Shillen said:
That's the only possible way to make the game difficult. You can't make the AI smarter than the player is.
True, you can't make the AI smarter, but there's another option: you could dumb the AI down on lower levels (or maybe that's the case already? I'm not sure). Apparently they decided not to do that and I think rightly so. I think it would destroy the game feel too much; e.g. it's easy to get the AI to mishandle workers, this will weaken it considerably. It would be a nice challenge to make a mod to make the AI weaker by not changing AI and player bonuses. But someone else than myself will have to do that; that's not a mod I'm interested in
Another option for lower levels, now that I'm thinking about it, is used in the latest Fritz chess engines. There's a handicap mode, where somewhere in the opening stage, the AI will do something silly on purpose, losing say, a pawn to the player if he sees the combination to do so. After that, the AI plays on full strength again and the player has the satisfaction of bringing home the point against the AI at full strength. At a still even lower level, the AI e.g. will 'oversee' the loss of two pawns.
This took quite some time to balance, but this works well now; the computer keeps a history of the results over several games and ultimately you wind up at a level where your odds to beat the computer are at 50%. If you're stronger than the AI in Civ4 you're still stuck with adapting bonuses here of course.
So it might be interesting to see if implementing likewise behavior is feasible for Civ4. Maybe COTM style giving the player an extra settler and tech at the start would be a possible implementation there, although that maybe gives too much of an exploitive feel to it. Maybe in the first trade sessions the AI could be more generous than usual to give the player an edge.