meant to post this in general.
I really don't think they can fix the AI. It would take an enourmous effect to do it right. The first problem I see if finding the right people to actually do the job we want. In the world of Computer Science AI is still among those problems that have moved relatively slowly compared to other fields, I mean, compare the AI to any of ther other Civs, are the leaps in those fields comparable to the other sections of the game.
Civ, is more complex then chess by a huge order. The two big problems is the number of varibles:
The number of different units, their abilites, their use in combination with other units and how they should be used in their enviroment.
Second, in chess you have perfect information, this is not the case in Civ. To compound things the AI seems to have no memory as seen in a post of PlayWithMe (Rome). The AI doesn't know that your units were on the hill 1 turn ago if they lost vision of them. So, you implement memory and then prediction properly.
Given how simple Chess is compared to Civ and the time its taken for the AI to provide a challenge that we can expect from a human player its not going to happen for Civ.
Sure there are seemingly simple things that could be done to improve the AI:
1 Use your Generals... god. Its that hard. Increase the spawn rate of the generals for the AI on harder difficulties in additon or in exchange for the amount of units they can produce. Reducing the number of units the AI has will probably make the game go faster as well.
1b If your going to lose your City its ok for your General to GTFO.
2 We get numbers that say, hey, you will die if you attack. I would suggest the AI use these numbers.
3 Build proper terrain upgrades, seriously, even late game, I take someone's capital and I have to rework the terrain so that the city can grow. Let them have super workers or extra workers so that they can develop thier land properly.
4 Teach them how to play defensively, while its more difficult for the AI to do they need to build forts adjacent to their city so that it makes it harder to approach the city due to sphere of influence penality to movement.
4b There simple defensive things that can be done to just make it that much difficult to take cities such as clearing out forests around the city. Not attack my units on the over side of the river, rather waiting for my units to attack your fortified unit across the river.
5 Focus fire? Seriously...
6 Don't level my troops uncessarily. If the damage you can deal is < then the heal rate of my unit stop.
7 Don't make ranged units if your ******ed. Just make Warrior, Spearmen and Horsemen class if you can't handle the responsibilities.
8 Retreat your guys if they are damaged... you normally have like 10 other dudes behind you so you don't have to worry about getting run down.
In the end in comes down to being a hard problem to solve and the amount of money required to make an improvement. I don't know how sales for a game like Civ goes but most games will have 90% of their life time revenue generated in the first 3 months of their release. So... if I was a money guy, I wouldn't exactly be concerned about putting much more money into AI rather than producing DLC and explansion packs to solve problems and implement features that should of been including the game from the get go.