Maybe this is intentional (maybe not), but the AI in my games just refuses to expand. In my current game, it's 1510 AD and Egypt and Japan each have 2 cities, while China, the Iroqois and the Babylonians have each stuck to their founding cities.
I've also got Aggressive AI turned on, but I've...