What wont be changing is the AI mounting a proper defense. In 2.08 the AI's are VERY much pinata's - bursting with goodies to be liberated with even trivial military investment. So while the unit spam will be toned down, the Pinata's will not be coming back.
I'm not asking for piñatas.
Don't discount what I'm about to say. I know a wrote a long and loud post. Ignore it. Read this one instead.
I'm asking for a different design philosophy. There are many kinds of AI. Some AIs play to not lose. Others play to obstruct or harass the human player. A few very good AIs play to win. These are all great goals for particular types of games. I don't think any of them is appropriate for Civilization.
AI civilizations should play to be interesting components in the game. What do I mean? I mean that the AI should seek to provide situations with interesting, challenging, and non-trivial decisions for the player.
Defender-spamming is playing to win, playing to not lose, and playing to obstruct a common human strategy. Defender-spamming does not create choices. It limits them. It makes conquest/domination victories tedious and boring, it forces the human to participate in the unit-spam game, and it blatantly reduces the military options for small civilizations. Besides that, unit spam in general causes performance issues in the Modern Era.
I recommended a unit cap because it is an easy and effective solution. 7 to 8 defenders per a city is far more than the AI ever produced with the default code; in general, they never produced more than 20 units in an offensive stack either. Limited stacks are also manageable and affordable for the AI, even under the Pacifism civic. If you can find a way to convince the AI to limit itself naturally instead of artificially, then that'd be best. But until then, I offer my opinions and solutions honestly and openly. I'm here to have fun, and I have more fun playing (and sometimes losing to) the regular AI on Emperor than I have playing (and always peacefully defeating) the defender-spamming AI on Prince.