Having an AI player do something obviously out of character because it's trying to win is almost as jarring as having it cheat in obvious ways
Yeah, I see what you are saying.
(And I was there for those days in Civ V. Civ V is the only game I've ever bought on release and participated in forum discussion of right from the get-go. I still remember not knowing whether to agree to a Pact of Secrecy with Alex against China because the Civilopedia wouldn't tell me what a Pact of Secrecy was. And I
still don't know).
Yes, particularly with the advantages that the AI civs get at the higher difficulty settings, they can wipe you out in the early game before you could conceivably get defenses up, if they are programmed to be as ruthless as possible. And that's no fun.
What I have in mind is not that, but something a little different: that each civ (think 1-6, not 7's new system) would settle in on a way that it wants to win the game. Not necessarily on turn 1, but on turn 75, maybe. And then from that point play (as well as they can be programmed to play) toward some specific victory condition, organizing
everything about their play so as to speed their progress toward that VC. Maybe I even do want it from turn 1, for a certain small number of warmongering civs. In Civ 5, Montezuma gets Jaguar Warriors, and any human player playing him would try to max out that advantage by taking out a neighbor or two in the early eras. So AI Monty, should do the same. I think what I'm describing is what 5 did eventually make its way toward. Its early programming for
every civ was "If I have military superiority, I should try to wipe this guy out," and
that got tiresome for the human player, yes. So, with revision, that got altered, properly.
But what I
do want is to feel like each AIs is deliberately trying to make progress toward a particular victory condition, and with the advantages they have (UUs, UBs, UAs) they have
advantages over me in reaching those objectives, and so there is a real possibility that they will beat me in the game. Not them just happily playing along building a civ, in general, and waiting for me to steamroll them.
So, to get back to the core issue, if the AIs always choose the historical path, I will not feel as though they are operating in the game as competitively as they could.