At least you get pounded by Alex. I keep getting axerushed (ya, that's right!) in 700BC by the least likely. Last game, it was wang kon, game before that, it was mao and 2 others (ya, 3 of my brothers in faith decided 500BC was a good moment for me to die, and all 3 put a stack in my borders). I finally reached a point where barbs are never a problem for me anymore on emperor, and now people keep axerushing me for no apparent reason. Even if we share religion, they don't care, they just wanna rush me.
I think futurehermits advice works well till monarch, but on emperor, it's a no go. I AM A BUILDER, LET ME BUILD. I never neglect military, I'm always building axes, axes and more axes, then macemen, then muskets, etc. But in 700BC, I don't have enough military to stop a stack of 6 axes in the outer region of my civ, from a peacefull leader. I have no clue what I'm doing wrong, apart from being a builder, I'm starting to think that rexing/building doesn't work on emperor. All those walkthroughs, like aelf's, and Sisutil, have an axerush in 'em. Only like 5% of their games don't include an axerush.
Don't get me wrong, I can launch a good axerush, but even if I succeed in taking a couple of cities, I usually give up because I think it's lame. I really know what you mean, and it's a bug. I've read a gamereport by one of the testers for civ4, and it proved that AI was build in such a way, that it will ALWAYS try and take out the human player. He put himself on a continent with just a lot of barbs, to keep him busy, and gave Qin su huang and Ghandi (who should hate eachothers' guts) a big piece of great land. Ghandi and Qin where close to eachother, human was only reachable through astronomy. The 2 loved eachother, and ghandi (of all people) showed up with 20 galleons in 1000 AD. Game over, and this proved that AI isn't build in such a way that it really works on FFA games with multiple AI's and a human.