For pure fear factor, I'll go with ancient cavalry or crusaders. It starts when your aggressive neighbor gets the Temple of Zeus or the Knights Templar. You know they're coming; you just don't know when.
Then, when the first one shows up at your doorstep, you do some quick math in your head...