Yeah, come to think of it, this happened to Kubla Kahn in another game I was playing (he was leading) and the stack of swordsmen walked right by one of my cities, within my border, and made a bee-line for him. This was likely the same thing, since I'm almost always leading in points early on...