Did the other civs have any reason to like you? I.e. same religion, tenets, gifts, trades, etc.? Did you have trade routes with any of them? DoF's?
If they're all neutral, then going on a conquering spree, regardless of who started the fight, would get you the Warmongering tag. That would be...