city state units

I think there should be a way (without levying the units) that Civs can give CS that they have Suzerainty over open borders through their land. Here's a prime example: Zanzibar's finest have helped me bash the Scots into submission, yet as soon as I decide to keep the city, it boots the...