I was playing a game and noticed workers poppingup in a couple cities. One I'd recently captured from Barbs and one that I'd recently received in a peace treaty. I looked at my number of workers in the military advisor and it remained constant. They just up and moved to another island by themselves.