Here is a pic to make it more clear:
note; the worker is blue, while it should be orange as is the color of its civ... I don't know exactly how to reproduce this bug, but here's the sav of the game it happened (please first download and install the scenario in my signature to be able to open the sav)
http://www.civfanatics.net/uploads6/fortbug.zip