To be sure, but in that case, when you take back what once was yours, you're taking what is now theirs. Has nothing to do with the trade (in fact, the AI may well trade to another civ whatever you traded to them, and you may take it back from THAT civ when you conquer one of their cities -- "Hey, didn't I trade that Great Work to Korea?").