Like (nearly) all things in CIV, it depends!
Right off, there are several things to consider -
1. Like you said, if there is a wonder there that you want, keep the city. Most of the time this will be a capitol city, which is nearly always in a really good spot.
2. Is it placed well...