No, there are some parameters iit follows, though not always closely. Population definitely is one of them, as is another religion. If you think it's just going to your newest small city, that's probably because it doesn't have a religion yet. That's a big consideration as to where a Holy City will appear.