I'm not arguing that it's not a good idea, but waiting the few turns it may take for your city to grow might result in the same production time of the worker. Which means you'll have your worker, an extra size on your city, and production started on either a wonder, warrior, or granary.