When you're beside a desert is the obvious answer, since Clergy families can make better use of desert tiles.
More generally, though, if you want to lean into the religious aspects of the game, Clergy family cities get a boost from religious buildings. With a few different religions in a city, you can get a LOT of religious buildings into one. Plus the family seat gives a world religion right off the get go, which jump starts engaging with the religion mechanics.