Nope. All you can do is manage as best you can.
You can try to tune down your faith generation (including selling shrines and temples, if necessary) or switching to tiles that don't generate faith (if you have a faith-giving pantheon, like desert folklore). Otherwise, you can park your GPs until you have discovered Astronomy and can spread your True Faith to the heathens on other continents, or you can plant them to form Holy Sites (+6 faith).
In the future, if you anticipate above-average faith generation, it can be useful to take a "faith-sink" follower belief, like one (or two) of the religious buildings or Holy Warriors, to get "value" for your pre-Industrial faith and avoid generating un-needed GPrs.