it's usually easy enough to avert bans to make them not annoying. I always play on epic speed, immortal/emperor on normal/large maps.
If you have Forbidden palace and you are the starting host (neither of which is too hard to get, albeit ai loves hugging palace), you start with enough votes to define the outcome of at least one of the two votes without effort.
Diplomats are the keys to bending (or twisting) the congress the way you want. Before the first congress convenes, you can visit and "persuade" 6 civs (double if you play England), which is all but one on a normal map. The cost of buying votes is usually negligible as well. You can easily make world religion pass on the first one even without palace and starting host, averting a luxury ban is just as easy.
Or you can always propose something you know most ais go for, giving their vote for a yea on yours instead of a lux ban. Good examples are arts funding or cultural heritage sites.
Also, diplomatic hits from congress are miniscule compared to ideology picks, don't worry about them.