I'm not sure how many turns it takes, but the -5 modifiers to go away. Something else I noticed was this...
I built the UN, Ragnar was elected (really pissed me off because I was +15 or better with him the other largest civ), I defied universal environmentalism. Next election came up, I'm...