Trust me, I know all of that. The Nazis didn't even "win" a national election because they never got more than a third of the votes.
My point is that things change. We may imagine that our liberal bubbles of respectability can't be punctured but that is a mere delusion. If Trump, the Leave victory, and other political events haven't woken people up to this fact they will not be woken up to it until the far right is in power.
My prediction is that things are going to continue to shift to a situation in which the far right has more and more of an advantage. Economic crisis will continue to recur as nothing has been done to address its causes. Migrants are going to continue to flood Europe as no solutions to the problems causing the migration are on the table.
The US may be in marginally better shape, but if a major financial crisis occurs during Clinton's presidency and the government is paralyzed and unable to respond effectively, I expect a similar rightward lurch to take place.