I've encountered quite the opposite. The drug users seem to think that those who don't use drugs are, at best, sticks in the mud and boring, and at worst, self-righteous, mean, and extremely odd. Which is ironic; I mean, they look down on non-users while accusing them of arrogance.
At least 60% of my high school was on drugs, probably much more. They generally didn't bother the rest of us but if anyone said they didn't use or like drugs, they were quick to accuse them of arrogance. And one girl I knew said that you could never be popular/well-liked/however you choose to translate "beliebt" if you didn't drink.
Then there are the types who brag about driving drunk. Their kind kills tens of thousands of people a year, and an intoxicated driver killed my aunt and cousin. Apparently, that's okay, though, because the reckless pursuit of happiness at any cost, including even the lives of others, is their lifestyle and demands respect.
So think a moment before you slam us all as "arrogant".