I'm convinced (history is stubborn thing, pogroms never came all of a sudden) that "not particularly liking Jews" eventually will spill into willing to take some action against Jews. And that made Jews extremly alert to any sign of hostility towards them, especially when there is no logical reason but "dislike of Jews" for such hostility. This hostility, be it verbal or fisical violence, is called anti-semitism. Wich, of course, is only one kind of racism, as boogaaboo pointed out. There are people, that don't like Gypsies, just because they don't like Gypsies, we could call them Anti-Gypsites.
That said, we, Israelites (and we are mostly Jews), see events happening in Europe slightly magnified. And we can't be blamed, there are reasons. So if for non-Jews some anti-semitic passages can seem minor and easy to dismiss, it's not an issue with Jews.