That's ridiculous.
I can only speak for Germany, but here people who are against refugees have virtually no influence on them, aside from the odd attack against them - which is bad, but really nothing compared to the number of crimes committed by the lowest individuals among the refugees, and something that doesn't happen often in the grand scale of things. Germany has created tons of opportunities for refugees, starting with courses where they can learn German and courses where they can get familiar with German Culture, to actual job opportunities. Their availability depends heavily on the area, and the coverage isn't ideal yet (hardly surprising, given how many refugees we've taken in without really being prepared for them), but even in the areas where they are available in abundance, many refugees still don't take that offer and don't want to integrate, instead are setting themselves up to be unemployables living in a parallel society.
These problems need to be tackled, not only for the "native" population, but also for the refugees themselves, and later down the line their children, and the children of their children. After all, we have just seen what happens when you don't help (and/or softly force) people to integrate with the Turks who stayed here after helping rebuild our cities after WW2, and are just now getting to a point where large parts of the last 1-2 generations of Turks begin to be fully integrated, after living separated, and in relative poverty for decades.
Deflecting and attacking people who are against immigration instead neither serves the conversation, nor the people you're trying to "protect" by not being willing to face reality.