I think that's the point we're entering now. The UK is a relatively conservative country in European terms and I think you'd find a large number of people hold to some degree racist views. Oxford Uni's Migration Observatory say 53% think immigration is too high and 32% think its a bad thing. That's potentially almost 40 million people who have some bad feeling towards immigration and over 20 million who are bordering on what some would call racist. You can't just ignore that many people and label them all as racist. That further entrenches them in their views and results in what we're now seeing. It needs government policy, education and most importantly integration efforts that have not been there for at least the last 30 years. If we crack down on the riots, lock a few people up and then sweep it under the carpet we'll be back here again in a few years.
Unfortunately i think we are now reaping the results of what has been a higher rate of migration to the UK than European peers, without an associated increase in public spending and integration efforts. Not sure i see an end to the bad feeling that's been brewing as it's been going on for so long we now have an entire generation that has grown up with it.
You can't ignore them but you have to also recognize that they are xenophobes, you also have to recognize that many politicians have cultivated xenophobia to gain votes while doing nothing for citizens of their country which increases the likelihood of creating new xenophobes.