Absolutely. I think it's up to sensible right-wing people to make it clear that this isn't the case.
In the same way that it's hard to label people's views in two words, UKIP voters aren't all the same. Some will be people who see the power of Europe becoming too great. There will be some libertarian anti-federalists. Some will be anti-EU ex-conservative voters who see this as a defining policy. There will also be some people who don't want foreigners doing jobs that they believe people from the UK could and should be trained to do. Some are protest voters, and some (probably a very small proportion) are racists who see this as a defining policy.
To paint them all as being like the very small minority who would support overtly racist laws is like painting labour voters as supporting renationalisation of all industry.