I put the majority of the blame on the racists. Without their solid support for Brexit, it’d never got across the line