True but the EU can choose to setup any trade barriers they choose against these countries. In fact there was a drive to do so in regard to chineese steel imports but the UK was one of the countries that argued against it. I am not saying the UK was wrong as tarrifs can lead to tit-for-tat retaliations.
I would wonder how brexit would effect the "the city"?