Brexit has made town twinning a battleground – but it's always been political