A Swiss-style Brexit deal is unlikely unless things change dramatically within the Conservative Party