Hopes that Britain and the EU can reach a deal addressing the nation's migrant population might be in vain.