The migrant holding facility no longer has anyone being detained there, Home Office sources say.