A sustained net migration loss could lead to “unexpectedly weak economic activity” in sectors that depend heavily on immigrant communities, the report warned.