Too late.
You have to take organized crime into account - many common people, especially in posh regions, would be shocked how many armed foreigners are residing next to them, practically invisible to the general public. Once the established order evaporates all these territories are theirs and many people will get enslaved and killed.
The upper crust will get their two-caste society in all of the West.
