I don't know if you've lived in an Islamic country but I have. In fact I was born there and spent more than half my life under Islamic law. More to it, I am the same brown minority that you seek to defend by posting this.
Westerners are so naive, Islam's objective is to grow and convert as many people as possible. To this end, they have been building mosques all over the world, increasing their population and weaponizing immigration. There is a reason Muslim countries don't allow Christians, Jews and other faiths to flourish in their homes.
Now, is this applicable to all Muslims? Of course not. But don't be naive and think that no one has an agenda. Case in point, my family has Muslims (Shia) and there are some of them I wouldn't want in the West.
No one is advocating for an immigration ban here, or is attempting to bar Muslims. Suggesting caps and enforcing sane limits is a good thing. Nations need to vet their applicants thoroughly before letting them in.
As a final note, I think that immigration is a band-aid for the population collapse in the West. The real issue is the underlying culture change. Perhaps a better avenue is to focus inward and promoting family values instead of outwards to resolve the issue?