Removing him only removed him from your conversation. He is not silenced. Same with banning the Trump reddit forums, what this achieved was to shift them to their own platform where they, no longer hear opposing views or being challenged. And to me it seems worse than ever in their views and speech, shockingly though sometimes.
Using something like the Paradox of tolerance logic is dangerous itself. People love to find justification to their own bad deeds, and this smells like something along those lines to me. The 'I cant be too tolerant or you will use it against me'.
I think the key flaw in the Paradox you quote is "tolerant without limit". I agree if this were true, but society has never had this and never will, it's such an absolute. As fairly standard wherever you live you will have libel and slander laws, rules about promoting things illegal, or encouraging violence.
Overall is a giant problem and is full of grey zones without a perfect answer, but in that I feel its important to steer strongly to the higher principle, be it tolerance or free speech etc, and accept there is cost to higher principles, as sad as that is, but this is far better than allowing a society to swing the other way.