Earlier quoted context omitted.
Unless you're someone's physician you can't really make an assessment that would allow you to determine if someone is intellectually disabled, so don't use it as an insult.
Am I allowed to allege that someone or some act was negligent without being a lawyer? Can I call someone incompetent without performing a study?
For example, I could say that you're ignorant of the harm that the colloquial use of "retarded" has on disabled people. I could say that you're being needlessly obtuse or selfish by claiming that you should be able to call things "retarded" despite polite requests to stop. I could say that you're callously dismissive of disabled people who are asking for you to stop using the word "retarded" as an insult.