Earlier quoted context omitted.
While I agree in general, there are plenty of circumstances where people don't get to not have an opinion about things. For example, you can't "agree to disagree" on LGBTQ rights if you belong to one of those categories. See also pregnant people and abortion rights.
A close friend of mine is, well, gay (as in man gay), and he doesn't have the fondest opinion of lesbians. He's also quite critical about trans people. He does like other (especially beautiful) men a lot, so that gay part is definitely covered, he's not in the closet by any means or anything like that.
I think I know why gay men tend to take this view way more often than the rest of the acronym, though: straight men don't hit on gay men, but straight men constantly hit on lesbians. If I had a nickel every time I heard "I can turn you straight," I'd be closing in on a couple dollars by now.