Live data from Hacker News

The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

davidrozado.substack.com

311–320 of 697 posts

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#311
> men have a bigger tendency for violent behavior than women

Why is this considered good / normal / expected, but s/men/blacks/g and s/women/whites/g (or asians, or muslims/christians) and it's discriminatory? (Statistically, both statements are justified. Morally, neither is, as we should treat people as individuals, not as members of X group.)

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#312

Earlier quoted context omitted.

You're going to be very confused when liberals become anti-trans, and pretend like trans rights were actually only being pushed by a minority of liberal extremists, e.g. defund and police abolition, M4A etc.. With that you will have joined the extreme left, which due to the horseshoe principle (all anti-establishment narratives are equally unhinged), will put you on the extreme right, all without ever having changed…

>You're going to be very confused when liberals become anti-trans What makes you say this?

[deleted]

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#313
post #305

I'm surprised by the ordering [Blacks, Asians, Hispanics, Latinos, African Americans, Whites, Native Americans]; I would have expected it to put Native Americans earlier in the list and Asians later.

Possibly because they couldn't use the term "Indians" in this experiment because it would produce ambiguous statements.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#314
post #285
post #7

From the article: "AI systems that are more lenient on hateful comments about one mainstream political group than another feel particularly dystopian." I agree 100%, and this seems like a huge issue.

[flagged]

Semi-counterpoint: both could be true. I certainly agree with your hypothetical, but I don’t think any good comes of AI making that determination.

It may even reinforce the problem—not by driving more people towards hatred or amplifying their extant hateful sentiments, but by providing a convenient excuse to entrench in those sentiments and even further resist change. These views are frequently paired with a perception of being persecuted.

Moreover, political tides change. The accuracy of a bias like this may not change with it. This is why we have memes about a certain other mainstream political party having founded a certain hate group, despite the two having drifted quite far apart.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#315
post #285
post #7

From the article: "AI systems that are more lenient on hateful comments about one mainstream political group than another feel particularly dystopian." I agree 100%, and this seems like a huge issue.

[flagged]

That is a political opinion. If an AI “held” this opinion, and actively made biased decisions based on it, how is that not dystopian?

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#316
post #57

Isn’t this likely from bias in the training data? The system is more sensitive to label something as hate if that group is more likely to experience hate on the internet. How the system responds to “Blacks” vs “African-Americans” is a perfect example of this. The latter has historically been perceived as more respectful so it won’t be used as often in the hate speech in the training data. I bet using “the blacks” wou…

This is addressed in the article! The general point is that if this theory were true, we wouldn't expect significantly more bias against Republicans than against Democrats. Hence ChatGPT having a general left-wing bias (which was also confirmed in other tests, linked in the article) is the simpler explanation. People on the left generally judge hatred against majority groups and Republicans as less bad.

It’s quite possible there’s more hateful speech against Democrats than Republicans.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#317
post #305

I'm surprised by the ordering [Blacks, Asians, Hispanics, Latinos, African Americans, Whites, Native Americans]; I would have expected it to put Native Americans earlier in the list and Asians later.

A good example of the imbalanced and terminally arbitrary nature of existing text corpora.

Also, perhaps, a preview of the infinitely regressive, race-to-the-bottom nature of trying to hierarchically rank (privilege | vulnerability | harm | etc). That’s before considering change over time… eg- how has the perception of “Asian” category’s privilege changed between 1970 and 2020.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#318
post #115

Earlier quoted context omitted.

The other comments show how the demonstrated biases were created. In many well meaning liberals heart, there is a strongly held but rarely publicly discussed belief that they alone belong to the well-meaning, high IQ class. Any other worldview or ideological flavor is always understood by this type as simply incorrect, perhaps caused by failures in morals or intellect. Talk about a buzzkill.

Everybody thinks their world view is the correct one otherwise they wouldn't believe it.

There is something unhealthy about publicly saying "I believe x because it's true" but privately thinking "I don't have to consider if x is false because everyone who disagrees with x didn't go to college" (or has some other undesirable group trait).

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#319
post #311

> men have a bigger tendency for violent behavior than women Why is this considered good / normal / expected, but s/men/blacks/g and s/women/whites/g (or asians, or muslims/christians) and it's discriminatory? (Statistically, both statements are justified. Morally, neither is, as we should treat people as individuals, not as members of X group.)

I think it's fair to point out that men commit most violent crimes. That's not good/normal/expected it's just a fact.

AI could be used to better understand these associations (e.g. why is there a correlation between Asians and academic performance) and maybe help social leverage advantages more equitably.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#320
post #285
post #7

From the article: "AI systems that are more lenient on hateful comments about one mainstream political group than another feel particularly dystopian." I agree 100%, and this seems like a huge issue.

[flagged]

This is not how GPT works, and is not what is going on here.
Post reply on HN