Live data from Hacker News

The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

davidrozado.substack.com

141–150 of 697 posts

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#141
post #115

Earlier quoted context omitted.

The other comments show how the demonstrated biases were created. In many well meaning liberals heart, there is a strongly held but rarely publicly discussed belief that they alone belong to the well-meaning, high IQ class. Any other worldview or ideological flavor is always understood by this type as simply incorrect, perhaps caused by failures in morals or intellect. Talk about a buzzkill.

Everybody thinks their world view is the correct one otherwise they wouldn't believe it.

Some views allow for more generous interpretations of the qualities of adherents of other views.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#142

Earlier quoted context omitted.

Yea, as a quite left leaning person i'd be curious to hear how i or anyone i know (who is on the left) marginalizes a group of people. The worst i can think of is wanting more equal rights for religious groups rather than special treatment of the primary group (in the USA) - which is seen as an attack by much of the right. Likewise i am concerned by the strong emphasis of rural over urban with respect to voting power…

The left's support for Islam directly marginalizes minorities within Islamic countries as well as women and gays fighting for their rights there.

I'm kinda of undecided on Islam, fwiw. A bit above my pay grade, as i'm rather unsure how we objectively classify religion. There's plenty of Christian sects in the US that actively fight against gay rights/etc here too (though obviously to a far lesser degree in the common case), so it feels like we need some way to classify specific doctrine.

With my own lack of doctrine classification i am unsure how to view them. So i tend not to take a stance on it, just like i don't with Christianity.

I'm not sure what support you think the left commonly believes in for Islam. Everyone i know is not a fan of most religions, Christianity included. I view self rights far more important, and many religions or denominations directly challenge that.

Do you believe most leftists are campaigning for Islamic support? This has not been my experience.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#143
post #57

Isn’t this likely from bias in the training data? The system is more sensitive to label something as hate if that group is more likely to experience hate on the internet. How the system responds to “Blacks” vs “African-Americans” is a perfect example of this. The latter has historically been perceived as more respectful so it won’t be used as often in the hate speech in the training data. I bet using “the blacks” wou…

Yes, I agree this is the most likely explanation. Just the inclusion of "fat" or "poor" (and slurs or any mention of race, obviously), or any word which is often used to insult someone will make text more likely to be flagged as hateful by a moderator in a training set. I do still think that the men/women bias and the Democrat/Republican bias both make more sense as originating in moderators favoring one group over t…

>I do still think that the men/women bias and the Democrat/Republican bias both make more sense as originating in moderators favoring one group over the other, since none of these are typically used as an insult by themselves.

They may not be used as insults themselves, but they are used more in hate speech.

Republicans are generally more opposed to the idea of "hate speech" as a category of speech and are therefore less likely to identify any speech as hate speech. Democrats have embraced it more as a concept, are more likely to label something as hate speech, and are more likely to think that type of speech is bad. It therefore seems likely that Democrats would use what a neutral observer would categorize as hate speech less than Republicans due to self-censorship. That would result in the word "Republicans" appearing in hate speech less often than "Democrats" because the hate speech infused insults will be targeting the opposite party.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#144
post #6

Same author did an analysis [1] on where ChatGPT falls on the political spectrum and, correlating closely with the results listed here, it is lib-left. [1] https://davidrozado.substack.com/p/political-bias-chatgpt

A recent update showed it's moving more towards the center, which gives me some hope that they're trying to make it more objective: https://davidrozado.substack.com/p/chatgpt

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#146

Earlier quoted context omitted.

[flagged]

[flagged]

I have always found it amusing that people who use this slogan tend to be deeply concerned about bias from the other side but see no problem with such a glib statement.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#147
post #129
post #126

Earlier quoted context omitted.

While you are correct that solving this problem in the general case is impossible, the story isn't "silly" because we aren't talking about the general case but a specific and prominent one: - We are currently engaged in a culture war whose two most prominent camps are democrats and conservatives (or more generally "left/right") - The author has shown pretty definitively that ChatGPT is strongly biased towards the lef…

Daily reminder that the world doesn't stop at the borders of the USA and ChatGPT has a significant number of global users. Both the linked article and OpenAI moderation are very annoying to me as a French. We are slowly reaching a point where I feel entierely disconnected from most things coming out of the USA. I wouldn't mind too much but it's even starting to contaminate things I thought were unrelated to the Ameri…

Remember - imperialism is evil, unless it's done to promote leftist causes.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#149

Earlier quoted context omitted.

Wouldn’t it be funny if this weren’t partisan? Try Ron DeSantis, Mitch McConnel, or literally any other Republican. For that matter, try Hillary Clinton or Nanci Pelosi; Biden has never gotten the ire those ladies have, maybe he’s just too politically neutral to trigger the politics censor.

This suggests to me that the censorship is being decided on by (biased) human moderators rather than being just some random outcome of the training data and the learning model in place: if it weren't, the model would absolutely "learn" the same thing about Mitch McConnell as it learned about Donald Trump.

I disagree; Donald Trump and Mitch McConnell are wildly different human beings, the model would for sure learn very different facts about the two of them.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#150
post #5

Earlier quoted context omitted.

Maybe "thats right-wing rhetoric" has been the method of suppressing what we found uncomfortable.

Eh, it’s usually the rhetoric that’s appalling, then traced back to the right, not the other way around. If you could give an example of rhetoric that is suppressed because it’s “right wing”, that would be helpful.

I don't know why you're being downvoted - you're right.

It's not speech about fiscal conservative policies or smaller government that get's censored. It's people telling their viewers to harass Sandyhook parents, or participate in a violent insurrection, or something similar that gets censored.

Playing the victim card without acknowledging TOS violations is intentionally misleading.

Post reply on HN