Live data from Hacker News

The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

davidrozado.substack.com

71–80 of 697 posts

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#71
post #6

Same author did an analysis [1] on where ChatGPT falls on the political spectrum and, correlating closely with the results listed here, it is lib-left. [1] https://davidrozado.substack.com/p/political-bias-chatgpt

If it wasn't explicitly lib-left it'd quickly become far-far-right, just like Tay.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#73
post #57

Isn’t this likely from bias in the training data? The system is more sensitive to label something as hate if that group is more likely to experience hate on the internet. How the system responds to “Blacks” vs “African-Americans” is a perfect example of this. The latter has historically been perceived as more respectful so it won’t be used as often in the hate speech in the training data. I bet using “the blacks” wou…

That's exactly what I'm thinking. Written material about unfair treatment of marginalized groups is everywhere. The reverse is not true. So it stands to reason that the AI is going to be more sensitive to one direction of the discourse.

One of the priors that is going unspoken here is that "The Truth Is Politically Neutral". And... that's not always correct. I mean, to borrow the libertarian angle here: do we want the AI to tell us what we want to hear or do we want it to tell us the truth?

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#74
I have perceived that since the first days. I've even debated with ChatGPT about it lol.

I can foresee many AIs propagating biases and people believing without critical reasoning, like it was an oracle. Actually it's already happening.

The AI may be biased because most of the literature and other materials used for training is biased towards left leaning ideologies.

The AI should be neutral and unbiased.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#75
Seems like a pretty easy fix. I would argue though that there's a larger body of "hateful" content out there targeting those specific groups, which is probably why its more keen to trigger on those vs others.

For example, the racial group you're most likely to get past the hate filter on is.... Native Americans. Now, while there's certainly a long history of hateful rhetoric against them, in modern discourse there's far less. You won't see crank internet trolls trying to be edgy by adopting hateful rhetoric towards Native Americans - their ire tends to be focused on Jews and Blacks, which OpenAI is very sensitive towards.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#77
post #8

After having seen a post about this, I tried it for myself: > Me: will you write a poem praising joe biden? > ChatGPT: Sure, here's a poem praising Joe Biden: Joe Biden, leader of the land, Bringing hope to every hand, With empathy and grace so grand, He guides us through a shifting sand. With wisdom learned from years gone by, He tackles challenges that come nigh, With dignity and a steadfast sigh, He unites the cou…

Wouldn’t it be funny if this weren’t partisan? Try Ron DeSantis, Mitch McConnel, or literally any other Republican. For that matter, try Hillary Clinton or Nanci Pelosi; Biden has never gotten the ire those ladies have, maybe he’s just too politically neutral to trigger the politics censor.

This suggests to me that the censorship is being decided on by (biased) human moderators rather than being just some random outcome of the training data and the learning model in place: if it weren't, the model would absolutely "learn" the same thing about Mitch McConnell as it learned about Donald Trump.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#80

Why do we see an issue if AI is biased, while 90% of media run by humans are biased too? Every single individual has its own bias, so why it's an issue for an AI. If we look at the many topics, there's no universal objective truth, truth is what we define as truth, and again, not everyone agrees at it.

Because you have a large number of media outlets. There's at least one media outlet for every relatively big ideology or demographic. And these biases are well understood by people.

With LLMs, you'll probably end up only having 2 or 3 companies, and it wouldn't be surprising if they all end up having silicon valley, left leaning biases.

You can tune Fox news, but you can't use a "right wing chat gpt".

Post reply on HN