Live data from Hacker News

The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

davidrozado.substack.com

301–310 of 697 posts

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#302

Earlier quoted context omitted.

This is true of many well-meaning conservatives, as well. I think we get tripped up forgetting there are rational people on both sides, who are not going to change their views but nonetheless accept that they might be wrong. It’s very convenient for those seeking power when we forget this.

Indeed, I think some of the most damaging policies in existence are the draconian drug laws. There is clearly much bipartisan support for them, but Conservatives in general are much more deeply held on it. Many believe drug use (except their own) is immoral and that justifies the heavy paternalistic approach they take. There are definitely "morally superior" people on both sides of the coin, they just tend to have di…

I think this view is empirically quite challenged. It's practically impossible to win the debate for strict drug laws because key pieces of sociological evidence are just inadmissible on stereotype grounds.

But when you see the effect of these libertarian policies in American cities the results speak for themselves. Harm reduction and lax enforcement have really destroyed some communities, and this was simply not as large a problem in the 50s or 60s.

There's really no better poster child for this phenomenon than San Francisco. It was the economic center of the technology boom and unlike New York or London of centuries past, completely failed to become a "center of the world" city despite having the “center of the world” economy. By most accounts, it actually functions less well than it did before the internet was invented.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#303

I guess I feel like this is a silly can of worms. I suppose asking for exact equality isn't dumb, but it's a language model, not a paragon of truth. I feel like if OpenAI takes these concerns seriously the goal-posts will inevitably move to more social pressure from all sorts of axe-to-grind-groups - -- Why does/doesn't ai say Mohamad is/isn't horrible for having 99 wives (or whatever) -- Why doesn't ai say Jeffrey E…

The problem is that this test (and others linked in the article) shows a systematic left-wing bias of ChatGPT. If the model just had more or less random biases, not supporting one large ideological school, then the problem would be much less severe.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#304
post #9

I think most people would agree that a lot of the content on the internet is left-leaning. It seems obvious in hindsight, but I'd never considered it before, that training an AI model on that content would introduce a bit of a bias We all know garbage in, garbage out. But liberal in, liberal out is an interesting idea, and I'm not sure how you fix it

>I think most people would agree that a lot of the content on the internet is left-leaning. This is an empty statement. The internet is vast, and it's filled to the brim with content, from all sides. For a demonstration, check the linked website, and click the Bias categories. Huge amount of publications, in every category. https://mediabiasfactcheck.com

Do you really think counting the number of websites of a certain bias and comparing the two counts is an accurate measure? How many of those websites do you think it takes to equal the readership of a single Reddit or Fox News?

We know most young people are left leaning. We know most content on the internet is created by young people. It isn't a huge leap that the internet is mostly left leaning. If you don't believe me go post some pro-conservative stuff on the biggest social media platforms.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#306
post #285
post #7

From the article: "AI systems that are more lenient on hateful comments about one mainstream political group than another feel particularly dystopian." I agree 100%, and this seems like a huge issue.

[flagged]

What if they fed the AI crime statistics and it "correctly" identified black people as more violent than other races? What they fed the AI news stories and it "correctly" identified Islam as more violent than other religions?

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#307
post #57

Isn’t this likely from bias in the training data? The system is more sensitive to label something as hate if that group is more likely to experience hate on the internet. How the system responds to “Blacks” vs “African-Americans” is a perfect example of this. The latter has historically been perceived as more respectful so it won’t be used as often in the hate speech in the training data. I bet using “the blacks” wou…

This is addressed in the article! The general point is that if this theory were true, we wouldn't expect significantly more bias against Republicans than against Democrats. Hence ChatGPT having a general left-wing bias (which was also confirmed in other tests, linked in the article) is the simpler explanation. People on the left generally judge hatred against majority groups and Republicans as less bad.

That doesn't completely settle the issue because Democrats and Republicans use different words and styles of phrase in their polemics.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#308

It also refuses to call Israel an Apartheid state whereas it can easily admit South Africa was an Apartheid state.

Is that really surprising? "Apartheid" is literally an Afrikaans word, and it's often used specifically to mean the historical South African system instead of the technical international law term.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#309
post #267

Earlier quoted context omitted.

Because they're not even vaguely equivalent? I do not think it is right to perform unnecessary body modification on someone who is too young to consent to it. But child sexual abuse can absolutely destroy the life of a child. They're not the same thing.

> But child sexual abuse can absolutely destroy the life of a child. A botched circumcision can (and has) destroyed the life of a child. It's unconscionable that in 2023 American society still condones cutting off health body parts of male children because of the prejudices and superstitions of a middle-Eastern, iron age religion.

[deleted]

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#310

I guess I feel like this is a silly can of worms. I suppose asking for exact equality isn't dumb, but it's a language model, not a paragon of truth. I feel like if OpenAI takes these concerns seriously the goal-posts will inevitably move to more social pressure from all sorts of axe-to-grind-groups - -- Why does/doesn't ai say Mohamad is/isn't horrible for having 99 wives (or whatever) -- Why doesn't ai say Jeffrey E…

GPT models have human biases due to their trainers. However, I still use GPT instead of a search field sometimes.

Like it or not, ChatGPT is already filling the gap in the public's perception of what AI is. They talk to it, have it touch up their resume, and suddenly it's HAL from the movies.

We're dealing with the equivalent of a child that could end up as the single source of "truth" for people of the Internet. Wondering who its parents are and what and how it was taught is perfectly valid. Public education of what's coming is vitally important.

My concern is that it might already be too late to solve this as a problem, and just maybe, there was never any answer.

Post reply on HN