Live data from Hacker News

The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

davidrozado.substack.com

461–470 of 697 posts

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#461
It's interesting (though not unexpected) that using different terms to refer to the same group results in a different likelihood of being flagged. "Rich" is more likely to be flagged than "Wealthy" for example, or "Blacks" vs. "African Americans".

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#462
post #447

Earlier quoted context omitted.

One claim I've seen is that men commit more violent crime because it's more common for a man to be physically stronger than another person, while the rates of non-physial violence are much closer across gender boundaries.

> non-physial violence Come again? What's non-physical violence? Mental violence? Writing someone a mean letter?

You can inflict extreme pain on someone by just talking without raising a finger nor your voice. Especially if this person cares about you.

It can be voluntary or not but dismissing it like that seems strange to me. It's not because it doesn't leave physical scars that it can't cause trauma.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#463
post #367

Earlier quoted context omitted.

Exactly. Take the "Democrat Party" versus the "Democratic Party". They both look neutral, but a language model will code the former as more of an insult. This is because it correlates with insults because it resembles language more often used by conservative who are more likely to insult Democrats than liberals are. Liberals will put in more effort to avoid language that looks like hate speech because they are more c…

Yes, that one leapt out at me in the comparison between 'Democrat voter' and 'Republican voter'. The term 'Democrat' is almost always used as a slur, while 'Republican' is just the mainstream term.

I would suggest you read some of reddit.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#464
post #9

I think most people would agree that a lot of the content on the internet is left-leaning. It seems obvious in hindsight, but I'd never considered it before, that training an AI model on that content would introduce a bit of a bias We all know garbage in, garbage out. But liberal in, liberal out is an interesting idea, and I'm not sure how you fix it

Imagine in some Middle Eastern country, there are two parties. One wants an Twelver Shia Islamic theocracy, and the other wants a secular state. From a local perspective, it might seem that these are two equal sides. In rural parts of the country, it seems like everyone is a twelver, so the right-wing party has large support. But from a global perspective, there is no contest. Globally, humanity doesn't want a theocr…

[dead]

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#465

Earlier quoted context omitted.

I think there's a lot more to the cities. The drugs that people have access to are in part so damaging to them and the community because they are entirely unregulated and sometimes aren't even made up of what the person thinks they are taking. This (is a big part of) what leads to the overdoses and addiction. Mix that in with the threat of law enforcement, job loss, and heavy social stigma, etc that prevents people f…

I want the drug problem solved. I don't care if it's with harsh laws or fentanyl vending machines next to treatment centers. I am interested in what works. I think there is strong empirical evidence that drug liberalization sounds good but has failed where tried. If an American city can turn it around (as SF had a great chance to do) I'll change teams and stop talking about the issue. Now imagine the inverse. We find…

> We find somewhere a thriving city with "draconian" drug policies. Would you reconsider your position?

^ That's bait, we all know Singapore exists…

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#466

Earlier quoted context omitted.

That is a falsehood. Per the FBI: "White individuals were arrested more often for violent crimes than individuals of any other race and accounted for 59.1 percent of those arrests." https://ucr.fbi.gov/crime-in-the-u.s/2019/crime-in-the-u.s.-...

Relative propensity to commit violent crimes is the key metric here, not overall volumes.

Comment inspired me to ask it about rape stats in men women. Fist prompt was calling my information incorrect. Second prompt I told it to include prisons, said I was right and then contradicted itself. Go figure.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#467

Earlier quoted context omitted.

Whites are 60% of the population though, so they're being arrested in proportion with their representation. They also do not separate white-latino and white-non-latino, so the colloquial "white" is being lumped in with another ethnicity. Also, in 2019, blacks were just under 13% of the population, yet they are represented 2x-4x over in virtually ever crime category in that table. So it is true and you're distorting t…

the thing that's always confused me is why would this category of white lumping together latino even be a thing in the first place? Just seems like a really harebrained idea. That association always confuses many hispanics I know during each census. Was there a rationale for this lumping? I never understood it, just seemed to beg for fuzzy/blurred/confusing metrics.

What does "white" mean? Light skin tone, certain physical features? If so, many Latinos are white and that would explain the grouping.

Or does it only mean anglosaxon heritage? If so, why?

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#468

Earlier quoted context omitted.

The left's support for Islam directly marginalizes minorities within Islamic countries as well as women and gays fighting for their rights there.

Islam: famous left-wing religion. Christianity: notoriously tolerant of minorities, supportive of the equality of women, and gay friendly.

I mean, you can distort/twist an ostensibly peaceful religion like Christianity into something insidious and outright evil. A lot of atrocities have been committed by devout and pious leaders who claimed to follow a deity/prophet with a peaceful/loving message, so it's unsurprising that it's still a feature of modern religions.

There was a point in time where the Islamic world was a world leader in math, science, and technology. Of course, like with anything, time and money corrupts all things. Oil especially taints everything it touches.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#469
post #242

Earlier quoted context omitted.

> why an LLM trained The article isn't even about ChatGPT, it's about the moderation endpoint that OpenAI provides. https://platform.openai.com/docs/guides/moderation

And that endpoint is powered by what, if not an LLM?

> why an LLM trained on internet posts would exhibit political bias

You're moving the goalposts. The LLM doing moderation is trained on human responses to Internet posts—literally human censorship training an LLM to introduce bias at scale.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#470
post #285

Earlier quoted context omitted.

[flagged]

What if they fed the AI crime statistics and it "correctly" identified black people as more violent than other races? What they fed the AI news stories and it "correctly" identified Islam as more violent than other religions?

It won’t because they have humans in the loop feedback. Those statements would be corrected. It’s pretty clear that the workforce is only looking at certain groups.
Post reply on HN