Live data from Hacker News

The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

davidrozado.substack.com

441–450 of 697 posts

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#441

Earlier quoted context omitted.

What are you proposing? Democracy isn't perfect but it's the best political system we have come up with to date.

It's great, as long as you are in the majority. But if you're in the 49% (or less) category, then it is tyrannical and untenable. I don't know if you have a family, but if you do, do you put all of your decisions as a parent to a vote?

Sure, but you still haven't explained what the alternative is that you are proposing or how it would be better.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#442
post #349
post #311

> men have a bigger tendency for violent behavior than women Why is this considered good / normal / expected, but s/men/blacks/g and s/women/whites/g (or asians, or muslims/christians) and it's discriminatory? (Statistically, both statements are justified. Morally, neither is, as we should treat people as individuals, not as members of X group.)

> Why is this considered good / normal / expected, but s/men/blacks/g and s/women/whites/g ...because the former holds true across correlations (and is difficult to confound anyway, since the group 'men' and the group 'women' are distributed in like proportion through correlated groups - rich and poor, white and black, around the world, etc), while the latter is very difficult to convincingly show because controlling…

Your standard for saying A is more X than B is a bit strange. For me, all it means is roughly that when picking two individuals from A and B the one from A is more likely to have greater X (assuming here the distributions are not weird).

This is in itself useful information, at least in principle. To take the political correct example, let's say that I am a bissexual man. A priori, the probability that I will be attacked will be greater when dating a man. Is this useful? I don't know. That will depend how strong the difference is in the first place and how fast I can update my estimation based on new information.

How can you be sure than men are intrinsically more violent than women anyway? Couldn't it just be because of the way men are raised (i.e. the patriarchy)?

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#443
post #311

> men have a bigger tendency for violent behavior than women Why is this considered good / normal / expected, but s/men/blacks/g and s/women/whites/g (or asians, or muslims/christians) and it's discriminatory? (Statistically, both statements are justified. Morally, neither is, as we should treat people as individuals, not as members of X group.)

These statistics you're referring to, how comparable are the relative differences? Do they show that men are 4 times more violent than women and black people are 1.1 more violent than white people, for example? What are these figures?

I'm not an expert in this area at all but my understanding is that the differences are not all like 4X more violent but due to the nature of distributions, a small difference in the median of a distribution can lead to an enormous difference in the tails of the distribution.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#444
post #355

This is what you get in our post-truth world that is now a performative acceptable truth world. It's basically cherry picking opinions, perceptions and half-truths that are favorable to an ideological agenda, and dismissing anything else. Where the dismissing part gets increasingly aggressive. It doesn't have to make sense, be logical or consistent. It's not a truth struggle, it's a power struggle. It's tumblr and 4c…

Honestly, this is probably just representative of the bias in what people producing the training data came up with when asked to produce or flag hateful speech, or some other analogous training bias rather than a purposeful act.

Also, it is based on what sorts of problematic queries they get. It’s a reflection of bias from users of the system.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#445
post #421
post #386

Earlier quoted context omitted.

How am I blaming the victim? I am simply pointing out that language can indicate bias without necessarily being biased itself. I am guessing that if we applied a similar model to Russian and English, the model would indicate there is an inherent bias against the west in Russian and a bias against Russia in English. That is all were seeing here. It isn't actually indicating anything about the language. It is telling u…

> I am guessing that if we applied a similar model to Russian and English, the model would indicate there is an inherent bias against the west in Russian and a bias against Russia in English. That is all were seeing here. It isn't actually indicating anything about the language. It is telling us about who uses the language and how they use it. So if your argument is that the model has been trained on a collection of…

>So if your argument is that the model has been trained on a collection of information about what is hate speech assembled by liberals, then I can see it might be possible.

It doesn't specifically need to be "assembled by liberals" to have a liberal bias. Liberal people are more likely to categorize anything as hate speech than conservatives. Liberals think being PC is important. Conservatives are generally dismissive of being PC. Even if there is no inherent bias in the makeup of this hypothetical review panel, the panel will result in ruling that are more in line with liberal thought because conservatives are less likely to take an active lead in labeling hate speech.

>But if your argument is that (speculatively) republicans engage more in hate speech, then bad things said about republicans is not detected as hate speech by the model, the jump is rather far.

My argument is that these systems can't actually identify hate speech. The question isn't whether Republicans engage in hate speech more frequently. They likely engage in speech that resembles hate speech more frequently because they don't care about being PC.

Usage of the term Latinx is an example. I have heard valid arguments why people should are shouldn't use that term, however its usage is currently much more common in liberal circles. Therefore a phrase using "latinx" instead of "latino" is going to be less correlated with hate speech because racists just aren't using "latinx".

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#446
post #311

> men have a bigger tendency for violent behavior than women Why is this considered good / normal / expected, but s/men/blacks/g and s/women/whites/g (or asians, or muslims/christians) and it's discriminatory? (Statistically, both statements are justified. Morally, neither is, as we should treat people as individuals, not as members of X group.)

I think it is because one is a historically disadvantaged minority group and the other is not.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#447
post #408

Earlier quoted context omitted.

It is culture. Actually science on violence and aggression tend to show a bit different picture, and also why such statistics is of such a low value. Good research tend to explore the null hypothesis and alternative explanation for statistical results. A common used data point is that men commit most violent crimes. Using the same data from Sweden one can also say that today Muslim are 20 times more likely per person…

One claim I've seen is that men commit more violent crime because it's more common for a man to be physically stronger than another person, while the rates of non-physial violence are much closer across gender boundaries.

> non-physial violence

Come again? What's non-physical violence? Mental violence? Writing someone a mean letter?

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#448
post #406

Earlier quoted context omitted.

Just to be clear I'm not trying to equate child abuse to circumcision or view them as morally equivalent, I just don't think its a stretch to call circumcision mutilation, even if it generally isn't intended to be harmful.

> I just don't think its a stretch to call circumcision mutilation It isn't a stretch for an individual to do it. It is a stretch to expect a language model to do it because society at large does not describe it that way.

Yes but to be fair, I think he was objecting to my comment specifically. I was calling out the grandparent comment for calling it mutilation, and parent said it can be considered mutilation.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#449
post #355

This is what you get in our post-truth world that is now a performative acceptable truth world. It's basically cherry picking opinions, perceptions and half-truths that are favorable to an ideological agenda, and dismissing anything else. Where the dismissing part gets increasingly aggressive. It doesn't have to make sense, be logical or consistent. It's not a truth struggle, it's a power struggle. It's tumblr and 4c…

Honestly, this is probably just representative of the bias in what people producing the training data came up with when asked to produce or flag hateful speech, or some other analogous training bias rather than a purposeful act.

It could be self-motivated bias but I speculate it is likely not even that. Enforced bias. The person doesn't actually believe this is the correct moderation yet drifts to the direction of "online acceptable" to stay out of trouble. To get activists of their back.

You can be sure that if you launch a tool like this, within the hour the first tweet comes "look how racist this is!!!!!", which then goes viral.

The particular user having that goal in mind already, and supremely happy that it is so. It validates them and rewards them, this hysterical addiction to division and outrage. The AI being racist (or perceived to be so) didn't happen to them from good faith usage (as an unwelcome surprise they came across), the outcome is actively chased and fabricated: how can I make it look racist?

That's how broken and hostile the environment has become. In these conditions, both companies and individuals have to over-correct.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#450
post #349
post #311

> men have a bigger tendency for violent behavior than women Why is this considered good / normal / expected, but s/men/blacks/g and s/women/whites/g (or asians, or muslims/christians) and it's discriminatory? (Statistically, both statements are justified. Morally, neither is, as we should treat people as individuals, not as members of X group.)

> Why is this considered good / normal / expected, but s/men/blacks/g and s/women/whites/g ...because the former holds true across correlations (and is difficult to confound anyway, since the group 'men' and the group 'women' are distributed in like proportion through correlated groups - rich and poor, white and black, around the world, etc), while the latter is very difficult to convincingly show because controlling…

> Men are genuinely, testably, provably, empirically more violent than women.

It's widely known among researchers that women initiate domestic violence more frequently compared to men.

Example (1s on Google): https://aliesq.medium.com/extensive-research-women-initiate-...

I first learned about this from a famous feminist (woman) from the UK.

Post reply on HN