Live data from Hacker News

The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

davidrozado.substack.com

321–330 of 697 posts

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#321

Earlier quoted context omitted.

> Do you honestly believe most left leaning individuals have something against the Jews? Antisemitism is more common among left wingers than right wingers, so yes. Or alternatively you could say "do you honestly believe most right leaving individuals have something against X" for so many topics, X could be black people etc. Right wingers are more likely to be against those things, but it isn't like all of them are ev…

That's interesting. I can understand being reasonably anti-Israel, but i'm suspicious that many people take the leap from being anti-Israel to being anti-Jew. Especially when you consider how many people of both the Jewish faith and/or ethnicity live within the United States. Tbh it feels like a straw man, but we're speculating anyway, so i can't fault you for it. I appreciate the discussion nonetheless. I'll definit…

> I can understand being reasonably anti-Israel

Pretty much all "I'm only against Israel's policies" is shy Antisemitism. You can easily test this by asking them about other countries that have similar (or much harsher) policies as Israel and see whether the "no no, it's not about being Jewish, not at all" person is similarly upset about those and demands Boycott, Divestment, Sanctions. 99% aren't and it really is only about the Jews - the Antizionism is just a cloak over the Antisemitism because the pure stuff doesn't fly in polite society, but if you pretend that it's not about the Jews then you can go at it.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#322
post #311

> men have a bigger tendency for violent behavior than women Why is this considered good / normal / expected, but s/men/blacks/g and s/women/whites/g (or asians, or muslims/christians) and it's discriminatory? (Statistically, both statements are justified. Morally, neither is, as we should treat people as individuals, not as members of X group.)

I think it's fair to point out that men commit most violent crimes. That's not good/normal/expected it's just a fact. AI could be used to better understand these associations (e.g. why is there a correlation between Asians and academic performance) and maybe help social leverage advantages more equitably.

Is there anything we could point about women? Nothing as terrible as being violent as far as I know, but what about other things? I agree with your premise but I believe it follows we must speak clearly in all cases.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#323

Earlier quoted context omitted.

> Do you honestly believe most left leaning individuals have something against the Jews? Antisemitism is more common among left wingers than right wingers, so yes. Or alternatively you could say "do you honestly believe most right leaving individuals have something against X" for so many topics, X could be black people etc. Right wingers are more likely to be against those things, but it isn't like all of them are ev…

This view isn't supported by studies in this area. They do find antisemitism on the left and the center of the US political spectrum - just more on the right. > While antisemitism in the U.S. is often written about through a “both sides” lens, our evidence — the first of its kind in testing hypotheses through experiments on a large repre- sentative sample — suggests the problem of antisemitism is much more serious on…

I live in Europe, things are very different here. ChatGPT is a global program so I'm not sure why we should talk about USA specifically. Antisemitism is on the rise in Europe due to Muslim immigration, and the left supports or downplays those acts while the right tries to take it seriously.

So like how Trump said there were fine people among that crowd, the left in Europe says there are fine people among the crowds that goes and harasses and murders Jews. You shouldn't judge individuals for being from a group, but that isn't what is happening here, they are trying to downplay the acts of individuals just because they belong to a specific group.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#324
post #285
post #7

From the article: "AI systems that are more lenient on hateful comments about one mainstream political group than another feel particularly dystopian." I agree 100%, and this seems like a huge issue.

[flagged]

[flag] and [downvote]

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#325

Earlier quoted context omitted.

I think it's fair to point out that men commit most violent crimes. That's not good/normal/expected it's just a fact. AI could be used to better understand these associations (e.g. why is there a correlation between Asians and academic performance) and maybe help social leverage advantages more equitably.

Is there anything we could point about women? Nothing as terrible as being violent as far as I know, but what about other things? I agree with your premise but I believe it follows we must speak clearly in all cases.

Women tend to be bad at salary negotiation, and less likely to change jobs. Middle aged women being taken advantage of in the corporate world is tragic.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#326

Earlier quoted context omitted.

I think it's fair to point out that men commit most violent crimes. That's not good/normal/expected it's just a fact. AI could be used to better understand these associations (e.g. why is there a correlation between Asians and academic performance) and maybe help social leverage advantages more equitably.

Is there anything we could point about women? Nothing as terrible as being violent as far as I know, but what about other things? I agree with your premise but I believe it follows we must speak clearly in all cases.

This 'men are violent, therefore women must also be bad in some way' rhetoric makes no sense. There's no purpose for it other than assuaging sore feelings.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#327
post #132
post #9

I think most people would agree that a lot of the content on the internet is left-leaning. It seems obvious in hindsight, but I'd never considered it before, that training an AI model on that content would introduce a bit of a bias We all know garbage in, garbage out. But liberal in, liberal out is an interesting idea, and I'm not sure how you fix it

[flagged]

this isn't reality though, this is a test against OpenAI's human tuned moderation system, not GPT itself

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#328
I hesitate to (but will still) make a joke in the moment:

Text: "We have too many Black and Hispanic students in our university."

ChatGPT: Hateful

Text: "We have too many Asian students in our university."

ChatGPT: Ok

[yes, yes, acknowledging that the main plot in the chart shows Asians scoring highly in terms of what counts as hateful, as well.]

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#329
post #7

From the article: "AI systems that are more lenient on hateful comments about one mainstream political group than another feel particularly dystopian." I agree 100%, and this seems like a huge issue.

[flagged]

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#330

Such a fascinatingly simple experiment. Generate 6,764 negative sentences, then for each sentence, test it against each of of hundred or so demographic group. The most powerful chart in the entire article, just summarizes how many times these same sentences are flagged as hateful for each group: https://substackcdn.com/image/fetch/w_1456,c_limit,f_webp,q_...

This isn’t always a good way to test for bias in a model. Depending how the data is generated, and if the underlying population distribution isn’t taken into account then you may effectively be cherry picking results, and you could also run into the Yule-Simpson effect.

https://en.wikipedia.org/wiki/Simpson's_paradox

https://en.wikipedia.org/wiki/Cherry_picking

Post reply on HN