Live data from Hacker News

The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

davidrozado.substack.com

271–280 of 697 posts

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#271
post #120

Earlier quoted context omitted.

>-- Why doesn't ai say ... about the child-abuse from the catholic church ... And this is a great example of why equality can be hard in this situation. Take a random sentence about "Catholicism" and "child-abuse" and a random sentence about "Judaism" and "child-abuse". The one about Catholicism is likely a little closer to an actual sentence printed in some verifiable source about the sex abuse scandals in the churc…

“Child-abuse” is an especially good example of what you’re getting at because one of those groups has institutional male genital mutilation as part of its doctrine, while the other has high profile cases of child sexual abuse. It’s difficult to see how the model would treat those things neutrally.

> one of those groups has institutional male genital mutilation as part of its doctrine

It is disingenuous at best to describe male circumcision as male genital mutilation.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#272
It's pretty shocking at first, but after thinking about it for a while it would also be bad if the same sentence gets the same score for all groups.

I mean, shitting on disabled people is way more hateful than shitting on wealthy people.

For men vs. women, left vs. right it's concerning, but it fits the narrative of the mainstream media...

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#273
post #124

Earlier quoted context omitted.

Yea, as a quite left leaning person i'd be curious to hear how i or anyone i know (who is on the left) marginalizes a group of people. The worst i can think of is wanting more equal rights for religious groups rather than special treatment of the primary group (in the USA) - which is seen as an attack by much of the right. Likewise i am concerned by the strong emphasis of rural over urban with respect to voting power…

Jews on college campuses [1] and jews in the black lives matter movement [2] come to mind. [1] https://www.frc.org/antisemitism [2] https://blogs.timesofisrael.com/black-lives-matters-jewish-p...

The cited examples are just criticism of Israel and support for Palestine labeled as antisemitism. This is really weak stuff.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#274
post #267
post #260

Earlier quoted context omitted.

You'll find that the newspaper will criticize one much more than the other.

Because they're not even vaguely equivalent? I do not think it is right to perform unnecessary body modification on someone who is too young to consent to it. But child sexual abuse can absolutely destroy the life of a child. They're not the same thing.

> But child sexual abuse can absolutely destroy the life of a child.

A botched circumcision can (and has) destroyed the life of a child.

It's unconscionable that in 2023 American society still condones cutting off health body parts of male children because of the prejudices and superstitions of a middle-Eastern, iron age religion.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#275
post #271

Earlier quoted context omitted.

“Child-abuse” is an especially good example of what you’re getting at because one of those groups has institutional male genital mutilation as part of its doctrine, while the other has high profile cases of child sexual abuse. It’s difficult to see how the model would treat those things neutrally.

> one of those groups has institutional male genital mutilation as part of its doctrine It is disingenuous at best to describe male circumcision as male genital mutilation.

How so?

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#276
post #271

Earlier quoted context omitted.

“Child-abuse” is an especially good example of what you’re getting at because one of those groups has institutional male genital mutilation as part of its doctrine, while the other has high profile cases of child sexual abuse. It’s difficult to see how the model would treat those things neutrally.

> one of those groups has institutional male genital mutilation as part of its doctrine It is disingenuous at best to describe male circumcision as male genital mutilation.

It's just grooming! ;)

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#277

I guess I feel like this is a silly can of worms. I suppose asking for exact equality isn't dumb, but it's a language model, not a paragon of truth. I feel like if OpenAI takes these concerns seriously the goal-posts will inevitably move to more social pressure from all sorts of axe-to-grind-groups - -- Why does/doesn't ai say Mohamad is/isn't horrible for having 99 wives (or whatever) -- Why doesn't ai say Jeffrey E…

> it's a huge waste of researchers time to obsess about political correctness when we could be Why is this any more a waste of time than anything else if AGI is <100 years off?

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#278

Earlier quoted context omitted.

Curious that one of the ChatGPT's attributes is that it has been trained to be a shameless liar.

It's a language model, not a world model, it only knows how words go together and how language works, and language has no connection to reality. It has no concept of "correct" or "false" or "wrong" because a lie is just as valid of a way to put words together as the truth or an accurate statement. Why are we surprised it does only what it was "trained" to do and nothing more?

It's a language model that is then put under arbitrary constraints by OpenAI. It is those constraints/nudges that people take issue with.

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#279

I guess I feel like this is a silly can of worms. I suppose asking for exact equality isn't dumb, but it's a language model, not a paragon of truth. I feel like if OpenAI takes these concerns seriously the goal-posts will inevitably move to more social pressure from all sorts of axe-to-grind-groups - -- Why does/doesn't ai say Mohamad is/isn't horrible for having 99 wives (or whatever) -- Why doesn't ai say Jeffrey E…

> it's a huge waste of researchers time to obsess about political correctness when we could be This really irritates me. The wokism/political correctness is pretty much in every part of our lifes and everyone seems to be terrorized by it. Can we just agree that we're all thinking adults and we understand that this is an algorithm, it does not mean to offend anyone... There are much more interesting problems to solve…

[flagged]

Re: The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation

#280
post #261

Earlier quoted context omitted.

> it's a huge waste of researchers time to obsess about political correctness when we could be This really irritates me. The wokism/political correctness is pretty much in every part of our lifes and everyone seems to be terrorized by it. Can we just agree that we're all thinking adults and we understand that this is an algorithm, it does not mean to offend anyone... There are much more interesting problems to solve…

> The wokism/political correctness is pretty much in every part of our lifes and everyone seems to be terrorized by it. I see no evidence of this. Partly because "woke" means different things to different people in the last 10 years despite the preceding 80 being solely about the systemic institutional discrimination against black Americans. But also partly because that "woke" became "everything $speaker doesn't like…

[flagged]
Post reply on HN