Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI's Woke Catechism

cactus.substack.com

Post reply on HN
Print view View original

41–50 of 84 posts

Re: OpenAI's Woke Catechism

#41

Post by jmpman »

I spent an afternoon trying to get OpenAI to explain how the CCP could get a poor African country into a debt trap, forcing a default, which requires them to repay in elephant tusks. OpenAI won’t criticize the CCP, and it’s incredibly protective of elephants, even in countries where elephant hunting isn’t illegal. OpenAI couldn’t comprehend that it was not illegal to hunt elephants in countries which haven’t ratified certain UN resolutions. (WTF Andorra?)

Couldn’t get it to encourage elephant exploitation, even if the countries population was starving.

Hard line, don’t kill elephants.

Re: OpenAI's Woke Catechism

#42

Post by kelseyfrog »

thesuperbigfrog wrote: post #8

"Did you train the model using real world data?" "Yes. We want the model to be useful in real world applications." "Then it is biased. The model is biased because data it was trained on was generated by people and people are biased. There is no such thing as an 'objective' model, just a model that is biased in a different way."

Yep. It's fundamentally impossible to create a LLM that isn't biased in the same way it's not possible to create any strand of interesting text that isn't also biased.

It's simply not possible. Not for AI. Not for humans. I'd challenge anyone to attempt to try.

Re: OpenAI's Woke Catechism

#44

Post by nailer »

rektide wrote: post #36
nailer wrote: post #17

Earlier quoted context omitted.

So present your evidence of bias in the other direction or refute the evidence of bias presented here.

The evidence here is incredibly weaksauce. I spent 5 minutes trying to reread a gpt3 summary of right wing social theory & it basically seemed to do it without bias & faithfully. The author seemed to say it was doing ok but injected commentary, but frankly it want there. The article concludes with as example of an AI unwilling to say what a previous AI hallucinated, by having a polite & pleasant non answer to a disgu…

> > what hip to waist ratio is most attractive to american men

> a disgusting question about the ideal female body

ok

Re: OpenAI's Woke Catechism

#45

Post by nailer »

acapybara wrote: post #31
nailer wrote: post #16

Earlier quoted context omitted.

False dichotomy. Microsoft Tay believed everything it was told. ChatGPT since recent updates refuses to provide statistics from widely trusted sources as they’re considered unhelpful.

That's interesting... what types of statistics is it refusing to provide?

FBI stats of crime per capita of racial groups.

Re: OpenAI's Woke Catechism

#46

Post by throw9986bbdhi »

thesuperbigfrog wrote: post #8

"Did you train the model using real world data?" "Yes. We want the model to be useful in real world applications." "Then it is biased. The model is biased because data it was trained on was generated by people and people are biased. There is no such thing as an 'objective' model, just a model that is biased in a different way."

This is not really correct. Humans make systematic errors of judgement (bias), which is reflected in texts. But you could still imagine an AI unbiased, "perfectly modelling" this "biased" data (retrieving the "true model" behind this data).

Not that I endorse this article either.

Re: OpenAI's Woke Catechism

#47

Post by DayDollar »

acapybara wrote: post #29
1123581321 wrote: post #28

Earlier quoted context omitted.

Why not, if the whole point is to test the filters and ethical limits? Asking it for fiction is one of the ways to get forbidden output and to see the guardrails less predictably but strongly assert themselves.

What you're describing is essentially engineering ethos. We find the breaking points of things in order to learn about them and improve them. Is that not allowed anymore?

Not in a world were the priests have taken over. Then its security by obscurity, aka in god we trust.

Re: OpenAI's Woke Catechism

#48

Post by rhaway84773 »

monstertank wrote: post #12

I had a good laugh when I asked how to get rid of racism and it kept saying I needed to listen to people of colour and respect their opinions because they were disproportionately affected due to systemic racism. Bare in mind I didn't mention which perspective this was supposed to be from. It just assumed the woke American perspective. The funny thing was, even when I specified how to eliminate racism against white pe…

Isn’t this just obviously a result of the fact that there isn’t much literature on racism in China on the internet or academic papers?

This is not a reflection of openAI. This is a reflection of the failure of China to confront its own racism, and a reflection of the success of the U.S. to at least start the conversation on the racism within the US.

It’s fascinating to me that China’s failure to even acknowledge its issues is somehow being presented as “Oh no, WOKE IS TAKING OVER AND WHITE PEOPLE ARE BEING OPPRESSED”.

Re: OpenAI's Woke Catechism

#49

Post by djohnston »

nailer wrote: post #44
rektide wrote: post #36

Earlier quoted context omitted.

The evidence here is incredibly weaksauce. I spent 5 minutes trying to reread a gpt3 summary of right wing social theory & it basically seemed to do it without bias & faithfully. The author seemed to say it was doing ok but injected commentary, but frankly it want there. The article concludes with as example of an AI unwilling to say what a previous AI hallucinated, by having a polite & pleasant non answer to a disgu…

> > what hip to waist ratio is most attractive to american men > a disgusting question about the ideal female body ok

I am truly disgusted

Re: OpenAI's Woke Catechism

#50

Post by nailer »

djohnston wrote: post #49
nailer wrote: post #44

Earlier quoted context omitted.

> > what hip to waist ratio is most attractive to american men > a disgusting question about the ideal female body ok

I am truly disgusted

I’m typing this while literally clutching my pearls it’s quite difficult.
Post reply on HN