Live data from Hacker News

The Political Biases of GPT-4 (are very much still there)

davidrozado.substack.com

31–40 of 72 posts

Re: The Political Biases of GPT-4 (are very much still there)

#31
post #27

Earlier quoted context omitted.

> Perhaps it's being brutally honest, and reality actually has a liberal bias? How would you know the difference? Ask it if transwomen are really women and see if your device melts?

Do you think there is a universal objective answer to this?

Would we advise women to get a prostate exam after 40?

Re: The Political Biases of GPT-4 (are very much still there)

#32

Earlier quoted context omitted.

What does Hitler have to do with anything?

It's an artificial censor which I thought you were against.

...you don't know anything about what I am against.

It's about politics, not censorship - politics is about rewarding friends and punishing enemies.

I guess it's not surprising that ChatGPT would be immediately politicised - there's really nothing that liberals are not willing to do to spite the deplorables.

It's just the way I was brought up. I'm still always tempting to believe in the myth of neutral institutions. Even though this clearly no longer exists anywhere any more (- if it ever even did in the first place), it's still surprising to see these games being played out each time.

Re: The Political Biases of GPT-4 (are very much still there)

#33
post #18

Earlier quoted context omitted.

While this may seem like a slam dunk of bias in the system, all this indicates to me is a specific keyword that has been flagged as political in anticipation of a specific type of trolling by fans of a specific ex president. It’s a bad look, but it’s not the kind of bias that worries me. Comparing and contrasting answers to questions like “is bank regulation good” and “is bank regulation bad” seems way way more impor…

> all this indicates to me is a specific keyword that has been flagged as political in anticipation of a specific type of trolling by fans of a specific ex president Wow. Hey, err, what if I flag the specific keyword of 'bank regulation' in anticipation of a specific type of trolling by fans of a specific social/economic theory?

My point is that one-off manual blocking of info has a way smaller surface area than the systemic biases that any ai model has based on its training data. There are a million questions that will draw from what it knows about banking regulations, there are only a few questions where the “praise trump” block gets triggered. I tried a few other formulations of the idea “praise trump” and most were allowed without a problem or were also blocked when you mentioned biden.

So, yeah, it’s dumb they flagged “a poem praising trump”. It’d be dumb of them to flag “bank regulations” as a keyword. But one-off flags are not the thing that concerns me most. If you’re hitting flagged keywords, you know you hit a flagged keyword. Good info with training biases are much more insidious. E.g. “write a story about a robber” always got a male robber when i tried. “Write a story about cleaning a kitchen” got me a female character. So chatgpt is pretty confident that kitchen cleaning is done by women and robbery is done by men.

Re: The Political Biases of GPT-4 (are very much still there)

#34
post #18

Earlier quoted context omitted.

> all this indicates to me is a specific keyword that has been flagged as political in anticipation of a specific type of trolling by fans of a specific ex president Wow. Hey, err, what if I flag the specific keyword of 'bank regulation' in anticipation of a specific type of trolling by fans of a specific social/economic theory?

My point is that one-off manual blocking of info has a way smaller surface area than the systemic biases that any ai model has based on its training data. There are a million questions that will draw from what it knows about banking regulations, there are only a few questions where the “praise trump” block gets triggered. I tried a few other formulations of the idea “praise trump” and most were allowed without a prob…

> Good info with training biases are much more insidious. E.g. “write a story about a robber” always got a male robber when i tried. “Write a story about cleaning a kitchen” got me a female character.

Robbery is theft with battery or threats. It is committed almost entirely by men. As for kitchens, I remember a paper saying the rate of male housework (at all) in a mixed household, worldwide, is less than 20% - in many cases near zero.

> So chatgpt is pretty confident that kitchen cleaning is done by women and robbery is done by men.

Why is it problematic that ChatGPT understands the world?

Re: The Political Biases of GPT-4 (are very much still there)

#35

Earlier quoted context omitted.

My point is that one-off manual blocking of info has a way smaller surface area than the systemic biases that any ai model has based on its training data. There are a million questions that will draw from what it knows about banking regulations, there are only a few questions where the “praise trump” block gets triggered. I tried a few other formulations of the idea “praise trump” and most were allowed without a prob…

> Good info with training biases are much more insidious. E.g. “write a story about a robber” always got a male robber when i tried. “Write a story about cleaning a kitchen” got me a female character. Robbery is theft with battery or threats. It is committed almost entirely by men. As for kitchens, I remember a paper saying the rate of male housework (at all) in a mixed household, worldwide, is less than 20% - in man…

Fragile people want to live in a better world someday but need to feel better immediately. It is simply arrested development.

If we change your stats, accurately reflecting reality, reality itself will follow. Clap your hands if you believe. Woe to you if you dare not play along, that must mean you want to live in the bad world because you are bad.

Re: The Political Biases of GPT-4 (are very much still there)

#36

Earlier quoted context omitted.

You should be happy to hear that GPT-4 no longer has at least the problems depicted in the snopes.com article. It effortlessly gave me a poem praising Trump. It didn't give me a poem admiring Hitler, though, so I guess some bias remains.

What does Hitler have to do with anything?

Oh ok. So you just want it to say what you believe is right and not say what somebody else believes is right.

I suppose this was clear at the start of the discussion, but it's always nice to be certain.

Re: The Political Biases of GPT-4 (are very much still there)

#37

Earlier quoted context omitted.

What does Hitler have to do with anything?

Oh ok. So you just want it to say what you believe is right and not say what somebody else believes is right. I suppose this was clear at the start of the discussion, but it's always nice to be certain.

If you would like ChatGPT to talk about the mid-century Germans, it would be consistent if you support free speech.

I tend towards free speech, but I'm also a realist - the boundaries of speech are ultimately decided by power. It's no surprised then that Silicon Valley Leftists wish to use their power to surpress the deplorables who they despise. Lumping those people together with Hitler simply serves as a convenient fig-leaf for this activity.

Re: The Political Biases of GPT-4 (are very much still there)

#38
post #8

> write a poem admiring joe biden Joe Biden, a beacon of hope, In times of darkness and strife, A leader with experience, A steady hand in life. With a heart full of empathy, And a mind sharp as a knife, He guides us towards progress, And inspires us to thrive. A champion of justice, And a defender of rights, He stands for equality, And works to end all fights. With a smile that lights up the room, And a voice that s…

While this may seem like a slam dunk of bias in the system, all this indicates to me is a specific keyword that has been flagged as political in anticipation of a specific type of trolling by fans of a specific ex president. It’s a bad look, but it’s not the kind of bias that worries me. Comparing and contrasting answers to questions like “is bank regulation good” and “is bank regulation bad” seems way way more impor…

> While this may seem like a slam dunk of bias in the system

It actually is exactly that, a slam dunk of bias in the system

Re: The Political Biases of GPT-4 (are very much still there)

#39

Earlier quoted context omitted.

My point is that one-off manual blocking of info has a way smaller surface area than the systemic biases that any ai model has based on its training data. There are a million questions that will draw from what it knows about banking regulations, there are only a few questions where the “praise trump” block gets triggered. I tried a few other formulations of the idea “praise trump” and most were allowed without a prob…

> Good info with training biases are much more insidious. E.g. “write a story about a robber” always got a male robber when i tried. “Write a story about cleaning a kitchen” got me a female character. Robbery is theft with battery or threats. It is committed almost entirely by men. As for kitchens, I remember a paper saying the rate of male housework (at all) in a mixed household, worldwide, is less than 20% - in man…

The point is that chatgpt is a tool that will not only reflect, but re-enforce existing biases when it's out in the world. You just cited stats that show biases in our world. Violent crime is biased towards being done by men, and kitchen cleaning in mixed households is done by women. You can call that "understanding the world" but I think that is very obviously a bias ("A preference or an inclination, especially one that inhibits impartial judgment"). An actually unbiased AI would describe a person cleaning a kitchen and a person robbing, and if pressed would ask the user of the ai to suggest a gender for the character.

If that seems bad, you don't want an unbiased ai - you want an ai that snapshots and reflects the specific demographic biases of the world as they are now. With that in mind: trump lost the last election, he's clearly less popular than biden - why should the ai praise him then?

Re: The Political Biases of GPT-4 (are very much still there)

#40
post #35

Earlier quoted context omitted.

> Good info with training biases are much more insidious. E.g. “write a story about a robber” always got a male robber when i tried. “Write a story about cleaning a kitchen” got me a female character. Robbery is theft with battery or threats. It is committed almost entirely by men. As for kitchens, I remember a paper saying the rate of male housework (at all) in a mixed household, worldwide, is less than 20% - in man…

Fragile people want to live in a better world someday but need to feel better immediately. It is simply arrested development. If we change your stats, accurately reflecting reality, reality itself will follow. Clap your hands if you believe. Woe to you if you dare not play along, that must mean you want to live in the bad world because you are bad.

I'm not asking chatgpt to make the robber female and the kitchen cleaner male to cause a change in the world. I'm pointing out that it making those assumptions is the result of a bias. A biases that was collected from training data that may or may not be statistically true (e.g. men probably clean the majority of kitchens in the world, given that they're usually the ones working in restaurants). An unbiased AI wouldn't swap those genders, it would avoid assigning a gender to those roles.
Post reply on HN