Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Google to pause Gemini image generation of people after issues

theverge.com

Post reply on HN
Print view View original

621–630 of 1001 posts

Re: Google to pause Gemini image generation of people after issues

#621

Post by nox101 »

rsynnott wrote: post #492
Aurornis wrote: post #417

Earlier quoted context omitted.

> If you ask generative AI for a picture of a "nurse", it will produce a picture of a white woman 100% of the time, without some additional prompting or fine tuning that encourages it to do something else. > If you ask a generative AI for a picture of a "software engineer", it will produce a picture of a white guy 100% of the time, without some additional prompting or fine tuning that encourages it to do something el…

Note: > without some additional prompting or fine tuning that encourages it to do something else. That tuning has been done for all major current models, I think? Certainly, early image generation models _did_ have issues in this direction. EDIT: If you think about it, it's clear that this is necessary; a model which only ever produces the average/most likely thing based on its training dataset will produce extremely…

why is it necessary? There's 1.4 billion Chinese. 1.4 billon Indians. 1.2 billion Africans. 0.6 billion Latinos and 1 billion white people. Those numbers don't have to be perfect but nor do they have to be purely white/non-white but taken as is, they show there should be ~5 non-white nurses for every 1 white nurse. Maybe it's less, maybe more, but there's no way "white" should be the default.

Re: Google to pause Gemini image generation of people after issues

#623

Post by SkintMesh »

chasum wrote: post #610

Reading the comments here... If you are only starting to wake up to what's happening now, in 2024, you are in for a hell of a ride. Shocked that racism has come back? Wait until you find out what's really been happening, serious ontological shock ahead, and I'm not talking about politics. Buckle up. Hey, better late than never.

When google forces my ai girlfriend to be bl*ck, serious ontological shock ahead

Re: Google to pause Gemini image generation of people after issues

#624

Post by ilrwbwrkhv »

Cornbilly wrote: post #617

I just find all of this hilarious. On one hand, we have a bunch of goofs that want to use AI as some arbiter of truth and get mad that it won't spit out "facts" about such-and-such race being inferior. On the other, we have an opposite group of goofs that think that have the hubris to think they can put guardrails in that make the other group of goofs happy and end up poorly implement guardrails that end up making th…

On the contrary there should be no censorship whatsoever. Open AI's wokeness and of course Google's wokeness is causing this mess. Hopefully Elon will deliver a censorship free model.

Re: Google to pause Gemini image generation of people after issues

#625

Post by Tarragon »

MadSudaca wrote: post #220
oceanplexian wrote: post #215

Earlier quoted context omitted.

No one is upset that an algorithm accidentally generated some images, they are upset that Google intentionally designed it to misrepresent reality in the name of Social Justice.

You mean some people's interpretation of what social justice is.

But also misinterpretations of what the history is. As I write this there's someone laughing at an image of black people in Scotland in the 1800s[1].

Sure, there's a discussion that can be had about a generic request generating an image of a black Nazi. The thing is, to me, complaining about a historically correct example is a good argument for why this kind of thing can be important.

[1] https://news.ycombinator.com/item?id=39467206

Re: Google to pause Gemini image generation of people after issues

#626

Post by pixl97 »

itsoktocry wrote: post #469
empath-nirvana wrote: post #387

Earlier quoted context omitted.

There is an _actual problem_ that needs to be solved. If you ask generative AI for a picture of a "nurse", it will produce a picture of a white woman 100% of the time, without some additional prompting or fine tuning that encourages it to do something else. If you ask a generative AI for a picture of a "software engineer", it will produce a picture of a white guy 100% of the time, without some additional prompting or…

> There is an _actual problem_ that needs to be solved. If you ask generative AI for a picture of a "nurse", it will produce a picture of a white woman 100% of the time Why is this a "problem"? If you want an image of a nurse of a different ethnicity, ask for it.

How to tell someone is white and most likely lives in the US.

Re: Google to pause Gemini image generation of people after issues

#627

Post by Perceval »

aniftythrifrty wrote: post #403
ActionHank wrote: post #361

Earlier quoted context omitted.

I love the idea of testing an image gen to see if it generates multicultural ww2 nazis because it is just so contradictory.

Of course it's not that different from today.

The media have done a number of stories, analyses, and editorials noting that white nationalist/white supremacy groups appear to be more diverse than one would otherwise expect:

* https://www.brennancenter.org/our-work/research-reports/why-...

* https://www.washingtonpost.com/national-security/minorities-...

* https://www.aljazeera.com/opinions/2023/6/2/why-white-suprem...

* https://www.voanews.com/a/why-some-nonwhite-americans-espous...

* https://www.washingtonpost.com/politics/2023/05/08/texas-sho...

* https://www.latimes.com/california/story/2021-08-20/recall-c...

Re: Google to pause Gemini image generation of people after issues

#628

Post by dotnet00 »

DebtDeflation wrote: post #598
mlrtime wrote: post #401

Earlier quoted context omitted.

But why give those two examples? Why didn't you use an example of a "Professional Athlete"? There is no problem with these examples if you assume that the person wants the statistically likely example... this is ML after all, this is exactly how it works. If I ask you to think of a Elephant, what color do you think of? Wouldn't you expect an AI image to be the color you thought of?

It would be an interesting experiment. If you asked it to generate an image of an NBA basketball player, statistically you would expect it to produce an image of a black male. Would it have produced images of white females and asian males instead? That would have provided some sense of whether the alignment was to increase diversity or just minimize depictions of white males. Alas, it's impossible to get it to genera…

I was able to get to the "Sure! Here are..." part with a prompt but had it get swapped out to the refusal message, so I think they might've stuck a human detector on the image outputs.

Re: Google to pause Gemini image generation of people after issues

#629

Post by PeterCorless »

somenameforme wrote: post #572
D13Fd wrote: post #398

Earlier quoted context omitted.

> If you ask generative AI for a picture of a "nurse", it will produce a picture of a white woman 100% of the time, without some additional prompting or fine tuning that encourages it to do something else. > If you ask a generative AI for a picture of a "software engineer", it will produce a picture of a white guy 100% of the time, without some additional prompting or fine tuning that encourages it to do something el…

This is a much more reasonable question, but not the problem Google was facing. Google's AI was simply giving objectively wrong responses in plainly black and white scenarios, pun intended? None of the Founding Father's was black, and so making one of them black is plainly wrong. Google's interpretation of "US senator from the 1800s" includes exactly 0 people that would even remotely plausibly fit the bill; instead i…

"US senator from the 1800s" includes Hiram R. Revels, who served in office 1870 - 1871 — the Reconstruction Era. He was elected by the Mississippi State legislature on a vote of 81 to 15 to finish a term left vacant. He also was of Native American ancestry. After his brief term was over he became President of Alcorn Agricultural and Mechanical College.

https://en.wikipedia.org/wiki/Hiram_R._Revels

Re: Google to pause Gemini image generation of people after issues

#630

Post by AirborneUnicorn »

bnralt wrote: post #579
AirborneUnicorn wrote: post #148

Earlier quoted context omitted.

Do you have sources for these events? I’d like to read them. Thanks!

I thought that a Yale speaker giving a public talk disparaging white people where they say they fantasize about shooting white people in the head was pretty extreme[1]. Even more so since it didn’t seem to bother the attendees there, and there was no push back until someone leaked the audio a few months later. If the audio hadn’t leaked, it seems like Yale and the attendees would have just considered that a normal le…

Certainly extreme, how bizarre
Post reply on HN