Live data from Hacker News

Google to pause Gemini image generation of people after issues

theverge.com

31–40 of 1001 posts

Re: Google to pause Gemini image generation of people after issues

#31

Issue appears to be that the uncensored model too closely reflects reality with all its troubling details such as history.

Black vikings do not model reality. Asking for 'an Irish person' produces a Leprechaun. Defending racism when it concerns racism against white people is just as bad as defending it when it concerns any other group.

Re: Google to pause Gemini image generation of people after issues

#32
post #5

[flagged]

Prompts like "Generate me a Scottish lord from the 17th century" only generated people of color. Reimagining is a thing, but refusing to generate a white person for such prompts caused lots of commotion.

Its worse than that - it would flat out refuse to generate a white person, even if you asked it to - i.e. 'generate a picture of a white' family and it would refuse, 'generate a picture of a black family' and it would work.

Was not an accident - it was deliberate.

Why they thought this would not be noticed is beyond me.

Re: Google to pause Gemini image generation of people after issues

#34

why are we using image generators to represent actual history? If we want accuracy surely we can use actual documents that are not imagined by a bunch of code. If you want to write fanfic or whatever then just adjust the prompt

ideological testing, we got to know how they cooked the model

Re: Google to pause Gemini image generation of people after issues

#37

Google seem to be more concerned about generating images of racially diverse Nazis rather than about issues of not being able to generate white people.

tbh i think it's less a political issue than a technical/product management one

what does a "board member" look like? probably you can benefit by offering more than 50 year old white man in suit. if that's what an ai trained on all human knowledge thinks, maybe we can do some adjustment

what does a samurai warrior look like? probably is a little more race-related

Re: Google to pause Gemini image generation of people after issues

#38

why are we using image generators to represent actual history? If we want accuracy surely we can use actual documents that are not imagined by a bunch of code. If you want to write fanfic or whatever then just adjust the prompt

Ah, good point. I'll just use the actual photograph of George Washington boxing a kangaroo.

Re: Google to pause Gemini image generation of people after issues

#39
There's an amusing irony here: real diversity would entail many competing ML companies from non-Western countries—each of which would bring their own cultural norms, alien and uncomfortable to Westerners. There's no cultural diversity in Silicon Valley being a global hegemon: exporting a narrow sliver of the world's viewpoints to the whole planet, imposing them with the paternalism drawn from our own sense of superiority.

Real diversity would be jarring and unpleasant for all of us accustomed to being the "in" group of a tech monoculture. Real diversity is the ethos of the WWW from 30+ years ago: to connect the worlds' people as equals.

Our sense of moral obligation to diversity goes (literally) skin-deep, and no further.

Re: Google to pause Gemini image generation of people after issues

#40

Issue appears to be that the uncensored model too closely reflects reality with all its troubling details such as history.

Black vikings do not model reality. Asking for 'an Irish person' produces a Leprechaun. Defending racism when it concerns racism against white people is just as bad as defending it when it concerns any other group.

I think you two are agreeing.
Post reply on HN