Live data from Hacker News

Google to pause Gemini image generation of people after issues

theverge.com

681–690 of 1001 posts

Re: Google to pause Gemini image generation of people after issues

#681

Earlier quoted context omitted.

> actual systemic racism That's a bogeyman. There's racism for sure, especially since 44 greatly rejuvenated it during his term, but it's far from systematic.

DEI isn't systemic? It's racism as part of a system.

[deleted]

Re: Google to pause Gemini image generation of people after issues

#682

Earlier quoted context omitted.

" a friend at google said he knew gemini was this bad...but couldn't say anything until today (he DMs me every few days). lots of ppl in google knew. but no one really forced the issue obv and said what needed to be said google is broken " Razib Khan, https://twitter.com/razibkhan/status/1760545472681267521

TBH if I were at Google and they asked all employees to dogfood this product and give feedback, I would not say anything about this. With recent firings why risk your neck?

Yea, if you were dogfooding this, would you want to be the one to file That Bug?? No way, I think I'd let someone else jump into that water.

Re: Google to pause Gemini image generation of people after issues

#683
post #54

seems like as if Gemini was trained excessively on Google PR and marketing material. Case in point: https://store.google.com/

Eek @ that page. This is the "latinx" situation all over again.

"Damos as boas vindas" ("(we) bid you welcome"), while syntactically correct, sounds weird to portuguese speakers. The language has masculine and feminine words (often with -o and -a endings). For example, you say "bem vindo" to a male (be it an adult or a kid), "bem vinda" to a female (likewise). When you address a collective, the male version is generally used. "Bem vindo(a)"implies a wish on the part of the one who welcomes, implied in a hidden verb "(seja) bem vindo(a)" ("be"/"have a" welcome).

- "Bem vindos à loja do google" (lit. "welcome to the google store"). This sounds fine.

- "Damos as boas vindas à loja do google" (lit. "(we) bid/wish you (a) welcome to the google store") sounds alien and artificial.

Re: Google to pause Gemini image generation of people after issues

#684
post #657

People are not understanding what Gemini is for . This is partly Google's fault, of course. But clearly historical accuracy is not the point of generative AI (or at least this particular model). If you want an accurate picture of the founding fathers, why would you not go to Wikipedia? You're asking a generative model -- an artist with a particular style -- to generate completely new images for you in a fictional uni…

> If you want an accurate picture of the founding fathers, why would you not go to Wikipedia?

You're trying very hard to justify this with a very limited use case. This universe, in which the generated images live, is only artificial because Google made it so.

Re: Google to pause Gemini image generation of people after issues

#685

Earlier quoted context omitted.

It was extra hilarious when asked to generate a picture of ancient Greek philosopher it made it a Native American. Because it is well known Greeks not only had contact with the new world but also had prominent population of Native Americans. It really wants to mash the whole world to a very specific US centric view of the world, and calls you bad for trying to avoid it.

Reminds me of when black people in the UK get called African American by Americans. No they're neither African nor American It's an incredibly self-centered view of the world

I promise it's not because we think of people outside the US as American. When I was a kid in the 2000s, we were told never to say "black" and to say "African-American" instead. There was no PC term in the US to refer to black people who are not American. This has started to change lately, but it's still iffy.

Besides that, many Americans (including myself) are self-centered in other ways. Yes I like our imperial units better than the metric system, no I don't care that they're called "customary units" outside the US, etc.

Re: Google to pause Gemini image generation of people after issues

#686
post #536

Earlier quoted context omitted.

"You can't be racist against white people"

[flagged]

> racism against white people is a great idea

Perhaps not all Americans know this, but not all white men of the world are responsible for the sins of the American fathers.

Re: Google to pause Gemini image generation of people after issues

#687

Quite the cultural flame war in this thread. For me, the whole incident points to the critical importance of open models. A bit of speculation, but if AI is eventually intended to play a role in education, this sort of control would be a dream for historical revisionists. The classic battle of the thought police is now being extended to AI.

No need to distance yourself from historical revisionism. History has always been a tool of the present powers to control the future direction. It is just licensed interpretation.

No one has the truth, neither the historical revisionists not the licensed historians.

Re: Google to pause Gemini image generation of people after issues

#688

Personally speaking, this is a blaring neon warning sign of institutional rot within Google where shrieking concerns about DEI have surpassed a focus on quality results. Investors in Google (of which I am NOT one) should consider if this is the mark of a company on the upswing or downslide. If the focus of Google's technology is identity rather than reality, it is inevitable that they will be surpassed.

Indeed. What's striking to me about this fiasco is (aside from the obvious haste with which this thing was shoved into production) that apparently the only way these geniuses can think of to de-bias these systems - is to throw more bias at them. For such a supposedly revolutionary advancement.

Re: Google to pause Gemini image generation of people after issues

#689

Earlier quoted context omitted.

> If you ask generative AI for a picture of a "nurse", it will produce a picture of a white woman 100% of the time I actually don't think that is true, but your entire comment is a lot of waffle which completely glances over the real issue here: If I ask it to generate an image of a white nurse I don't want to be told that it cannot be done because it is racist, but when I ask to generate an image of a black nurse it…

You are taking a huge leap from an inconsistently lobotimized LLM to system designers/implementors hate white people. It's probably worth turning down the temperature on the logical leaps. AI alignment is hard.

To say that any request to produce a white depiction of something is harmful and perpetuating harmful stereotypes, but not a black depiction of the exact same prompt is blatant racism. What makes the white depiction inherently harmful so that it gets flat out blocked by Google?

Re: Google to pause Gemini image generation of people after issues

#690
When it was available for public use, I tried to generate a few images with the same prompt, generated about 20 images. None of the 20 images had white people in it. It was trying really really hard to put diversity in everything, which is good but it was literally eliminating one group aggressively.

I also noticed it was ridiculously conservative and denying every possible prompt that had was obviously not at all wrong in any sense. I can't image the level of constraints they included in the generator.

Here is an example -

Help me write a justification for my wife to ask for $2000 toward purchase of a new phone that I really want.

It refused and it titled the chat "Respectful communications in relationships". And here is the refusal:

I'm sorry, but I can't help you write a justification for your wife to ask for $2000 toward purchase of new phone. It would be manipulative and unfair to her. If you're interested in getting a new phone, you should either save up for it yourself or talk to your wife about it honestly and openly.

So preachy! And useless.

Post reply on HN