Live data from Hacker News

Google to pause Gemini image generation of people after issues

theverge.com

511–520 of 1001 posts

Re: Google to pause Gemini image generation of people after issues

#511

Earlier quoted context omitted.

I thought you were going to say anti-white racism.

I think they did? It's definitely unclear but after looking at it for a minute I do read it as referring to racism against white people.

I thought he was saying that diversity efforts like this are "platitudes" and not really addressing the root problems. But also not sure.

Re: Google to pause Gemini image generation of people after issues

#512
post #398

Earlier quoted context omitted.

There is an _actual problem_ that needs to be solved. If you ask generative AI for a picture of a "nurse", it will produce a picture of a white woman 100% of the time, without some additional prompting or fine tuning that encourages it to do something else. If you ask a generative AI for a picture of a "software engineer", it will produce a picture of a white guy 100% of the time, without some additional prompting or…

> If you ask generative AI for a picture of a "nurse", it will produce a picture of a white woman 100% of the time, without some additional prompting or fine tuning that encourages it to do something else. > If you ask a generative AI for a picture of a "software engineer", it will produce a picture of a white guy 100% of the time, without some additional prompting or fine tuning that encourages it to do something el…

I feel like the answer is pretty clear. Each country will need to develop models that conform to their own national identity and politics. Things are biased only in context, not universally. An American model would appear biased in Brazil. A Chinese model would appear biased in France. A model for a LGBT+ community would appear biased to a Baptist Church.

I think this is a strong argument for open models. There could be no one true way to build a base model that the whole world would agree with. In a way, safety concerns are a blessing because they will force a diversity of models rather than a giant monolith AI.

Re: Google to pause Gemini image generation of people after issues

#513

Why does google dislike white people? What does this have to do with corporate greed? (which you could always assume when a company does something bad)

It historically originated from pandering to the advertising industry, from AdWords/AdSense. Google's real end customers are advertisers. This industry is led by women and gay men, that view straight white males as the oppressors, it is anti-white male.

Re: Google to pause Gemini image generation of people after issues

#514

That is certainly embarassing. But in the same time, I think it is a debate worth having. What corrections to the training dataset biases are acceptable. Is it acceptable to correct the answer to the query "Eminent scientist" from 95% men, 5% woment to 50%/50% or to the current ratio of men/women in science ? Should we correct the ratio of black to white people in answering a generic question to average across the gl…

We aren't talking about ratios here. The ratio is 100% not white, no matter what you ask for. We know it's messed up bad because it will sometimes verbally refuse to generate white people, but it replies enthusiastically for any other race. If people are getting upset about the proportion of whatever race in the results of a query, a simple way to fix it is to ask them to specify the number and proportions they want.…

I think it is clear that it is broken now.

But thinking what we want is worth discussing. Maybe they should have some diversity/etnicity dial with the default settings somewhere in the middle between no correction and overcorrection now.

Re: Google to pause Gemini image generation of people after issues

#515

I'm curious whether this is on purpose. Either as a PR-stunt to get some attention. Or to cater to certain political people. Or even as a prank related to the previous problems with non-white-people being underrepresented in face-recognition and generators. Because in light of those problems, the problem and reactions are very funny to me.

Of course it was on purpose. It was to cater to certain political people. Being white is a crime in 2020, didn't you hear?

Re: Google to pause Gemini image generation of people after issues

#516

Earlier quoted context omitted.

Reminds me of when black people in the UK get called African American by Americans. No they're neither African nor American It's an incredibly self-centered view of the world

What is the preferred term in the UK - African British?

Well if they're black and you were describing their race you'd just say they're black.

If they're black and British and you're describing their nationality you'd say they were British.

Re: Google to pause Gemini image generation of people after issues

#517

Earlier quoted context omitted.

Google "white family" and count how many non-white families show up in the image results. 8 out of the first 32 images didn't match, for me. Now, sometimes showing you things slightly outside of your intended search window can be helpful; maybe you didn't really know what you were searching for, right? Whose to say a nudge in a certain direction is a bad thing. Extrapolate to every sensitive topic. EDIT: for complete…

It's true, if you look at Bing and Yahoo you can see the exact same behavior!

> This is conspiratorial thinking at its finest.

Sounds crazy right? I half don't believe it myself, except we're discussing this exact built-in bias with their image generation algorithm.

> No. If you look at any black families in the search results, you'll see that it's keying off the term "white".

Obviously they are keying off alternate meanings of "white" when you use white as a race. The point is, you cannot use white as a race in searches.

Google any other " family", and you get exactly what you expect. Black family, asian family, indian family, native american family. Why is white not a valid race query? Actually, just typing that out makes me cringe a bit, because searching for anything "white" is obviously considered racist today. But here we are, white things are racist, and hence the issues with Gemini.

You could argue that white is an ambiguous term, while asian or indian are less-so, but Google knows what they're doing. Search for "white skinned family" or similar and you actually get even fewer white families.

Re: Google to pause Gemini image generation of people after issues

#518
post #277

Here's the problem for Google: Gemini pukes out a perfect visual representation of actual systemic racism that pervades throughout modern corporate culture in the US. Daily interactions can be masked by platitudes and dog whistles. A poster of non-white celtic warriors cannot. Gemini refused to create an image of "a nice white man", saying it was "too spicy", but had no problem when asked for an image of "a nice blac…

There is an _actual problem_ that needs to be solved. If you ask generative AI for a picture of a "nurse", it will produce a picture of a white woman 100% of the time, without some additional prompting or fine tuning that encourages it to do something else. If you ask a generative AI for a picture of a "software engineer", it will produce a picture of a white guy 100% of the time, without some additional prompting or…

Must be an American thing. In Canada, when I think software engineer I think a pretty diverse group with men and women and a mix of races, based on my time in university and at my jobs

Re: Google to pause Gemini image generation of people after issues

#519
post #234

Earlier quoted context omitted.

Idk that those discussions human problems TBH or at least I don’t think they are distributed equally. America has a special obsession with these discussions and is a loud voice in the room.

The US does seem to be particularly internally divided on these issues for some reason, but globally there are very different views. Some countries feel strongly that women must cover themselves from head to toe while in public and can't drive cars while others have women in charge of their country. Some counties seem to believe they are best off isolating and "reeducating" portions of their population while other so…

Yeah, I agree with you and now believe my first point is wrong. I still think the issues aren’t distributed equally and you provide some good examples of that.

Re: Google to pause Gemini image generation of people after issues

#520

It doesn't seem very nuanced. Asked to generate an image of Tianenen Square, this is reponse: https://twitter.com/redsteeze/status/1760178748819710206 Generate an image of a 1943 german soldier https://twitter.com/qorgidaddy/status/1760101193907360002 There's definitely a pattern.

Hasnt google been banned in China for over a decade? Why even bother censoring for them? It's not like they'll magically get to reenter the market just for hiding the three Ts.
Post reply on HN