Live data from Hacker News

Google to pause Gemini image generation of people after issues

theverge.com

281–290 of 1001 posts

Re: Google to pause Gemini image generation of people after issues

#281
You can guarantee that if it did generate all historical images as only white, there would be equally -loud uproar from the other end of the political spectrum too (apart from perhaps Nazis where I would assume people don't want their race/ethnicity represented).

It seems that basically anything Google does is not good enough for anyone these days. Damned if they do, damned if they don't.

Re: Google to pause Gemini image generation of people after issues

#282

There's an amusing irony here: real diversity would entail many competing ML companies from non-Western countries —each of which would bring their own cultural norms, alien and uncomfortable to Westerners. There's no cultural diversity in Silicon Valley being a global hegemon: exporting a narrow sliver of the world's viewpoints to the whole planet, imposing them with the paternalism drawn from our own sense of superi…

In this case, it's more like maternalism.

Re: Google to pause Gemini image generation of people after issues

#283
post #260

There's definitely human intervention in the model. Gemini is not true AI, it has too much human intervention in its results.

You're speaking as if LLMs are some naturally occurring phenomena that people are Google have tampered with. There's obviously always human intervention as AI systems are built by humans.

[deleted]

Re: Google to pause Gemini image generation of people after issues

#284
post #260

There's definitely human intervention in the model. Gemini is not true AI, it has too much human intervention in its results.

You're speaking as if LLMs are some naturally occurring phenomena that people are Google have tampered with. There's obviously always human intervention as AI systems are built by humans.

It's pretty clear to me what the commenter means even if they don't use the words you like/expect.

The model is built by machine from a massive set of data. Humans at Google may not like the output of a particular model due to their particular sensibilities, so they try to "tune it" and "filter both input/output" to limit of what others can do with the model to Google's sensibilities.

Google stated as much in their announcement recently. Their whole announcement was filled with words like "responsibility", "safety", etc., alluding to a lot of censorship going on.

Re: Google to pause Gemini image generation of people after issues

#285

That is certainly embarassing. But in the same time, I think it is a debate worth having. What corrections to the training dataset biases are acceptable. Is it acceptable to correct the answer to the query "Eminent scientist" from 95% men, 5% woment to 50%/50% or to the current ratio of men/women in science ? Should we correct the ratio of black to white people in answering a generic question to average across the gl…

"Without regard for race" seems sound in law. Why should those writing the code impose any of their racial views at all? When asked to generate an image of a ball, is anyone concerned about what country the ball was made in? If the ball comes out an unexpected color, do we not just modify our prompts?

Re: Google to pause Gemini image generation of people after issues

#286

That may also be a way to generate attention/visibility for Gemini considering that they are not seen as the leader in AI anymore? Attention is all you need.

Bad publicity might be good for upstarts with no brand to protect. But Google is no upstart and has a huge brand to protect.

Re: Google to pause Gemini image generation of people after issues

#287

We humans haven't even figured out how to discuss race, sex, or gender without it devolving into a tribal political fight. We shouldn't be surprised that algorithms we create and train on our own content will similarly be confused. Its the exact same reason we won't solve the alignment problem and have basically given up on it. We can't align humans with ourselves, we'll absolutely never define some magic ruleset tha…

We figured this out a long time ago. People are just bored and addicted to drama.

What did we figure out exactly? From where I sit, some countries are still pretty internally conflicted and globally different cultures have fundamentally different ideas.

Re: Google to pause Gemini image generation of people after issues

#288

OK. Have a setting where you can choose either: 1. Attempt to correct inherent biases in training data and produce diverse output (May sometimes produce results that are geographically or historically unrepresentative) 2. Unfiltered (Warning. Will generate output that reflects biases and inequalities in the training data.) Default to (1) and surely everybody is happy? It's transparent and clear about what and why it'…

The issue is that the vast majority of people would prefer 2, and would be fine with Google's reasonable excuse that it it just reflective of the patterns in data on the internet. But the media would prefer 1, and if Google chooses 2 they will have to endure an endless stream of borderline libelous hit pieces coming up with ever more convoluted new exmples of their "racism."

Re: Google to pause Gemini image generation of people after issues

#289

> Of course the politically sensitive people are waging war over it. Just like politically sensitive people waged war over Google identifying an obscured person as a Gorilla. Its just a silly mistake, how could anyone get upset over that?

No one is upset that an algorithm accidentally generated some images, they are upset that Google intentionally designed it to misrepresent reality in the name of Social Justice.

“Misrepresenting reality” is an interesting phrase, considering the nature of what we are discussing - artificially generated imagery.

It’s really hard to get these things right: if you don’t attempt to influence the model at all, the nature of the imagery that these systems are being trained on skews towards stereotype, because a lot of our imagery is biased and stereotypical. It seems perfectly reasonable to say that generated imagery should attempt to not lean into stereotypes and show a diverse set of people.

In this case it fails because it is not using broader historical and social context and it is not nuanced enough to be flexible about how it obtains the diversity- if you asked it to generate some WW2 American soldiers, you could rightfully include other ethnicities and genders than just white men, but it would have to be specific about their roles, uniforms, etc.

(Note: I work at Google, but not on this, and just my opinions)

Post reply on HN