Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Google to pause Gemini image generation of people after issues

theverge.com

Post reply on HN
Print view View original

701–710 of 1001 posts

Re: Google to pause Gemini image generation of people after issues

#701

Post by partiallypro »

This isn't even the worst I've seen from Gemini. People have asked it about actual terrorist groups, and it tries to explain away that they aren't so bad and it's a nuanced subject. I've seen another that was borderline Holocaust denial.

The fear is that some of this isn't going to get caught, and eventually it's going to mislead people and/or the models start eating their own data and training on BS that they had given out initially. Sure, humans do this too, but humans are known to be unreliable, we want data from the AI to be pretty reliable given eventually it will be used in teaching, medicine, etc. It's easier to fix now because AI is still in its infancy, it will be much harder in 10-20 years when all the newer training data has been contaminated by the previous AI.

Re: Google to pause Gemini image generation of people after issues

#702

Post by duxup »

skynetv2 wrote: post #690

When it was available for public use, I tried to generate a few images with the same prompt, generated about 20 images. None of the 20 images had white people in it. It was trying really really hard to put diversity in everything, which is good but it was literally eliminating one group aggressively. I also noticed it was ridiculously conservative and denying every possible prompt that had was obviously not at all wr…

I felt like that the refusals were triggered by just basic keyword triggers.

I could see where a word or two might be involved in prompting something non desirable, but the entire request was clearly not related to that.

The refusal filtering seemed very very basic. Surprisingly poor.

Re: Google to pause Gemini image generation of people after issues

#703

Post by Biganon »

_heimdall wrote: post #224

We humans haven't even figured out how to discuss race, sex, or gender without it devolving into a tribal political fight. We shouldn't be surprised that algorithms we create and train on our own content will similarly be confused. Its the exact same reason we won't solve the alignment problem and have basically given up on it. We can't align humans with ourselves, we'll absolutely never define some magic ruleset tha…

> We humans

Americans*

The rest of the world is able to speak about those things

Re: Google to pause Gemini image generation of people after issues

#704

Post by thrill »

andybak wrote: post #226

OK. Have a setting where you can choose either: 1. Attempt to correct inherent biases in training data and produce diverse output (May sometimes produce results that are geographically or historically unrepresentative) 2. Unfiltered (Warning. Will generate output that reflects biases and inequalities in the training data.) Default to (1) and surely everybody is happy? It's transparent and clear about what and why it'…

(1) is just playing Calvin Ball.

"Correcting" the output to reflect supposedly desired nudges towards some utopian ideal inflates the "value" of the model (and those who promote it) the same as "managing" an economy does by printing money. The model is what the model is and if the result is sufficiently accurate (and without modern Disney reimaginings) for the intended purpose you leave it alone and if it is not then you gather more data and/or do more training.

Re: Google to pause Gemini image generation of people after issues

#705

Post by khaki54 »

verisimi wrote: post #687
aliasxneo wrote: post #544

Quite the cultural flame war in this thread. For me, the whole incident points to the critical importance of open models. A bit of speculation, but if AI is eventually intended to play a role in education, this sort of control would be a dream for historical revisionists. The classic battle of the thought police is now being extended to AI.

No need to distance yourself from historical revisionism. History has always been a tool of the present powers to control the future direction. It is just licensed interpretation. No one has the truth, neither the historical revisionists not the licensed historians.

No such thing as historical revisionism. The truth is that the good guys won every time. /s

Re: Google to pause Gemini image generation of people after issues

#706

Post by FirmwareBurner »

logicalmonster wrote: post #596

Personally speaking, this is a blaring neon warning sign of institutional rot within Google where shrieking concerns about DEI have surpassed a focus on quality results. Investors in Google (of which I am NOT one) should consider if this is the mark of a company on the upswing or downslide. If the focus of Google's technology is identity rather than reality, it is inevitable that they will be surpassed.

> If the focus of Google's technology is identity rather than reality, it is inevitable that they will be surpassed.

They're trailing 5 or so years behind Disney who also placed DEI over producing quality entertainment and their endless stream of flops reflects that. South Park even mocked them about that ("put a black chick in it and make her lame and gay").

Can't wait for Gemini and Google to flop as well since nobody has a use for a heavily biased AI.

Re: Google to pause Gemini image generation of people after issues

#707

Post by xnx »

mrtksn wrote: post #4

For context: There was an outcry in social media after Gemini refused to generate images of white people, leading deeply inaccurate in historic sense images being generated. Though the issue might be more nuanced than the mainstream narrative, it had some hilarious examples. Of course the politically sensitive people are waging war over it. Here are some popular examples: https://dropover.cloud/7fd7ba

Image generators probably should follow your prompt closely and use probable genders and skin tones when unspecified, but I'm fully in support of having a gender and skin tone randomizer checkbox. The ahistorical results are just too interesting.

Re: Google to pause Gemini image generation of people after issues

#708

Post by mort96 »

verisimi wrote: post #691
mort96 wrote: post #674

Earlier quoted context omitted.

I believe this to be a symptom of a much, much deeper problem than "DEI gone too far". I'm sure that without whatever systems is preventing Gemini from producing pictures of white people, it would be extremely biased towards generating pictures of white people, presumably due to an incredibly biased training data set. I don't remember which one, but there was some image generation AI which was caught pretty much just…

[flagged]

"Marxism" isn't responsible for bias in training sets, no.

Re: Google to pause Gemini image generation of people after issues

#709

Post by [deleted] »

MrBuddyCasino wrote: post #192
mrtksn wrote: post #4

For context: There was an outcry in social media after Gemini refused to generate images of white people, leading deeply inaccurate in historic sense images being generated. Though the issue might be more nuanced than the mainstream narrative, it had some hilarious examples. Of course the politically sensitive people are waging war over it. Here are some popular examples: https://dropover.cloud/7fd7ba

" a friend at google said he knew gemini was this bad...but couldn't say anything until today (he DMs me every few days). lots of ppl in google knew. but no one really forced the issue obv and said what needed to be said google is broken " Razib Khan, https://twitter.com/razibkhan/status/1760545472681267521

[deleted]

Re: Google to pause Gemini image generation of people after issues

#710

Post by bsimpson »

hot_gril wrote: post #685
jack_riminton wrote: post #317

Earlier quoted context omitted.

Reminds me of when black people in the UK get called African American by Americans. No they're neither African nor American It's an incredibly self-centered view of the world

I promise it's not because we think of people outside the US as American. When I was a kid in the 2000s, we were told never to say "black" and to say "African-American" instead. There was no PC term in the US to refer to black people who are not American. This has started to change lately, but it's still iffy. Besides that, many Americans (including myself) are self-centered in other ways. Yes I like our imperial uni…

Fahrenheit gets a bad rap.

100F is about as hot as you'll ever get. 0F is about as cold as you'll ever get. It's a perceptual system.

Post reply on HN