Live data from Hacker News

Google to pause Gemini image generation of people after issues

theverge.com

41–50 of 1001 posts

Re: Google to pause Gemini image generation of people after issues

#43

why are we using image generators to represent actual history? If we want accuracy surely we can use actual documents that are not imagined by a bunch of code. If you want to write fanfic or whatever then just adjust the prompt

I want image generators to generate what I ask them and not alter my query into something else.

It's deeply shameful that billions of dollars and the hard work of incredibly smart people is mangled for a 'feature' that most end users don't even want and can't turn off.

This is not a one off, it keeps happening with generative AI all the time. Silent prompt injections are visible for now with jailbreaks but who knows what level of stupidity goes on during training?

Look at this example from the Würstchen paper (which stable cascade is based on):

>This work uses the LAION 5-B dataset...

>As an additional precaution, we aggressively filter the dataset to 1.76% of its original size, to reduce the risk of harmful content being accidentally present (see Appendix G).

Re: Google to pause Gemini image generation of people after issues

#45
It's hardly "politically sensitive" to be disappointed by this behaviour: https://news.ycombinator.com/item?id=39465554

"Asked specifically to generate images of people of various ethnic groups, it would happily do it except in the case of white people, in which it would flatly refuse."

Re: Google to pause Gemini image generation of people after issues

#46

[flagged]

While I don't disagree with your conclusion about Gemini (it does seem to be at the moment incorrigibly racist against the very idea of white people), I'd say that the paucity of comments is likely due to the fact that it's early in the day and it's only been an hour since this was posted. I'd be surprised if you saw the same paucity after a full day of having this on the page.

Re: Google to pause Gemini image generation of people after issues

#47
Yet another setback hot on the heels of their faked demos, but this one is much worse. Their actions shifted things into the political realm and ticked off not only the extremists, but a lot of the majority moderate middle too.

For those looking to launch an AI platform in the future, take note. Don't lie about and oversell your technology. Don't get involved in politics because at best you'll alienate half your customers and might even manage to upset all sides. Google may have billions to waste, but very few companies have that luxury.

Re: Google to pause Gemini image generation of people after issues

#49
post #33

Can someone provide content of the Tweet?

> We're already working to address recent issues with Gemini's image generation feature. While we do this, we're going to pause the image generation of people and will re-release an improved version soon.

They were replying to their own tweet stating

> We're aware that Gemini is offering inaccuracies in some historical image generation depictions. Here's our statement.

Which itself contained a text image stating

> We’re working to improve these kinds of depictions immediately. Gemini’s AI image generation does generate a wide range of people. And that’s generally a good thing because people around the world use it. But it’s missing the mark here.

Re: Google to pause Gemini image generation of people after issues

#50
post #43

why are we using image generators to represent actual history? If we want accuracy surely we can use actual documents that are not imagined by a bunch of code. If you want to write fanfic or whatever then just adjust the prompt

I want image generators to generate what I ask them and not alter my query into something else. It's deeply shameful that billions of dollars and the hard work of incredibly smart people is mangled for a 'feature' that most end users don't even want and can't turn off. This is not a one off, it keeps happening with generative AI all the time. Silent prompt injections are visible for now with jailbreaks but who knows…

This sounds bit entitled. It is just service of private company.
Post reply on HN