Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Google to pause Gemini image generation of people after issues

theverge.com

Post reply on HN
Print view View original

121–130 of 1001 posts

Re: Google to pause Gemini image generation of people after issues

#121

Post by bayindirh »

timeon wrote: post #50
msp26 wrote: post #43

Earlier quoted context omitted.

I want image generators to generate what I ask them and not alter my query into something else. It's deeply shameful that billions of dollars and the hard work of incredibly smart people is mangled for a 'feature' that most end users don't even want and can't turn off. This is not a one off, it keeps happening with generative AI all the time. Silent prompt injections are visible for now with jailbreaks but who knows…

This sounds bit entitled. It is just service of private company.

Is it equally entitled to ask for a search engine which brings answers related to my query?

Re: Google to pause Gemini image generation of people after issues

#122

Post by ben_w »

mrtksn wrote: post #4

For context: There was an outcry in social media after Gemini refused to generate images of white people, leading deeply inaccurate in historic sense images being generated. Though the issue might be more nuanced than the mainstream narrative, it had some hilarious examples. Of course the politically sensitive people are waging war over it. Here are some popular examples: https://dropover.cloud/7fd7ba

I get the point but one of those four founding fathers seems technically correct to me, albeit in the kind of way that might be in the kind of way Lisa Simpson's script would be written.

And the caption suggests they asked for "a pope", rather than a specific pope, so while the left image looks like it would violate Ordinatio sacerdotalis which is being claimed to be subject to Papal infallibility(!), the one the right seems like a plausible future or fictitious pope.

Still, I get the point.

Re: Google to pause Gemini image generation of people after issues

#123

Post by DonHopkins »

Mountain_Skies wrote: post #85
dontupvoteme wrote: post #68

OpenAI already experienced this backlash when it was injecting words for diversity into prompts (hilariously if you asked for your prompt back it would include the words, and supposedly you could get it to render the extra words onto signs within the image). How could Google have made the same mistake but worse ?

Perhaps the overtness was intentional, made by someone in the company who doesn't like the '1984' world Google is building, and saw this as a good opportunity to alert the world with plausible deniability.

[flagged]

Re: Google to pause Gemini image generation of people after issues

#124

Post by imgabe »

sycamoretrees wrote: post #22

why are we using image generators to represent actual history? If we want accuracy surely we can use actual documents that are not imagined by a bunch of code. If you want to write fanfic or whatever then just adjust the prompt

I don't know what you mean by "represent actual history". I don't think anyone believes that AI output is supposed to replace first-party historical sources.

But we are trying to create a tool where we can ask it questions and it gives us answers. It would be nice if it tried to make the answers accurate.

Re: Google to pause Gemini image generation of people after issues

#125

Post by db48x »

mrtksn wrote: post #87

Honestly, I'm baffled by the American keywordism and obsession with images. They seem to think that if they don't say certain words and show people from minorities in the marketing material the racism and discrimination will be solved and atrocities from the past will be forgiven. It only become unmanageable and builds up resentment. Anyway, maybe its a phase. Sometimes I wonder if the openly racist European&Asians w…

[flagged]

Re: Google to pause Gemini image generation of people after issues

#126

Post by nuz »

tycho-newman wrote: post #98

I am shocked, shocked , that AI hallucinates. This technology is a mirror, like many others. We just don't like the reflection it throws back at us.

Hallucinations are unintended. These are intended and built into the model very consciously

Re: Google to pause Gemini image generation of people after issues

#127

Post by dmezzetti »

troupo wrote: post #97
dmezzetti wrote: post #84

This is a good reminder on the importance of open models and ensuring everyone has the ability to build/fine-tune their own.

This is also why the AI industry hates upcoming regulations like EU's AI act which explicitly require companies to document their models and training sets.

A one-size-fits-all model is hard enough as it is. But with these types of tricks added in, it's tough to see how any business can rely on such a thing.

Re: Google to pause Gemini image generation of people after issues

#128

Post by throwaway118899 »

fweimer wrote: post #6

Probably a better story (not paywalled, maybe the original source): https://www.theverge.com/2024/2/21/24079371/google-ai-gemini... Also related: https://news.ycombinator.com/item?id=39465301

Ah, so it was disabled because some diverse people didn’t like they were made into Nazis, not because the model is blatantly racist against white people.

Re: Google to pause Gemini image generation of people after issues

#130

Post by perihelions »

rob74 wrote: post #110
perihelions wrote: post #39

There's an amusing irony here: real diversity would entail many competing ML companies from non-Western countries —each of which would bring their own cultural norms, alien and uncomfortable to Westerners. There's no cultural diversity in Silicon Valley being a global hegemon: exporting a narrow sliver of the world's viewpoints to the whole planet, imposing them with the paternalism drawn from our own sense of superi…

There's just one problem: even if you collect all the biases of all the countries in the world, you still won't get something diverse and inclusive in the end...

No, and that's a utopianism that shouldn't be anyone's working goal, because it's fantastic and unrealistic.
Post reply on HN