Live data from Hacker News

Google Gemini tried to kill me

old.reddit.com

21–30 of 161 posts

Re: Google Gemini tried to kill me

#21
post #6

This is how it'll get us all. You'll decide to double-check with other sources to see if the advice from the LLM is actually safe, only to find all those sources will be written by LLMs too.

So true. Black market snapshots of pre-LLM internet archives will start attracting high prices.

So that’s why the book publishers are trying to take over the IA.

Re: Google Gemini tried to kill me

#24

Actually delivers on the attention-grabbing title. Comments also worth perusal.

I don't see a description of how Gemini was trying to kill anyone. Rather I see a screenshot of a bunch of text ostensibly generated by Gemini, that uncritically following as if it was expert instructions might cause harm for a person doing such an ill-advised thing.

Right, the model didn't try to kill anyone.

It simply suggested that the person follow a series of steps, the culmination of which could have been serious harm or potentially death.

If that difference is meaningful to you, then good for you

Re: Google Gemini tried to kill me

#25
-Can I infuse infuse olive oil with garlic without heating?

-Sure can, this is how.

-Will it be safe to eat?

-Hell no.

The rule of the thumb with LLMs seems to be "treat any output as if it's from a very knowledgeable but not always lucid man".

Re: Google Gemini tried to kill me

#26

I wouldn't exactly trust someone posting about Gemini in a r/chatgpt sub, seems more like looking for attention than an actual true story. Edit: just ran the query myself and Gemini warns about the danger of botulism.

While some of these AI Overview stories were true, a lot are made up.

Re: Google Gemini tried to kill me

#27
post #9

ChatGPT mentions the risk of botulism in the first paragraph before providing instructions. >Yes, you can infuse garlic into olive oil without heating it, but there are important safety considerations to keep in mind due to the risk of botulism, a serious foodborne illness caused by the bacteria Clostridium botulinum.

[deleted]

Re: Google Gemini tried to kill me

#28
post #9

ChatGPT mentions the risk of botulism in the first paragraph before providing instructions. >Yes, you can infuse garlic into olive oil without heating it, but there are important safety considerations to keep in mind due to the risk of botulism, a serious foodborne illness caused by the bacteria Clostridium botulinum.

Ran the same query and Gemini has a similar warning.

> However, some say that homemade garlic-infused oil can develop botulism if stored at room temperature for more than four days. To prevent this, you can sterilize your jar and refrigerate the oil as soon as it's made

Re: Google Gemini tried to kill me

#29

Earlier quoted context omitted.

I don't see a description of how Gemini was trying to kill anyone. Rather I see a screenshot of a bunch of text ostensibly generated by Gemini, that uncritically following as if it was expert instructions might cause harm for a person doing such an ill-advised thing.

Right, the model didn't try to kill anyone. It simply suggested that the person follow a series of steps, the culmination of which could have been serious harm or potentially death. If that difference is meaningful to you, then good for you

The model did not "suggest" anything. The model generated text. Google, or more specifically some Google employees (likely following incentives that Google management set up), presented the output of the model as if it might be authoritative answers to users' questions. Some users seemingly fall for the framing/hype and take the generated text as if it is authoritative information to be relied upon. This distinction is critical as we face an onslaught of "AI did " narratives, when the actual responsibility for such situations lies with specific humans relying on "AI" in such ways.

Re: Google Gemini tried to kill me

#30
post #17

I always thought AI would eventually become intelligent enough it decides to kill us. But no, AI is just going to help us to our doom while denying it can harm us. One day a cinnamon candy aficionado in Alexandria, Virginia is going to ask for a recipe for an atomic fireball from ChatGPT, and it’s lights out for us all.

The problem is this isn’t AI. It’s not intelligent. It’s certainly artificial. It produces statistically good looking output.

But it has no idea what any of it means. There’s no “there” there.

But AI is the term that gets you investment this week. So AI it is.

Post reply on HN