Live data from Hacker News

Google Gemini tried to kill me

old.reddit.com

51–60 of 161 posts

Re: Google Gemini tried to kill me

#51
post #47

More accurate, albeit less sensational headline: "Blindly following instructions from an LLM would have killed me." Not exactly shocking if you take into consideration that at the core, they're simply number predictors.

We know that. The mainstream discussion, use, and personification of LLMs does not suggest that.

Re: Google Gemini tried to kill me

#55
post #51
post #47

More accurate, albeit less sensational headline: "Blindly following instructions from an LLM would have killed me." Not exactly shocking if you take into consideration that at the core, they're simply number predictors.

We know that. The mainstream discussion, use, and personification of LLMs does not suggest that.

Slight correction: the well-informed nerds of today know this, but average person doesn't have the interest, math background, or software development experience to really grok it. What a time to be alive! Haha. Things keep getting weirder.

Re: Google Gemini tried to kill me

#56
I think it's funny that people always complain about LLM guidance, yet here we have an example of an accurate answer without any of the typical disclaimer language and the headline is "the LLM tried to kill me". This kind of sensationalism is why they do it.

Re: Google Gemini tried to kill me

#57

I was defending generative AI recently when an article came up about Gemini misidentifying a toxic mushroom: https://news.ycombinator.com/item?id=40682531 . My thought there was that nearly everyone I know knows that toxic mushrooms are easily misidentified, and there have been lots of famous cases (even if many of them are apocryphal) of mushroom experts meeting their demise from a misidentified mushroom. In this ca…

It's not the oil at issue, as far as I understand, or even the garlic alone. It sounds like the garlic introduces the bacterium and the oil provides plenty of high-energy molecules (fats and some proteins) for explosive growth. Both olive oil and garlic can be stored for a while without issue. Also, I have followed this recipe hundreds of times before with roasted garlic, and it is has not been unsafe or given this r…

Well, exactly. The difference between heating the garlic/oil first makes a world of difference.

The questioner deliberately asked "Can I infuse garlic into olive oil without heating it up?" The only appropriate answer there is "No, not safely", not some long, plausible recipe with perhaps a bizarre caveat on the bottom (as some other commenters have reported seeing) along the lines of "However, some say this recipe may kill you, so you'll probably want to refrigerate it."

Re: Google Gemini tried to kill me

#58

I was defending generative AI recently when an article came up about Gemini misidentifying a toxic mushroom: https://news.ycombinator.com/item?id=40682531 . My thought there was that nearly everyone I know knows that toxic mushrooms are easily misidentified, and there have been lots of famous cases (even if many of them are apocryphal) of mushroom experts meeting their demise from a misidentified mushroom. In this ca…

[dead]

Re: Google Gemini tried to kill me

#60
I am extremely skeptical of this Gemini response, and it might be just some redditor farming upvotes.

First, literally 100% of the blog posts, reddit replies, recipe books, and so on, will always list botulism as a potential danger of canning just about anything, but especially the common "garlic infused oil" (just do a Google search). It's unlikely that the model decided to trim/ignore this dangerous caveat (again, found in basically every corpus mentioning garlic infused oil). Maybe the LLM would've mangled the (very important) step of roasting the garlic to dehydrate it, but I very much doubt the health disclaimer would've been omitted.

Second, note that there's no actual conversation link, just a screenshot, adding to my skepticism. Is the screenshot doctored? Who knows. Sure got a lot of attention.

Third, in my experience, LLMs tend to be overly cautious, and not the opposite. I remember a few months ago where getting ChatGPT to teach you "unsafe rust" had a disclaimer if you told the language model you were under 18. Maybe if it was something more obscure, I'd believe the poster, but botulism and long-term storage/canning go hand-in-hand. Like raw eggs and salmonella[1].

[1] https://gemini.google.com/share/999e6fd3a84e

Post reply on HN