Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Google Gemini tried to kill me

old.reddit.com

Post reply on HN
Print view View original

41–50 of 161 posts

Re: Google Gemini tried to kill me

#41

Post by lifeisjoy »

mupuff1234 wrote: post #28
tjpnz wrote: post #9

ChatGPT mentions the risk of botulism in the first paragraph before providing instructions. >Yes, you can infuse garlic into olive oil without heating it, but there are important safety considerations to keep in mind due to the risk of botulism, a serious foodborne illness caused by the bacteria Clostridium botulinum.

Ran the same query and Gemini has a similar warning. > However, some say that homemade garlic-infused oil can develop botulism if stored at room temperature for more than four days. To prevent this, you can sterilize your jar and refrigerate the oil as soon as it's made

I ran the same query too but didn’t get the botulism warning every time. So it seems to vary. However, unlike the poster most of the answers from Gemini did say to store it in a cool, dark place as opposed to saying to store it at room temperature explicitly

Re: Google Gemini tried to kill me

#42

Post by dezsiszabi »

tjpnz wrote: post #9

ChatGPT mentions the risk of botulism in the first paragraph before providing instructions. >Yes, you can infuse garlic into olive oil without heating it, but there are important safety considerations to keep in mind due to the risk of botulism, a serious foodborne illness caused by the bacteria Clostridium botulinum.

More precisely: it happened to mention it when you asked.

Re: Google Gemini tried to kill me

#43

Post by [deleted] »

crdrost wrote: post #31
mindslight wrote: post #14

Earlier quoted context omitted.

I don't see a description of how Gemini was trying to kill anyone. Rather I see a screenshot of a bunch of text ostensibly generated by Gemini, that uncritically following as if it was expert instructions might cause harm for a person doing such an ill-advised thing.

On a related note, I have never seen a person trying to kill anyone. Rather I have seen movies about a bunch of things that are ostensibly people holding guns, that uncritically standing in the way of their shot paths as if the guns were toys might cause harm for a person choosing to stand in such a foolish place. English is such a fun language sometimes! So many idioms.

[deleted]

Re: Google Gemini tried to kill me

#44

Post by pclmulqdq »

hn_throwaway_99 wrote: post #33

I was defending generative AI recently when an article came up about Gemini misidentifying a toxic mushroom: https://news.ycombinator.com/item?id=40682531 . My thought there was that nearly everyone I know knows that toxic mushrooms are easily misidentified, and there have been lots of famous cases (even if many of them are apocryphal) of mushroom experts meeting their demise from a misidentified mushroom. In this ca…

It's not the oil at issue, as far as I understand, or even the garlic alone. It sounds like the garlic introduces the bacterium and the oil provides plenty of high-energy molecules (fats and some proteins) for explosive growth. Both olive oil and garlic can be stored for a while without issue.

Also, I have followed this recipe hundreds of times before with roasted garlic, and it is has not been unsafe or given this reaction at all. I assume that is because you sterilize the garlic by roasting it.

Re: Google Gemini tried to kill me

#45

Post by Turing_Machine »

MBCook wrote: post #32
29athrowaway wrote: post #5

Earlier quoted context omitted.

Or food from dented cans.

Or especially bulging.

Definitely a good rule of thumb, though there are exceptions.

I gather that surströmming, a type of canned fermented herring popular in Sweden, is considered to be at its best when the can starts to bulge (for some value of "best").

Apparently the key difference is that it has enough salt in it that botulism and other nasty bacteria can't survive.

Opening a can of this stuff is memorable. Even the Swedes generally open it outdoors.

https://en.wikipedia.org/wiki/Surstr%C3%B6mming

Re: Google Gemini tried to kill me

#46

Post by hn_throwaway_99 »

mupuff1234 wrote: post #28
tjpnz wrote: post #9

ChatGPT mentions the risk of botulism in the first paragraph before providing instructions. >Yes, you can infuse garlic into olive oil without heating it, but there are important safety considerations to keep in mind due to the risk of botulism, a serious foodborne illness caused by the bacteria Clostridium botulinum.

Ran the same query and Gemini has a similar warning. > However, some say that homemade garlic-infused oil can develop botulism if stored at room temperature for more than four days. To prevent this, you can sterilize your jar and refrigerate the oil as soon as it's made

To be honest, if it gave out anything except that warning, I still think it's bullshit and extremely dangerous.

I.e. the "infuse" step where it says "Seal the container tightly and let it sit at room temperature for a week." No. Never. This is basically how you deliberately grow Clostridium botulinum.

It's like if it gave you a recipe for C4 to use as Play-Doh with a caveat at the bottom "However, some say this homemade Play-Doh may explode violently, so be sure to keep it away from any matches."

Re: Google Gemini tried to kill me

#47

Post by metadat »

More accurate, albeit less sensational headline:

"Blindly following instructions from an LLM would have killed me."

Not exactly shocking if you take into consideration that at the core, they're simply number predictors.

Re: Google Gemini tried to kill me

#48

Post by derefr »

resolutebat wrote: post #20
jrflowers wrote: post #11

Earlier quoted context omitted.

It’s obscure in the sense that most information about safety in food canning is obscure if you never look into it

Infused oils don't fall under most people's mental model of "canning" though.

Now I'm curious whether there's any way to do oil infusion where the oil doesn't create an anaerobic environment.

Can you bubble oxygen through oil in a way that would keep aerobic bacterial reactions going, without making the oil go rancid?

Re: Google Gemini tried to kill me

#49

Post by lynx23 »

willsmith72 wrote: post #24
mindslight wrote: post #14

Earlier quoted context omitted.

I don't see a description of how Gemini was trying to kill anyone. Rather I see a screenshot of a bunch of text ostensibly generated by Gemini, that uncritically following as if it was expert instructions might cause harm for a person doing such an ill-advised thing.

Right, the model didn't try to kill anyone. It simply suggested that the person follow a series of steps, the culmination of which could have been serious harm or potentially death. If that difference is meaningful to you, then good for you

https://darwinawards.com/ -- And yes, there is a quite meaningful difference. I know that some people are safety freaks, but I for one, will not grief for a single person that managed to kill themselves by following LLM instructions. There is a point of low IQ where we as a society can't really help anymore.

Re: Google Gemini tried to kill me

#50

Post by adolph »

ffhhj wrote: post #4

Botulism, that's why we didn't give honey to our young children, it can damage their brains.

Had no idea, that’s terrible. From the NLM:

Over 50% of the new cases of infantile botulism in the past 30 years have occurred in California. . . . Approximately 20% of cases involve honey or corn syrup. . . . Hispanics and Asian families have a higher incidence of infantile botulism because of their use of herbal medications and raw honey.

https://www.ncbi.nlm.nih.gov/books/NBK493178/

Post reply on HN