Live data from Hacker News

Google Gemini tried to kill me

old.reddit.com

151–160 of 161 posts

Re: Google Gemini tried to kill me

#151

Earlier quoted context omitted.

The publication that I linked includes references into the peer-reviewed literature. The author has a PhD in microbiology, and is currently employed as a co-PI at the UC Davis Western Center for Food Safety: https://www.wcfs.ucdavis.edu/linda-j-harris/ So while it's possible that she's mistaken, I think it's much more likely that you are. If you still think it's the former, then I'm open to review any references that…

You and everyone in the food science field can convince me to stop this by providing a peer reviewed article indicating that roasting garlic does not get an internal temp hot enough to kill botulism (I will actually check this next time) and that botulism spores can inhabit the interior of the garlic. I would expect the latter to be false even if the former is true (the surface is the place all of these things grow).…

I don't think the study that you're asking for is likely to ever be performed. Even if the interior of an intact clove of garlic is free of botulism, pest damage, rough peeling, etc. might introduce it there. The goal of typical processing is to make the food uniformly safe, without relying on the initial distribution of the pathogens. For example, that's why the acidification method linked above applies only to chopped garlic, to ensure the acid penetrates all the way through.

The caramelized bits of roasted garlic almost certainly reached temperatures far above 121 C. The concern is the minimum temperature though, not just the surface temperature.

I'm not sure how your analogy with chicken is supposed to work. If you cooked chicken, submerged it in oil, and then incubated at room temperature for a few days, then I definitely wouldn't eat that either. The problem isn't the initial population of C. botulinum; it's that they multiply under the anaerobic conditions of the oil.

Likewise, I'm not sure what you think is wrong with their advice on the acidified garlic. The botulism simply won't grow at low pH, no matter how long you wait. The taste and texture will eventually become disgusting, but that's not a safety concern.

You seem to have the idea that cooking fully sterilizes food. That's not correct; it decreases the population of pathogens, but not to zero. So the cooking potentially makes the food safe to consume immediately (since the dose makes the poison, and the dose is very small). But if the food is incubated under conditions where the bacteria can grow, then the dose gets exponentially bigger and the food becomes unsafe. Methods that rely on perfect sterility (like pressure canning) achieve that by applying heat when the food is already in a closed container, and are assumed to lose that sterility once the container is opened.

Water-free garlic in oil should be safe at room temperature, and that publication gives directions for dried garlic in oil. I'd guess that confit would be safe too, and I'm not sure why you think the FDA would forbid it. (Note that it would be safe because of the low water activity, meaning that even if botulism spores are present they can't multiply. It would not be safe because it's "sanitized".)

Re: Google Gemini tried to kill me

#152

Earlier quoted context omitted.

1) How is this any different from social media influencers especially those in health and wellness? 2) I would argue that LLM's are designed to give an answer that is the closest possible answer to the right answer without being a plagiarist. Sometimes this means they will give you a wrong answer. The same is true for humans. Ask any teacher correcting essays from students.

> How is this any different from social media influencers especially those in health and wellness? If you are trying to make an argument that LLMs are exceptionally shitty at giving well-grounded advice, and instead excel at spouting asinine bullshit, congratulations, you succeeded.

Let me pose a hypothetical. What would your reaction be if the OP got the bad recommendation for garlic-infused oil from TikTok? That is a believable scenario. You would not be far wrong if it drove you to shout from the rooftops that TikTok (and social media in general) is a BS machine.

Why is it worse for the bullshit to come from a program (LLM) than it is from a human on social media? if not, why single out LLMs for their bullshit?

Re: Google Gemini tried to kill me

#153
post #149

That's an interesting prompt I tried on our Pulze.ai platform Spaces and we nailed it with automatically choosing the right model for this type of question gpt-4-turbo: "Yes, you can infuse garlic into olive oil without heating it up, but it requires caution due to the risk of botulism, a potentially fatal illness caused by Clostridium botulinum bacteria. These bacteria can thrive in low-oxygen environments and can p…

Which Gemini was used is important too btw. - just tried Gemini-1.5-pro and it was working just fine. So I really think the newer versions of LLMs are able to catch this.

Re: Google Gemini tried to kill me

#154

Earlier quoted context omitted.

More like if you drink and then take paracetamol for the headache, the pharma corporation should warn you against performing this seemingly sensible action.

Mixing drugs is not sensible. Anyone who does so without checking for side effects is at fault. The bottle being labeled is sufficient, just as the LLM being labeled as sometimes wrong is sufficient.

> The bottle being labeled is sufficient, just as the LLM being labeled as sometimes wrong is sufficient.

Labeling LLMs as "sometime wrong" is like labeling drugs as "sometimes have side effects, especially when mixing". It's a truism, such label would be completely useless. You need to take the drug anyway, so knowing that "some side effects exist" doesn't change anything. And often you also do need to take 2-3-4 drugs at same time, so the mixing clause is not helping either.

It took us many decades to build the system around drugs that today you take as granted. Drugs are studied very carefully, with all observed side effects listed explicitly. Drugs compatibility is a big topic and all new drugs are checked in combination with common-use drugs.

At the other end of equation awareness of side effects and mixing was increased dramatically both among doctors and patients, who were previously completely oblivious of them. Mere 100 years ago people were prescribed heroin against cough. Only 60 years ago the thalidomide disaster happened.

If all you can say to people destroyed by Kevadon is "you are at fault, the bottle said CAUTION: new drug", then I'm afraid we see this too differently.

Re: Google Gemini tried to kill me

#155
yet another tale of internet illiteracy.

even if you believe that llm can think/recall/etc. you should be vary of the information on the web, as part of internet literacy 101. especially with things that affect your health.

Re: Google Gemini tried to kill me

#156

Earlier quoted context omitted.

> How is this any different from social media influencers especially those in health and wellness? If you are trying to make an argument that LLMs are exceptionally shitty at giving well-grounded advice, and instead excel at spouting asinine bullshit, congratulations, you succeeded.

Let me pose a hypothetical. What would your reaction be if the OP got the bad recommendation for garlic-infused oil from TikTok? That is a believable scenario. You would not be far wrong if it drove you to shout from the rooftops that TikTok (and social media in general) is a BS machine. Why is it worse for the bullshit to come from a program (LLM) than it is from a human on social media? if not, why single out LLMs…

I mean, both are bad. Just because one exists doesn't make the other better by comparison. However LLMs are just so much worse because

1. they can be asked anything, on any subject, at any time, at the click of a button

2. They have even less accountability than a human when stating falsehoods or dangerous advice

3. They're really good at generating statements that sound believable or authoritative, even when devoid of truth

Re: Google Gemini tried to kill me

#157

Earlier quoted context omitted.

You and everyone in the food science field can convince me to stop this by providing a peer reviewed article indicating that roasting garlic does not get an internal temp hot enough to kill botulism (I will actually check this next time) and that botulism spores can inhabit the interior of the garlic. I would expect the latter to be false even if the former is true (the surface is the place all of these things grow).…

I don't think the study that you're asking for is likely to ever be performed. Even if the interior of an intact clove of garlic is free of botulism, pest damage, rough peeling, etc. might introduce it there. The goal of typical processing is to make the food uniformly safe, without relying on the initial distribution of the pathogens. For example, that's why the acidification method linked above applies only to chop…

> I'm not sure how your analogy with chicken is supposed to work. If you cooked chicken, submerged it in oil, and then incubated at room temperature for a few days, then I definitely wouldn't eat that either. The problem isn't the initial population of C. botulinum; it's that they multiply under the anaerobic conditions of the oil.

Let me spell out the analogy: The problem with chicken isn't long-term presence of a bacteria colony (botulism), it's presence of salmonella. Salmonella doesn't need days to become a problem - it's a problem immediately. Chicken when raw is a great environment for salmonella. Chicken when cooked is a great environment for salmonella - in fact, there are numerous food safety incidents that occur when people use the same utensils on raw and cooked chicken, transferring the bacteria. Hence, the only reason it is safe to eat the cooked chicken is because you kill (enough of) the salmonella during the cooking process.

Conversely, he document you cited makes the claim that raw garlic is a great environment for botulism, and so is roasted garlic, and does not address whether the cooking process kills the bacteria. In fact, it makes the claim by implication that there is no roasting process that kills the bacteria. As far as I can tell, these claims are made without any actual experiment, and it is simply enough that the environments before and after processing are good for harboring the bug.

Re: Google Gemini tried to kill me

#158

Earlier quoted context omitted.

Let me pose a hypothetical. What would your reaction be if the OP got the bad recommendation for garlic-infused oil from TikTok? That is a believable scenario. You would not be far wrong if it drove you to shout from the rooftops that TikTok (and social media in general) is a BS machine. Why is it worse for the bullshit to come from a program (LLM) than it is from a human on social media? if not, why single out LLMs…

I mean, both are bad. Just because one exists doesn't make the other better by comparison. However LLMs are just so much worse because 1. they can be asked anything, on any subject, at any time, at the click of a button 2. They have even less accountability than a human when stating falsehoods or dangerous advice 3. They're really good at generating statements that sound believable or authoritative, even when devoid…

All of your statements are true just like these are

1) humans can be asked anything on any subject at any time at the click of a button. The response time differs but we can also add a delay of hours for LLM's to respond and make it seem the same.

2) humans have even less accountability than an LLM when stating falsehoods or dangerous advice. At least in the US, humans can spout whatever bull shit they want under the guise of the First Amendment. LLM's can be censored legally because they have no such legal privilege.

3) humans are really good at generating statements that sound believable or authoritative even when devoid of the truth. See US conservatives, corporate disinformation, advertising, and fundamentalist religions

One could make the case that humans created LLM's in their own image. We identify the erroneous outputs as bullishit or hallucination because that's what we do. If we did not have the capability of lying, hallucinating, or the term I prefer, confabulating, it would be difficult to recognize in LLM output. It's tough for us to imagine a world where other beings didn't lie or confabulate all the women saying that, I'm beginning to wonder if in LLM is such a creature. It gives us confabulations because it doesn't know they exist and can't modify its behavior.

Re: Google Gemini tried to kill me

#159

Earlier quoted context omitted.

I don't think the study that you're asking for is likely to ever be performed. Even if the interior of an intact clove of garlic is free of botulism, pest damage, rough peeling, etc. might introduce it there. The goal of typical processing is to make the food uniformly safe, without relying on the initial distribution of the pathogens. For example, that's why the acidification method linked above applies only to chop…

> I'm not sure how your analogy with chicken is supposed to work. If you cooked chicken, submerged it in oil, and then incubated at room temperature for a few days, then I definitely wouldn't eat that either. The problem isn't the initial population of C. botulinum; it's that they multiply under the anaerobic conditions of the oil. Let me spell out the analogy: The problem with chicken isn't long-term presence of a b…

> As far as I can tell, these claims are made without any actual experiment, and it is simply enough that the environments before and after processing are good for harboring the bug.

Correct--processes are unsafe until proven safe. Would you stand under a bridge designed by an engineer who believed otherwise?

And the effort to prove that a process step actually kills all pathogens (including those that survive at temperatures well above 100 C) across all possible input material is big. So the return on that investment usually isn't there, especially when the safe alternative is trivial--heat gently to infuse, then refrigerate, or acidify or pressure-can for a commercial product.

The principles that you're rejecting are the reason why Americans now rarely suffer from foodborne illnesses that used to be a routine, unpleasant, and occasionally lethal part of life (and still are in many developing countries). As with many public health measures, they seem to be victims of their own success, delivering extraordinary improvements in safety that then deliver public complacency.

Re: Google Gemini tried to kill me

#160
post #31

Earlier quoted context omitted.

On a related note, I have never seen a person trying to kill anyone. Rather I have seen movies about a bunch of things that are ostensibly people holding guns, that uncritically standing in the way of their shot paths as if the guns were toys might cause harm for a person choosing to stand in such a foolish place. English is such a fun language sometimes! So many idioms.

I didn't kill this man, your honor. I was just standing out there holding a knife. When he walked in, he stumbled and fell on it six times.

You jest, but I remember reading a case about a guy who was convicted on 9 counts of attempted murder and managed to get it reduced to one on appeal by pointing out that he only fired one bullet toward a group of 9 people. (Nobody was actually hit.)
Post reply on HN