Live data from Hacker News

Google Gemini tried to kill me

old.reddit.com

111–120 of 161 posts

Re: Google Gemini tried to kill me

#111
This is another case that adds to my thinking that LLMs will be a productivity win for people who are already familiar with the type of subject they need help with. Someone familiar with canning would have known the dangers of sealing food without properly heating everything to kill the bacteria. A novice would not know. Novices would have to do a lot of research to be sure of what they are doing. Experienced users would know the problem right away and fix it.

Re: Google Gemini tried to kill me

#112

Earlier quoted context omitted.

I think this is typical for software engineers (including myself) to view the world like this: this can't be murder, this is just words, you fell for it yourself. After all words alone are gibberish, the meaning arises in the head of the listener depending on how he interprets them. However in most countries the justice system works differently. If your neighbor gives you this advice and it kills you, what will matte…

You're not responding to the argument I'm making, but seemingly to other arguments that have been made over things like 4chan trolling that got people to cook their phones in microwaves. I'm not saying that users are the only responsible parties here. I'm saying that the humans , including both the users and Google ('s managers and employees), are the only parties that can possibly be responsible. The LLM is not resp…

Thanks for clarification, I agree this is a reasonable view of the situation.

Though I also don't really have problems with headlines like "AI tried to kill a man". True LLM can't be held responsible, but so are e.g. animals. If an unleashed dog kills a man, the owner will be responsible but the headlines will be still about the dog.

Then it can be argued that LLMs don't have intent while the dog had, and many more analogies, arguments and nuances will follow. My point is, this headline is still at an acceptable level of accuracy, unlike many other headlines that distort the reality completely.

Re: Google Gemini tried to kill me

#113
post #110
post #104

Earlier quoted context omitted.

Truly asinine take. Blaming the individual instead of the trillion-dollar scam industry.

So, if you drink and drive and kill a child, is it your responsibility, or is it the fault of alcohol being legal or vehicles not being mandates safe enough? This modern way of dealing with moral hazards is making me sad and afraid of others. After all, who knows whom they are going to blame for their own inability to perform sensible actions?

More like if you drink and then take paracetamol for the headache, the pharma corporation should warn you against performing this seemingly sensible action.

Re: Google Gemini tried to kill me

#114
post #63

I'm still utterly boggled by why Google thinks it's a good idea to serve generative answers to "give me true information about the world" type questions. It's stupid in the same way that it would be stupid to have Maps serve output from an image AI trained on real maps - output that resembles truth just isn't useful to somebody who wants definitive information. And even the "somebody using AI hype to pad their promot…

> why Google thinks

Money. And by the magic of ai they get rid of copyrights.

Re: Google Gemini tried to kill me

#115

I was defending generative AI recently when an article came up about Gemini misidentifying a toxic mushroom: https://news.ycombinator.com/item?id=40682531 . My thought there was that nearly everyone I know knows that toxic mushrooms are easily misidentified, and there have been lots of famous cases (even if many of them are apocryphal) of mushroom experts meeting their demise from a misidentified mushroom. In this ca…

It's not the oil at issue, as far as I understand, or even the garlic alone. It sounds like the garlic introduces the bacterium and the oil provides plenty of high-energy molecules (fats and some proteins) for explosive growth. Both olive oil and garlic can be stored for a while without issue. Also, I have followed this recipe hundreds of times before with roasted garlic, and it is has not been unsafe or given this r…

It doesn't seem to have killed you yet, but that doesn't mean it's safe:

> Do not store garlic in oil at room temperature. [...] The same hazard exists for roasted garlic stored in oil.

https://anrcatalog.ucanr.edu/pdf/8568.pdf

Garlic canned in water is also unsafe unless it's acidified or processed at elevated pressure, and uniformly acidifying looks nontrivial.

Re: Google Gemini tried to kill me

#117
post #77
post #60

I am extremely skeptical of this Gemini response, and it might be just some redditor farming upvotes. First, literally 100% of the blog posts, reddit replies, recipe books, and so on, will always list botulism as a potential danger of canning just about anything, but especially the common "garlic infused oil" (just do a Google search). It's unlikely that the model decided to trim/ignore this dangerous caveat (again,…

This isn't even a canning recipe - there's no processing time at all. This is more of an infusing recipe and the model didn't understand that you can't just infuse with anything. I also wouldn't be surprised if there are humans with similar recipes on the internet.

There have been YouTube videos with teens or well-meaning moms or oldsters uploading videos with dangerous info. All of which that I've seen I've told and they've taken down. Ergo, there being websites with it on in 2024 is still very likely—perhaps almost certainly.

I would also bet that the AI generated books flooding Amazon also contain dangerous information in terms of recipes.

Re: Google Gemini tried to kill me

#118
post #55
post #51

Earlier quoted context omitted.

We know that. The mainstream discussion, use, and personification of LLMs does not suggest that.

Slight correction: the well-informed nerds of today know this, but average person doesn't have the interest, math background, or software development experience to really grok it. What a time to be alive! Haha. Things keep getting weirder.

Even people with that on HN make it abundantly clear that they'll believe or say anything that makes the number go up.

Re: Google Gemini tried to kill me

#119

This is the Generative part of the GenAI. I believe we will come full circle back to search engines as front ends with occasional highly restricted GenAI summaries.

I believe it's a bubble like crypto and we'll find the new hotness to hype the shit out of whilst some grifters and diehards remain enamoured with the promise of improvements that never materialize.
Post reply on HN