Live data from Hacker News

Family poisoned after using AI-generated mushroom identification book

old.reddit.com

31–40 of 123 posts

Re: Family poisoned after using AI-generated mushroom identification book

#31
post #19

I see this happen a lot on Tiktok and Facebook where influencers post about using different plants for food or for skincare. They often either show photos that are of a different plant that is dangerous to eat or they haven’t actually tried this and promoting the consumption of a plant that can poison people. It’s the Wild West out there on social networks.

Obligatory PA Comic: https://www.penny-arcade.com/comic/2024/05/27/a-very-particu...

Ouch. That web comic did not age gracefully.

Re: Family poisoned after using AI-generated mushroom identification book

#32
post #20

This is actually a problem with non-AI generated mushroom books as well. Apparently publishers have been copying eachothers misinformation for a long time.

It is also a problem with accurate images and descriptions. Some mushrooms are very easily mistaken for others: unless you're 100% sure you've picked this very species before in around the same place and time, you'd better leave it there or bring it to a mycologist for identification.

not only that, some toxics taste quite delicious, others are part of an interaction [with beer/wine/spirits] that produces toxic products.

Re: Family poisoned after using AI-generated mushroom identification book

#33
post #25

This was something that was bound to happen and is going to happen again unless we get more serious regulation around AI publishing. > It lists the author as having a Masters Degree in Mycology from University of East Ontario. A search later revealed there is no "University of East Ontario." This has got to be criminal negligence.

Sounds more like a scam.

Isn’t this the case for almost everything “AI”?

Regulation like the EU’s AI Act (and even more strict) should be in effect worldwide. Corps have been running the show but naturally their focus is on monetisation rather than what their creations actually do.

Re: Family poisoned after using AI-generated mushroom identification book

#34

This was something that was bound to happen and is going to happen again unless we get more serious regulation around AI publishing. > It lists the author as having a Masters Degree in Mycology from University of East Ontario. A search later revealed there is no "University of East Ontario." This has got to be criminal negligence.

I’m not an AI apologist by any stretch, but how is this different from some incompetent person criminally-negligently assembling and publishing a book without AI help? Shouldn’t existing legislation already cover this? I’d also assume that most books will be written with AI help in some way or another in the future.

Re: Family poisoned after using AI-generated mushroom identification book

#35
post #25

This was something that was bound to happen and is going to happen again unless we get more serious regulation around AI publishing. > It lists the author as having a Masters Degree in Mycology from University of East Ontario. A search later revealed there is no "University of East Ontario." This has got to be criminal negligence.

Sounds more like a scam.

Why can't a scam be criminal negligence?

Re: Family poisoned after using AI-generated mushroom identification book

#36
post #13

This was something that was bound to happen and is going to happen again unless we get more serious regulation around AI publishing. > It lists the author as having a Masters Degree in Mycology from University of East Ontario. A search later revealed there is no "University of East Ontario." This has got to be criminal negligence.

What's good for the goose is good for the gander: the AI generated not only the contents but the author as well. This has to be some kind of a new level of idiocy. I mean, use AI to make junk sci-fi stories, and generate fake authors all day. But going for a book about mushrooms deserves a special stupidity and evilness award.

It probably could be automated to a point where there's no human even in the loop here: I wonder if books about mushroom identification are trending in Amazon UK sales lately, or something like that.

No excuse, obviously. But it could explain how whoever's running the scam could have run it off this cliff - probably others, too.

It's been a couple years since I bought even paper books off Amazon. Used should theoretically be closer to OK, but eBay sellers are cheaper and much more trustworthy.

Re: Family poisoned after using AI-generated mushroom identification book

#38
post #27
post #5

Earlier quoted context omitted.

The poster doesn’t claim they ate morels. The section about morels was an example for something unrelated to the poisoning.

The fact that these people claim mushroom poisoning but don't say what kind of mushrooms they were looking for makes you... more? less? willing to buy the story? They mentioned morels, which are sort of plausible (dates excepted) since false morels aren't going to kill you. What kind of mushroom would they be hunting in late July where their poisoning wouldn't be actually-newsworthy?

I really have no opinion here at all. I just wanted to point out that the fact that it’s no morel season in the UK is no evidence in either direction since the post doesn’t claim that the poisoning was due to morels.

I saw a comparable post the other day about an LLM proposing to mix garlic and oil in a way that would have produced a poisonous fluid, which the author recognized before trying. I found that story, and I find this one, at least plausible.

Re: Family poisoned after using AI-generated mushroom identification book

#40
Here's a more credible article about the general phenomenon (more so than an anonymous anecdote in "legal advice" Reddit, which is, by reputation, a place for amateur writers to hone their craft in a low-stakes environment).

https://www.washingtonpost.com/technology/2024/03/18/ai-mush... ("Using AI to spot edible mushrooms could kill you")

- "Like past mushroom identification apps, the accuracy is poor, Claypool found in a new report for Public Citizen, a nonprofit consumer advocacy organization. But AI companies and app stores are offering these apps anyway, often without clear disclosures about how often the tools are wrong."

- "Apple, Google, OpenAI and Microsoft didn’t respond to requests for comment."

Post reply on HN