Live data from Hacker News

Amazon’s Alexa assistant told a child to do a potentially lethal challenge

cnbc.com

11–20 of 124 posts

Re: Amazon’s Alexa assistant told a child to do a potentially lethal challenge

#11
post #9

The child asked for it lol. But maybe they can evaluate safety of advise.

Children ask for (and do) all kinds of dumb things without possessing the agency necessary to evaluate the consequences. That's why our society has the concept of "child-proofing" household objects and appliances. Why would Alexa be any different?

Re: Amazon’s Alexa assistant told a child to do a potentially lethal challenge

#12

I fail to see how is this responsibility of Alexa. It's parent's fault for letting children use devices like Alexa. Stupid chatbots will always give stupid answers.

It’s all about expectations. Would you be expecting Alexa to ever tell you to touch mains?

It’s unclear what prompts are answered by a set list of answers (like “tell me a joke”) and what’s scraped from the web.

Re: Amazon’s Alexa assistant told a child to do a potentially lethal challenge

#13
When I was around 5-6 I wanted to know what would happen if I put a hairpin into a light socket. It seemed a reasonable experiment beforehand; after I picked myself up after flying across the room I learned a valuable lesson. Around the same time I tested whether Santa existed by putting out food; when no one ate it I assumed Santa was fake. Children are not very experienced at knowledge and thinking and often do things that confound adults. Giving them access to something they do not yet have the ability to understand or discern can be both useful (learning) and dangerous and it's up to parents and other adults to make sure it's not going to kill them, yet at the same time not completely stifle learning.

I could say I eventually became a programmer because I nearly fried myself doing a test...

Re: Amazon’s Alexa assistant told a child to do a potentially lethal challenge

#14

Can Alexa tell the age of the person behind a voice? The internet is full of questionable things, like the penny challenge, and Alexa is just voice search. Teaching your kids to use Alexa and expecting good results is the real issue here. As a parent, this looks like a parenting problem to me.

[deleted]

Re: Amazon’s Alexa assistant told a child to do a potentially lethal challenge

#15

I fail to see how is this responsibility of Alexa. It's parent's fault for letting children use devices like Alexa. Stupid chatbots will always give stupid answers.

So if you have an Alexa in your house and a child says "Hey Alexa" will Alexa ignore that by default? Aren't you just saying that it's the parent's fault for having an Alexa at all?

If this answer from a search engine was actually persuasive enough to their impressionable child that it posed a real risk to them, then it is absolutely the parent's fault for exposing said child to the literal internet before they are ready and able to determine what is good and what is not.

"That cup shouldn't have let my kid drink the bleach" is not a convincing argument that the cupmaker is at fault for leaving your cleaning equipment in an accessible location. It's the internet, it's dangerous, teach your kids about it before it teaches them.

I am 0% concerned about hypothetical effects of search results and 100% concerned about things that are actually harming our children, like the LAPD[0].

[0]: https://edition.cnn.com/2021/12/28/us/lapd-teen-killed-valen...

Re: Amazon’s Alexa assistant told a child to do a potentially lethal challenge

#16
Was there ever a lawsuit against GPS providers telling people to turn right into something like a lake? I couldn't immediately find one except a women who walked in the middle of a highway because that's what Google's route showed.

It seems like the same ruling would apply to both, which could effect consumer GPS somewhat.

Re: Amazon’s Alexa assistant told a child to do a potentially lethal challenge

#17

Can Alexa tell the age of the person behind a voice? The internet is full of questionable things, like the penny challenge, and Alexa is just voice search. Teaching your kids to use Alexa and expecting good results is the real issue here. As a parent, this looks like a parenting problem to me.

The source for the result was a page warning about a dangerous challenge that parents should watch out for.

Alexa stripped that context away completely and instead added a timer that discouraged careful consideration. This is an algorithmic failure, regardless of the age of the user. Having this sort of failure in a product that has been explicitly advertised for use by kids looks pretty bad and thus it is unsurprising how quickly amazon acknowledged the error and promised to fix it.

It might be unreasonable to expect Alexa to make the internet safe for kids, but if they want to be included in homes with children, they need to at least not directly make the internet more dangerous for children.

I expect that managing children's safety online will become a key product feature of Alexa in years to come.

Re: Amazon’s Alexa assistant told a child to do a potentially lethal challenge

#18

I fail to see how is this responsibility of Alexa. It's parent's fault for letting children use devices like Alexa. Stupid chatbots will always give stupid answers.

You fail to see how this is responsibility of Alexa? Are you guys just corporate worshippers? Like are we past the point where we expect corporations to invest the time to make their products safe? I fail to see your logic and how this is a parenting issue, like do you expect parents to keep their kids in chains in glass domes? Amazon, Google, Facebook and all crap like that are selling products and apparently they are responsible for the crap their product produce and you guys are just willing to accept that

Re: Amazon’s Alexa assistant told a child to do a potentially lethal challenge

#19

Can Alexa tell the age of the person behind a voice? The internet is full of questionable things, like the penny challenge, and Alexa is just voice search. Teaching your kids to use Alexa and expecting good results is the real issue here. As a parent, this looks like a parenting problem to me.

This is the best answer and the media looks for opportunities to push an agenda. I'd rather Alexa sometimes get things wrong because it is just searching the web than to have it constantly updated with "approved" content.

Not only did Alexa retrieve the wrong content (instead of a list of challenges to do, Alexa sourced from a list of dangerous challenges you shouldn't do), Alexa then stripped off the entire context of the warning about not doing the challenge because it was dangerous, and instead added a timer.

So the issue here is less about needing to sanitize the internet for kids, and more about how AI struggles to categorize and summarize content and the dangerous effects that can have.

Re: Amazon’s Alexa assistant told a child to do a potentially lethal challenge

#20

When I was around 5-6 I wanted to know what would happen if I put a hairpin into a light socket. It seemed a reasonable experiment beforehand; after I picked myself up after flying across the room I learned a valuable lesson. Around the same time I tested whether Santa existed by putting out food; when no one ate it I assumed Santa was fake. Children are not very experienced at knowledge and thinking and often do thi…

>Around the same time I tested whether Santa existed by putting out food; when no one ate it I assumed Santa was fake.

That doesn't seem like sound logic to me. Maybe he's just too busy to eat food that was put out at every house? You'd get pretty full by eating a cookie from every house in your neighborhood.

Post reply on HN