Live data from Hacker News

Amazon device recorded private conversation, sent it out to random contact

kiro7.com

291–300 of 734 posts

Re: Amazon device recorded private conversation, sent it out to random contact

#291

Earlier quoted context omitted.

> There's no way a team would get the "ok" to build a skill that randomly records private conversations then sends them to a random contact. And then builds exactly that...

Yeah, the skill may not be (and I'm sure it wasn't) intended to that, but it did, in fact, do it. Intentions don't really matter after the fact. It's a mistake, but it's a pretty bad one.

What if mistake was that the recordings were sent to one of the contacts and not to some agency?

Re: Amazon device recorded private conversation, sent it out to random contact

#292

> But Danielle is hoping Amazon gives her a refund for her devices, which she said their representatives have been unwilling to do. Based on Amazon's admission and apologies, I'd think they'd be willing to give a lot more than just a refund. Seems like a huge liability for them.

That is not like Amazon. Typically their customer support is almost unreasonably good. I've gotten refunds and perks without even asking for them on support calls.

Re: Amazon device recorded private conversation, sent it out to random contact

#293

Earlier quoted context omitted.

One reason you might want a server is to have more expressive power than "if someone literally enters the room, turn on the lights". You might want to turn on the lights and run the AC a little before you predict people will arrive, for example.

> One reason you might want a server is to have more expressive power than "if someone literally enters the room, turn on the lights". You might want to turn on the lights and run the AC a little before you predict people will arrive, for example. Maybe, but that seems like a lot of work for little gain. You probably don't actually have that much control over the AC in your rooms unless you have zoned heating and a l…

> Intent is a very important factor when answering the question "should the lights be one," I don't think you'll be able to predict that. For instance: if movement is detected in the bedroom at 2AM, should the lights come on? The answer is: a very strong maybe.

You would be collecting data from many sources in order to predict intent. This is why you need a centralized server.

Re: Amazon device recorded private conversation, sent it out to random contact

#294

I have this idea of a system I would like to have in my house. It contains cameras in every room that are constantly watching where people are and relaying the coordinates to a central server. That server makes decisions on if lights should be on or if A/C should be running in that room. But I would never buy this system. I would have to make it myself. I am hopeful that open source software and hardware can produce…

The Personal Cloud is what we should be building for ourselves. Servers running in your closet at your house.

Any idiot who breaks into your home would be well positioned to steal your server along with all of your memories and use them for ransom/blackmail/etc.

Re: Amazon device recorded private conversation, sent it out to random contact

#295

I have this idea of a system I would like to have in my house. It contains cameras in every room that are constantly watching where people are and relaying the coordinates to a central server. That server makes decisions on if lights should be on or if A/C should be running in that room. But I would never buy this system. I would have to make it myself. I am hopeful that open source software and hardware can produce…

OpenCV + some kind of industrial controller could do this.

hackaday.com/blog/ will have some details on how people set up computer home controllers as well as working with OpenCV

Re: Amazon device recorded private conversation, sent it out to random contact

#296

This devices should by law always have a big LED on when recording, you would have the option to set it's brightness though. Also why could it send data out without any confirmation from the user.

You mean like the very visible colored LED ring that already exists on the devices? Though I suspect that most people keep their devices tucked away in a corner where they are hard to see -- but that's not amazon's fault -- few people would want the devices if they had a bright flashing strobe light visible anywhere the room.

A confirmation after every request makes the device a lot less useful, I suspect most people do not want the device to confirm commands before it does them.

Re: Amazon device recorded private conversation, sent it out to random contact

#297
I am oversimplifying here but:

* install device that is designed to listen to speech in the house

* the device is connected to internet

* the device is capable of contacting other internet peers/services/hosts

* the device knows a bit about its owner's internet presence such as contacts

* the device is equipped with simple conversational user interface based on fuzzy human speech-command detection

These basically bound the failure modes of the complete system. I am not surprised that a glitch like that happened. I can certainly attest to how shocking it might be to discover first hand that it really did happen, but given the context I can't say it's hard to not foresee something like this.

Re: Amazon device recorded private conversation, sent it out to random contact

#298

I have this idea of a system I would like to have in my house. It contains cameras in every room that are constantly watching where people are and relaying the coordinates to a central server. That server makes decisions on if lights should be on or if A/C should be running in that room. But I would never buy this system. I would have to make it myself. I am hopeful that open source software and hardware can produce…

There's a whole class of tech like this for me. An Alexa/Echo/etc, a fitness tracker with GPS and sleep monitoring, a maps program that learns my routine and integrates with a weather app, and so on. And ideally? All of it integrated. It actually sounds nice to say "I'm going home", and have Maps say "today that will take 35, should your oven start preheating when you're 20 minutes out?" IoT devices are overrated, bu…

Maps currently does do what you're saying - Google knows the time I'm going home and displays current traffic information and estimated time to arrive, at least for me.

Not yet preheating the oven though :)

Re: Amazon device recorded private conversation, sent it out to random contact

#299

Earlier quoted context omitted.

Not sure about Android phones with "Ok Google" but on iOS, all of Siri's voice processing is on the device. As opposed to Amazon Alexa which sends the data to the cloud for processing.

Siri does speech recognition on Apple’s servers, but commands are performed on the device. The server doesn’t know who you are.

If they have your voice, they can identify you regardless of metadata can't they?

Re: Amazon device recorded private conversation, sent it out to random contact

#300

I have this idea of a system I would like to have in my house. It contains cameras in every room that are constantly watching where people are and relaying the coordinates to a central server. That server makes decisions on if lights should be on or if A/C should be running in that room. But I would never buy this system. I would have to make it myself. I am hopeful that open source software and hardware can produce…

How to determine Presence is a very interesting topic.
Post reply on HN