Live data from Hacker News

Amazon device recorded private conversation, sent it out to random contact

kiro7.com

481–490 of 734 posts

Re: Amazon device recorded private conversation, sent it out to random contact

#481
post #297

I am oversimplifying here but: * install device that is designed to listen to speech in the house * the device is connected to internet * the device is capable of contacting other internet peers/services/hosts * the device knows a bit about its owner's internet presence such as contacts * the device is equipped with simple conversational user interface based on fuzzy human speech-command detection These basically bou…

Every time my wife says to me, "Are you serious?" Her iPhone chirps up with something like, "Yes, I am Siri."

Somehow it hasn't broken her (my wife) of the habit yet.

Re: Amazon device recorded private conversation, sent it out to random contact

#482
The exact same thing happened with Ok Google a year ago, and I will repeat the same thing again for those who are able to hear. This happened due to a bug, except not the way you would think. The only bug was that the recording was sent to an anonymous user instead of the Amazon HQ. Don't trust them.

Re: Amazon device recorded private conversation, sent it out to random contact

#483

Earlier quoted context omitted.

There’s a Mozilla project for everything https://hacks.mozilla.org/2018/02/how-to-build-your-own-priv... (voice is experimental and I don’t know if it’s on device) Looks cool, but I haven’t tried. I’m the kind of person that gets up and walks to the light switch.

There's Mycroft too: https://mycroft.ai/ We have a lot of alternatives but they are unable to get the sort of marketing and hence the attention mainstream devices like Alexa and Google Home do

In fairness ( I'm Mycroft's CEO ) our product isn't on par with Assistant or Alexa....yet. We've had to do a ton of work around wakeword detection, natural language understanding, device management, skills management, user management, credential management and speech synthesis BEFORE we've had a chance to work on the user experience.

That said....we are on track to have a high quality experience when we go to production in Feb 2019 ( Release 19.02 ). As an open source community we'd welcome any help folks have to offer. Contributors don't even need to know how to code, all they need to be able to do is listen to sound samples at https://home.mycroft.ai and tag them as "Hey, Mycroft" or not "Hey, Mycroft"

Thanks to everyone who is helping make Mycroft a reality!

Re: Amazon device recorded private conversation, sent it out to random contact

#484
post #352

Earlier quoted context omitted.

My friend installed IBM OS/2 WARP beta when it came out, it too was voice controlled. We would shout into his room, "select all, delete" or "format c" or other childish fun commands.

Humans are terrible. When the computers take over.... I won't be happy about it, but I'll kinda understand.

Just shout "self-destruct" all the time and we'll be fine.

Re: Amazon device recorded private conversation, sent it out to random contact

#485

Earlier quoted context omitted.

I can't pick up my coworker's phone and manually dial a number, because years of learning from our mistakes have led us to implement lock screens and such. I can, however, say "Hey Siri, call 867-5309." Or "Hey Siri, Facebook status: my anus is bleeding. SEND!" Because we are apparently incapable of applying past lessons to new technologies.

Hm. I can't "Hey Siri" someone else' phone, can I? It's certainly never worked for me.

To my knowledge, “Hey Siri” has never been tied to the owner’s voice. I was able to post to a colleague’s Facebook account a couple years ago, using nothing but voice commands. It was sitting on his desk, locked. I haven’t tried it since, and I keep it disabled on my own phone.

Re: Amazon device recorded private conversation, sent it out to random contact

#487
I recall a few weeks ago how some researchers figured out that the voice-commands could be triggered with subliminal messages, too. i.e., you wouldn't have to go 'Ok Google', but rather just play a fingerprint of that sound that makes the algorithm think you said that, without it being audible or understandable to human beings. And you could hide it in other audio like music.

That feels pretty scary particularly because these devices have such a high mandate. Right now you can shop for things online by voice command. Record and send messages. What's next, sending money, sending a data dump of sensitive data like emails, passwords, contact lists?

We've already heard of some reports where you'd have a smart home device listen to a commercial on television where they were demo'ing a purchase of some product via such a device, and interpret it as a command from the owner. Amazon took steps to avoid that with their superbowl commercial, but it seems to have done so by changing the commercial, not the product itself.

Just another attack vector to worry about. I'd happily buy these home speakers if I could limit them to just downloading information, and only uploading limited pieces of information, e.g. a music playlist. I'd want to be able to shut off any of the commercial/financial or social capabilities. I just don't care about them and they're risky.

Re: Amazon device recorded private conversation, sent it out to random contact

#489
post #297

I am oversimplifying here but: * install device that is designed to listen to speech in the house * the device is connected to internet * the device is capable of contacting other internet peers/services/hosts * the device knows a bit about its owner's internet presence such as contacts * the device is equipped with simple conversational user interface based on fuzzy human speech-command detection These basically bou…

Every time my wife says to me, "Are you serious?" Her iPhone chirps up with something like, "Yes, I am Siri." Somehow it hasn't broken her (my wife) of the habit yet.

To be fair it hasn't taught you not to say such astonishing things either!

Re: Amazon device recorded private conversation, sent it out to random contact

#490
post #442

Earlier quoted context omitted.

Maps currently does do what you're saying - Google knows the time I'm going home and displays current traffic information and estimated time to arrive, at least for me. Not yet preheating the oven though :)

Same. But it gets such obvious things wrong. Instead of "traffic to [daycare center] is light" it says "traffic to [some weird company name probably registered in the same building] is light". Waze also knows where I'm going in advance and most of the time it gets it right, like every Thu evening "are you heading to [evening school] ?". My weekly schedule is exactly the same 99% of the time but sometimes it still mak…

The bizarre thing is that Waze is owned by Google. People speculate they haven't merged information due to regulatory reasons.
Post reply on HN