I’m genuinely concerned about data privacy, but I’m kinda surprised about the outcry about all of this. I guess it’s relatively common knowledge for hacker news readers that all of these systems need to have human intervention to improve, but I feel like all this could have been avoided by just explaining that this was how the service was able to improve... I’m sure more steps could be taken to anonymise data from th…
It is not at all a given that machine learning systems need covert review of user data. The training data can come from paid users or explicitly opted in users. Do not normalize this behavior, it is not normal, OK, or required.
Apple suspends Siri response grading in response to privacy concerns
41–50 of 227 posts
Re: Apple suspends Siri response grading in response to privacy concerns
#42So far, most of the comments here are a good example of both why this happened and why it will happen again. When people complained that putting microphones in your home 24/7 was creepy, the response was "that's nonsense, Siri is not sending anything unless you specifically ask for it". When it turned out that it does send things you didn't intend, the response was "well, it's not like anyone is listening anyway". No…
In my opinion it's only now which they see that they can capitalize on this misunderstanding that tech journalists are portraying the situation like nobody knew and this was some kind of big secret. Why didn't they make such a big fuss in the first place, when these technologies came out?
Maybe it was wrong to not highlight those issues right from the start but I think it's also wrong to act like nobody knew. It was well understood, but tech journalists at the time wanted a positive story instead of a negative one. Now the negative angle is more profitable and the tune has changed.
Re: Apple suspends Siri response grading in response to privacy concerns
#43So far, most of the comments here are a good example of both why this happened and why it will happen again. When people complained that putting microphones in your home 24/7 was creepy, the response was "that's nonsense, Siri is not sending anything unless you specifically ask for it". When it turned out that it does send things you didn't intend, the response was "well, it's not like anyone is listening anyway". No…
Re: Apple suspends Siri response grading in response to privacy concerns
#44People have really bad intuitions around privacy. The predominant mental model is that there is a single, motivated adversary who is uniquely interested in attacking them. In reality, privacy almost always involves large, impersonal systems ingesting masses of data to either increase profits or commit crimes. It may sound bad that some random person is hearing your sex sounds but that person has heard a thousand othe…
Yes, you may not care about whose audio you're listening to. But someone might. They may not even know the person prior to listening to that audio and still pose a threat.
Stalking is an obvious problem. But what if they think they recognise a voice and then act on that information when they meet the person they (mis-)identified? Or in your sex noises scenario: sure, they may be anonymous to the listener, but so is revenge porn to most consumers of it: the ethical issue isn't whether they can be recognised but they lacked (or withdrew) consent.
People in tech generally seem to have an extremely hard time to grasp a basic premise: consent.
Consent must be given. Consent must be informed. Consent can be withdrawn at any time. Whether it's consent for physical interactions, social interactions or storing and processing my data -- and make no mistake, it is my data, even if I only shared it passively or explicitly gave you permission to use it.
This isn't about security. This isn't about intellectual property. This is entirely about consent.
Re: Apple suspends Siri response grading in response to privacy concerns
#45Earlier quoted context omitted.
Are people really using these assistants for anything more than making the device do something? Because in my experience Siri will set reminders, timers etc. just fine and will find the song you are listening just fine and will call someone just fine. The other stuff feels like a gimmick to me or more like stuff that some middle-level manager spawned to get a nice bonus. Using a voice assistant "AI" usually feels lik…
The day when you can just say “lights on, 50%” and the assistant in the next room understands you don’t mean it is when we will have the right amount of universal compatibility. Until we can derive decisions based on who is speaking and where they ”are” - I think it’ll always be clunky. “Hey Alexa tell Hue to set light scene livingroom to 80%” is cool that it exists for those who really need the solution but its not…
Why? Because they don't want to set off any so-called smart speakers.
I'd argue that going so low as to change the way we speak just to accommodate these devices is quite terrible, and if you have to watch what you say so that a smart speaker don't misunderstand you, then it's not very smart.
Their listeners shouldn't complain that their hosts use the word Alexa. They should complain to the vendors that their products are garbage.
I wouldn't use one of those even if they weren't garbage, but at least I wouldn't be infuriated every time I hear someone on the podcast stop themselves from saying the name of the product that's the topic of their discussion.
Re: Apple suspends Siri response grading in response to privacy concerns
#46Re: Apple suspends Siri response grading in response to privacy concerns
#47People have really bad intuitions around privacy. The predominant mental model is that there is a single, motivated adversary who is uniquely interested in attacking them. In reality, privacy almost always involves large, impersonal systems ingesting masses of data to either increase profits or commit crimes. It may sound bad that some random person is hearing your sex sounds but that person has heard a thousand othe…
My points are:
- while I might be an uninteresting target, this doesn’t mean others are not. Lawyers, Doctors, Jiurnalists, Activists and so on certainly are targets that are and will be spied on if it is easily possible for adverseries to get the data (e.g. without a real.court ruling etc). I profit from a society where these groups and their communications are protected. The chance that this can be used against these groups in form of kompromat for example is enough for privacy rules to exist.
- Privacy rules also try to counteract a inbalance of power. In the age of complexity those with more and better information have more and better power. “We are the good ones” or “But we would never do such a thing” are cute arguments, but ultimatively I want to live in a state where the accumulation of power by unelected forces is limited by design. When a company knoes all about you while they themselves tell you only the marketing version, there is a extreme inbalance in power that benefits them against you. In practice it would look a bit like the cambridge analytica thing where every individual saw only (fake) things that nudged them into one or the other direction by using facebooks targeted adverticement, but on a bigger scale it was targeted manipulation by false imformation. This is not only unethical, but potentially dangerous to the instable societies we live in.
- privacy is about marketing. The big californian giants are so good to make things simple for all of us. But when it comes to the question how much data they collect when, they cannot give a straight simple answer, but a wall of legalese that doesn’t tell anybody what’s going on. If you actively decept people by downplaying the potential impact of the privacy violations you profit from, that is unethical for sure.
That beeing said you can have the standpoint that making money is more important than a functioning society with trust between citizen and the companies they are customers of — but don’t be surprised when the accumulation of power and the erosion of democratic principles show devastating results. Tech companies do shape our future if they wan’t or not. The question is, if they do it by critically following up onto their good intentions, or by blindly giving in to their incentives?
Right now it looks like the latter.
Re: Apple suspends Siri response grading in response to privacy concerns
#48So far, most of the comments here are a good example of both why this happened and why it will happen again. When people complained that putting microphones in your home 24/7 was creepy, the response was "that's nonsense, Siri is not sending anything unless you specifically ask for it". When it turned out that it does send things you didn't intend, the response was "well, it's not like anyone is listening anyway". No…
The implications of what they agree to are impossible to understand, by design. They're crafted by lawyers to be as vague and all-encompassing as possible.
I actually read more than one story last year by some tech site claiming that no Siri data left your iphone at all. Even journalists who would love to stir up controversy have no idea what is going on.
Its impossible to understand what is happening on our locked-down mobile devices
Re: Apple suspends Siri response grading in response to privacy concerns
#49People have really bad intuitions around privacy. The predominant mental model is that there is a single, motivated adversary who is uniquely interested in attacking them. In reality, privacy almost always involves large, impersonal systems ingesting masses of data to either increase profits or commit crimes. It may sound bad that some random person is hearing your sex sounds but that person has heard a thousand othe…
> People have really bad intuitions around privacy. > Having worked at companies that collected that data [...] No, you just have a different personal definition of privacy. The fact that you think your use of my data is innocuous doesn't mean you are not violating my privacy. If your use was really, trully unobjectionable you'd be fine with getting clear and explicit consent. Somehow, I don't think an honest consent…
This ignores human nature: requiring people to make a decision, any decision, is a friction point that will lose users. Something like "we'd like to increment a counter when our app crashes, we won't log anything else than that single bit".
So first of all, you'll have people who will claim that you could be lying, and they'll opt out, or not install your app, or whatever. Fine. But now all the people who truly didn't and don't actually care will have to make a decision. And making choices takes effort. So some people will just refuse to make a choice, and you'll lose users.
Consider the other side of this: I'm from the US but currently in Europe. GDPR requires explicit consent for the various trackers, it has defaults. I don't change them. I don't want to think about them. I don't care enough. And it's just effort I have to expend before I actually get to the stuff I'm interested in. Like a government mandated paywall (think the "we use cookies..." but more extreme, with checkboxes to decide which cookies they can store).
Even as someone who truly actually doesn't care, and is happy to, in the abstract, give explicit consent to all the tracking these sites do, I don't want to have to explicitly consent, because its work to do something I don't care about.
I expect, though I'm by no means certain, that most people who aren't on HN are in that bucket. And that means that requiring explicit consent for otherwise innocuous things is just bad for business with little gain, and it numbs people for explicit consent on actually important things.
Re: Apple suspends Siri response grading in response to privacy concerns
#50People have really bad intuitions around privacy. The predominant mental model is that there is a single, motivated adversary who is uniquely interested in attacking them. In reality, privacy almost always involves large, impersonal systems ingesting masses of data to either increase profits or commit crimes. It may sound bad that some random person is hearing your sex sounds but that person has heard a thousand othe…
yes, in reality no-one cares about you and that might sting a bit. but it gives people a sense of importance when you tell them they’re spied upon.