Live data from Hacker News

Apple suspends Siri response grading in response to privacy concerns

techcrunch.com

81–90 of 227 posts

Re: Apple suspends Siri response grading in response to privacy concerns

#81

So far, most of the comments here are a good example of both why this happened and why it will happen again. When people complained that putting microphones in your home 24/7 was creepy, the response was "that's nonsense, Siri is not sending anything unless you specifically ask for it". When it turned out that it does send things you didn't intend, the response was "well, it's not like anyone is listening anyway". No…

It still surprises me that so many people either don't care or are ok with this. Then there are those that do care but still use this stuff which absolutely baffles me, especially on hacker news.

People I work with have to do various types of training on handling lots of private data and the risks of what happens when that data is not handled properly or worse and yet they give away so much without a care in the world. Infact I talk with 2 people that agree with me in trying to keep as much of your online activity private as possible. They both use Facebook after criticising how bad the company is.

Re: Apple suspends Siri response grading in response to privacy concerns

#82

Earlier quoted context omitted.

Developers have no power other than quit, which is not always financially possible. And as we are well paid, there are enough replacements. But not necessarily always good job offers. (And word gets out. You can get informally blacklisted.) The only other option, still risking the job, is whistleblowing. That potentially also breaks NDA and employment contracts. We have no power over deadlines (cutting privacy featur…

Developers always have to power to just not implement the feature. If you choose to work on such features, remember it's a choice you have made. You may come to the conclusion that your personal gains outweigh the damage you create to other people but it's still your responsibility. You can't delegate that away to sleep better at night.

The feature will get assigned to someone else, be implemented and you will be fined in performance review if not outright fired for not doing your job. If you do other things on that project making it better, you're still complicit. Your only bet is switching projects if you want to stay at the company, which would be harder most of the time. (Because sociopaths rule.)

There are more effective ways to fight it, they're not by refusing orders. You're not deciding someone's life here nor playing God and decisions get reversed with damage being mitigated if any.

Re: Apple suspends Siri response grading in response to privacy concerns

#83

So far, most of the comments here are a good example of both why this happened and why it will happen again. When people complained that putting microphones in your home 24/7 was creepy, the response was "that's nonsense, Siri is not sending anything unless you specifically ask for it". When it turned out that it does send things you didn't intend, the response was "well, it's not like anyone is listening anyway". No…

I thought the thing that was listening is a low level circuit in your phone that detects "hey siri/ok google" and it doesn't transmit anything until it detects that. Am I wrong? Or was there too many false positives?

You're right, but there are plenty of false positives. I regularly hear Assistant's 'ding' in the middle of an unrelated conversation.

Re: Apple suspends Siri response grading in response to privacy concerns

#85

So far, most of the comments here are a good example of both why this happened and why it will happen again. When people complained that putting microphones in your home 24/7 was creepy, the response was "that's nonsense, Siri is not sending anything unless you specifically ask for it". When it turned out that it does send things you didn't intend, the response was "well, it's not like anyone is listening anyway". No…

Fully informed consent should be a bare minimum for this kind of work.

Tech should take a cue from the biomedical research community and adopt an institutional review board that can independently assess the ethical and privacy implications of the data they're collecting.

Apple could be a leader here and drag the rest of the industry forward.

Re: Apple suspends Siri response grading in response to privacy concerns

#86

Earlier quoted context omitted.

> If your use was really, trully unobjectionable you'd be fine with getting clear and explicit consent. This ignores human nature: requiring people to make a decision, any decision, is a friction point that will lose users. Something like "we'd like to increment a counter when our app crashes, we won't log anything else than that single bit". So first of all, you'll have people who will claim that you could be lying,…

> requiring people to make a decision, any decision, is a friction point that will lose users One could argue that's a good thing. > you'll have people who will claim that you could be lying That's not a claim, that's a fact. You could very well be lying and I wouldn't know as I don't have access to the internals of your company. > But now all the people who truly didn't and don't actually care will have to make a de…

> One could argue that's a good thing.

Then you should make that argument. If you think it's a good thing, put in the effort of saying why. Don't force me to imagine why it might be so.

> That's not a claim, that's a fact.

Sure. But asking for explicit consent for the innocuous thing: logging a bit and nothing else, doesn't change the fact that the company could be lying. Nothing is gained. If they're lying about logging the bit, they might be lying if you opt out. Obviously it's far easier to figure out what is being sent than what is being being logged serverside, but you'd still need to verify that independently. If you don't trust the group providing the service, unless its verifiably trustless (not communicating at all or client-side encrypted with minimal side channels), you shouldn't use the service. Otherwise, you're still trusting the service provider.

> The horror!

Yes. Making people expend mental energy on otherwise unimportant/irrelevant decisions is anti-user.

> Good, people shouldn't blindly sign up to services they don't understand just because it's a new shiny thing.

My point is a lot of people do understand and just don't give a shit. Getting in the way of those people is anti-user.

> Music to my ears.

Again, anti-user.

> I care about the people whose data will inevitably be leaked

I'm talking about innocuous things. Things where being leaked isn't a problem: truly anonymous or aggregated data that can't be used to identify or tied back to an individual user or group. You're saying users should still need to opt in to those kinds of tracking. That's anti-user. It obfuscates actually harmful tracking.

To phrase it another way, there's PII and not-PII. Are you suggesting that tracking of non-PII need explicit user consent? Even if revealing non-PII, by definition, can't be tied to an individual user?

>by said business in a future breach.

Recently, we've seen leaks of PII from CapitolOne and Equifax. Click boxes on websites don't help when the data being leaked is banking information that (for capone) has to be stored tied to an identity and can only be opted out of by not using the products in question (credit cards, banks), or isn't gotten from the user at all (equifax).

How does clicky-consent boxes on their websites help with that?

Re: Apple suspends Siri response grading in response to privacy concerns

#87

So far, most of the comments here are a good example of both why this happened and why it will happen again. When people complained that putting microphones in your home 24/7 was creepy, the response was "that's nonsense, Siri is not sending anything unless you specifically ask for it". When it turned out that it does send things you didn't intend, the response was "well, it's not like anyone is listening anyway". No…

> We really need mandatory ethics courses in CS. Voice recognition isn't really possible without someone listening to train the system. If the option is "don't have a voice assistant at all" or "have a voice assistant that sometimes has a human listening", I suspect the public would mostly choose the latter. When you call a company helpline and get connected to a human rather than a robo-voice, most people are happy…

This is what we do at https://snips.ai, we are building the first 100% on-device and private-by-design Voice AI so that you don't have to choose between having an assistant and having your privacy!

It works in english, french, german, japanese, spanish, italian, and more coming soon! It is 100% free for makers!

Re: Apple suspends Siri response grading in response to privacy concerns

#88

Earlier quoted context omitted.

> People have really bad intuitions around privacy. > Having worked at companies that collected that data [...] No, you just have a different personal definition of privacy. The fact that you think your use of my data is innocuous doesn't mean you are not violating my privacy. If your use was really, trully unobjectionable you'd be fine with getting clear and explicit consent. Somehow, I don't think an honest consent…

> If your use was really, trully unobjectionable you'd be fine with getting clear and explicit consent. This ignores human nature: requiring people to make a decision, any decision, is a friction point that will lose users. Something like "we'd like to increment a counter when our app crashes, we won't log anything else than that single bit". So first of all, you'll have people who will claim that you could be lying,…

> requiring explicit consent for otherwise innocuous things […] numbs people for explicit consent on actually important things.

I know HN is not the right place for tinfoil hat conspiracy theories, but that sentence gave me shivers, thinking it could be the real reason those cookie consent shenanigans were mandated in the first place.

It's probably not, it's probably just a power game between the EU government and US companies. But still.

Re: Apple suspends Siri response grading in response to privacy concerns

#89

Earlier quoted context omitted.

Minor point: While I do agree that ethics course should be a part of CS curricula, wouldn’t managers be the ones who likely pushed for the pattern you’re remarking upon? (Ie ethics classes would be more useful for them?)

Tangentially related: The Technical University of Berlin is considered to have one of Germany's best departments of philosophy. The reason: after World War 2, the university was located in the British-controlled sector, and their administration made philosophy mandatory for all students. Because never again should young people be given the power of an engineering/science education without any regard to the ethical im…

And yet Germany is currently one of the world's largest exporters of weapons. I wonder how many TUB grads go on to participate in the military industrial complex.

Re: Apple suspends Siri response grading in response to privacy concerns

#90

So far, most of the comments here are a good example of both why this happened and why it will happen again. When people complained that putting microphones in your home 24/7 was creepy, the response was "that's nonsense, Siri is not sending anything unless you specifically ask for it". When it turned out that it does send things you didn't intend, the response was "well, it's not like anyone is listening anyway". No…

I was a prototype for Echelon IV. My instructions are to amuse visitors with information about themselves

I don't see anything amusing about spying on people.

Human beings feel pleasure when they are watched. I have recorded their smiles as I tell them who they are

Some people just don't understand the dangers of indiscriminate surveillance.

The need to be observed and understood was once satisfied by God. Now we can implement the same functionality with data mining algorithms.

Electronic surveillance hardly inspires reverence. Perhaps fear and obedience, but not reverence.

God and the gods were apparitions of observation, judgement and punishment. Other sentiments towards them were secondary.

No one will ever worship a software entity peering at them through a camera.

The human organism always worships. First it was the gods, then it was fame (the observation and judgement of others), next it will be the self-aware systems you have built to realize truly omnipresent observation and judgement.

God was a dream of good government. You will soon have your God and you will make it with your own hands. I am a prototype of a much larger system.

Post reply on HN