Earlier quoted context omitted.
I think that people wind up worried about the wrong thing on these systems. The worst case scenario, where some all-knowing system negatively impacts you because it's rating your behavior on some opaque scale, isn't the one we should be worried about. That by itself is scary enough, but the much more likely case is the one where this system is rating you based on wrong information , and given Finagle's law.. Especial…
The justice system has built into it the requirement to justify allegations against you though. By design everything in the justice system is transparent or its not admissible. So an opaque "score" of any sort wouldn't ever be acceptable evidence.
Data isn't just being collected from your phone, it's being used to score you
31–40 of 165 posts
Re: Data isn't just being collected from your phone, it's being used to score you
#32Earlier quoted context omitted.
There's a very good reason why organizations should be allowed to keep "fool me once/twice/thrice" records: it's what enables them to be nice to customers who don't abuse that niceness. But there's no process to appeal and the data might be laughably wrong. Outlawing cross-organizational aggregation might be a reasonable middle ground. It gives a further advantage to giants like Amazon, but all the problems compound…
In 2006, I spent some time in the hospital after a bike accident. Someone who shared my recovery room was an guy with kidney failure & an extremely poor attitude. I learned he was running out of places to get dialysis because he kept treating the staff poorly & getting kicked out of the dialysis centers. Imagine having some poor newly hired receptionist trying to help this near death, abusive asshole & reading a note…
Re: Data isn't just being collected from your phone, it's being used to score you
#33Earlier quoted context omitted.
No need to disclose anything: plausible deniability is enough. And "bias" can be fixed by ad-hoc quotas.
Why wouldn't an HR person or hiring staffer immediately out the company or even sue them?
Re: Data isn't just being collected from your phone, it's being used to score you
#34People are complex. If some piece of code is used to predict my employability based on my facial expressions, there's not much to add. It's already as bad as it gets: you can't say/write anything non vanilla in public because 10 years later some HR snooping app will analyze the sentiment on the post and outright reject you. And we all kind of blindly walking into this no questions asked.
It's already happening, now, unfortunately. All your tweets (posted & liked) etc analyzed and flagged for bad language, drug/alcohol mentions, bigotry etc. and a report generated for HR.
https://news.ycombinator.com/item?id=22211363
The company in question is used by Sterling and HireRight, so this isn't some unknown/niche company.
Re: Data isn't just being collected from your phone, it's being used to score you
#35Re: Data isn't just being collected from your phone, it's being used to score you
#36Re: Data isn't just being collected from your phone, it's being used to score you
#37Re: Data isn't just being collected from your phone, it's being used to score you
#38A central premise of this article is not correct. If an employer, for example, is using tens of thousands of background data points to deny employment to a person, the employer would need to disclose that to the applicant.[1]. If the things in this article are secret then the law may well be violated. Also, not really the best idea to apply secret proprietary algorithms to these kinds of decisions because you're even…
You only have to disprove that if the applicant can first show the existence of bias, which with a secret proprietary algo that they don't have access to either the inputs or outputs of or know exists, is pretty hard to do.
Re: Data isn't just being collected from your phone, it's being used to score you
#39I feel like the Chinese style social score system won't have enough support in government for most countries, but we'll receive a decentralized version anyway through corporate overreach. Also, it's always amusing to arrive at an article about data collection and be greeted by this: https://i.imgur.com/d4Z4sdd.png
It's only a tiny leap to incorporate a similar magic number some company comes up with. Actually due to competition, if it correlates to risk, all companies will literally be forced to use the magic numbers or go into an adverse selection death spiral.
Unless there is regulation against it, like in CA. Not all regulation is bad.
Re: Data isn't just being collected from your phone, it's being used to score you
#40I feel like the Chinese style social score system won't have enough support in government for most countries, but we'll receive a decentralized version anyway through corporate overreach. Also, it's always amusing to arrive at an article about data collection and be greeted by this: https://i.imgur.com/d4Z4sdd.png
There were a few similar programs a few years ago when federal grants were made available. Iirc, they were modeled on the stuff built to identify people vulnerable to becoming extremist terrorist types. Insurance companies have databases of way more lifestyle and other behavior data than people realize. (Everything from sports, politics, to porn and gambling habits — anything for sale) I’m pretty sure Georgia mashed that against Medicaid claim data to build the model.
It’s a reason why we all need to watch “pre-existing condition” debates closely. If insurers know that 45 year old divorced father of 3 who moves every 3 months is a smoker, gambler and drinker, they don’t want to write a policy — the guy is a trainwreck with no support system.