Live data from Hacker News

AI and Mass Spying

schneier.com

131–140 of 349 posts

Re: AI and Mass Spying

#132

The new Google, Meta, Microsoft, etc. bots won't just crawl the web or social networks--they will crawl specific topics and people. Lots of cultures have the concept of a "guardian angel" or "ancestral spirits" that watch over the lives of their descendants. In the not-so-distant technofedualist future you'll have a "personal assistant bot" provided by a large corporation that will "help" you by answering questions,…

Poetic as this is, I always feel like if we can imagine it then it won't happen. The only constant is surprise, we can only predict these types of developments accidentally

Re: AI and Mass Spying

#134
post #21

Never in the history of humanity has such powerful privacy tech existed for anyone who wants to use it. Using common off the shelf, open source, heavily audited tools, it's trivial today, even for a non-technical 10 year old, to create a new identity and collaborate with anyone anywhere in the world. They can do research, get paid, make payments, and contribute to private communities in such a way that no existing su…

I think "trivial" is a stretch.

[deleted]

Re: AI and Mass Spying

#137
post #72

I don't know why this isn't being discussed more. The reality of the surveillance state is that the sheer amount of data couldn't realistically be monitored - AI very directly solves this problem by summarizing complex data. This, IMO, is the real danger of AI, at least in the short term - not a planet of paperclips, not a moral misalignment, not a media landscape bereft of creativity - but rather a tool for targetin…

At least for me, this is what I've considered as the mass surveillance threat model the entire time - both for government and corporate surveillance. I've never thought some tie-wearing deskizen was going to be particularly interested in me for "arrest", selling more crap, cancelling my insurance policies, etc. I've considered such discrete anthropomorphic narratives as red herrings used for coping (similar to how "I have nothing to hide" posits some focus on a few specific things, rather than big brother sitting on your shoulder continuously judging you in general). Rather I've always thought of the threat actor as algorithmic mass analytics performed at scale, either contemporarily or post-hoc on all the stored data silos, with resulting pressure applied gradually in subtle ways.

Re: AI and Mass Spying

#138
post #69

Earlier quoted context omitted.

Yea this is a good point. If justice is executed by systems, rather than people (the end result from this scenario), we have lost the ability to challenge the process or the people involved in so many ways. It will make challenging how the law is executed almost impossible because there will be no person there to hold responsible.

I think that’s a good reason to question whether this would be due process. Why do we have due process? One key reason is that it gives people the opportunity to be heard. One could argue that being heard by an AI is no different from being heard by a human, just more efficient. But why do people want the opportunity to be heard? It’s partly the obvious, to have a chance to defend oneself against unjust exercises of…

"it doesn't make people feel heard" isn't a real emotion, it includes a judgement about the AI. According to "Nonviolent Communication" p235; "unheard" speaks towards the feelings "sad, hostile, frustrated" and the needs "understanding" & "consideration". Everyone agrees AI would be more efficient, but people are concerned that the AI will not be able to make contextual considerations based on a shared understanding of what it's like to live a human life.

Re: AI and Mass Spying

#139
post #42

I think another aspect of this is mass criminal law enforcement enabled by AI. Many of our criminal laws are written with the implicit assumption that it takes resources to investigate and prosecute a crime, and that this will limit the effective scope of the law. Prosecutorial discretion. Putting aside for the moment the (very serious) injustice that comes with the inequitable use of prosecutorial discretion, let's…

> " Heck, jaywalking tickets given out as though by speed camera. " This has been a thing since 2017: https://futurism.com/facial-recognition-china-social-credit - "Since April 2017, this city in China's Guangdong province has deployed a rather intense technique to deter jaywalking. Anyone who crosses against the light will find their face, name, and part of their government ID number displayed on a large LED screen…

There are lots of false positives too, like this case where a woman who’s face appeared in a printed advertisement on the side of a bus was flagged for jaywalking. https://www.engadget.com/2018-11-22-chinese-facial-recogniti...

Re: AI and Mass Spying

#140
post #42

I think another aspect of this is mass criminal law enforcement enabled by AI. Many of our criminal laws are written with the implicit assumption that it takes resources to investigate and prosecute a crime, and that this will limit the effective scope of the law. Prosecutorial discretion. Putting aside for the moment the (very serious) injustice that comes with the inequitable use of prosecutorial discretion, let's…

The whole automation and overzealous less leeway/common sense interpretations have as we have seen, many an automated traffic/parking ticket come into question.

Applying that to many walks of life, say farming, could well see chaos and a whole new interpretation to the song "Old McDonald had a farm, AI AI oh", it's gone as McDonald is in jail for numerous permit, environmental and agricultural regulations that saw produce cross state lines deeming it more serious a crime as he got buried in automated red-tape.

Post reply on HN