Live data from Hacker News

AI and Mass Spying

schneier.com

61–70 of 349 posts

Re: AI and Mass Spying

#61

The new Google, Meta, Microsoft, etc. bots won't just crawl the web or social networks--they will crawl specific topics and people. Lots of cultures have the concept of a "guardian angel" or "ancestral spirits" that watch over the lives of their descendants. In the not-so-distant technofedualist future you'll have a "personal assistant bot" provided by a large corporation that will "help" you by answering questions,…

You're just describing TikTok/Youtube algorithm.

Re: AI and Mass Spying

#62
post #42

I think another aspect of this is mass criminal law enforcement enabled by AI. Many of our criminal laws are written with the implicit assumption that it takes resources to investigate and prosecute a crime, and that this will limit the effective scope of the law. Prosecutorial discretion. Putting aside for the moment the (very serious) injustice that comes with the inequitable use of prosecutorial discretion, let's…

Yea this is a good point. If justice is executed by systems, rather than people (the end result from this scenario), we have lost the ability to challenge the process or the people involved in so many ways. It will make challenging how the law is executed almost impossible because there will be no person there to hold responsible.

Re: AI and Mass Spying

#63
Schneier is wrong that "hey google" is always listening. Google does on-device processing with dedicated hardware for the wake-words and only then forwards audio upstream. Believe it or not, the privacy people at Google really do try to do the right things. They don't always succeed, but they did with our hardware and wake-word listening.

Am Google employee, not in hardware.

Re: AI and Mass Spying

#64
I have a friend that is working as a contractor building AI-powered workplace spying software for the explicit purpose of behavior manipulation. It gives the employees and employers feedback reports about their behavior over chat and video. For example, if they used microaggressions, misgendered someone, or said something crass. This same friend will then talk about the dangers of dystopian technology.

People don't know what they're creating. Maybe it's time it bites them.

Re: AI and Mass Spying

#65
post #42

I think another aspect of this is mass criminal law enforcement enabled by AI. Many of our criminal laws are written with the implicit assumption that it takes resources to investigate and prosecute a crime, and that this will limit the effective scope of the law. Prosecutorial discretion. Putting aside for the moment the (very serious) injustice that comes with the inequitable use of prosecutorial discretion, let's…

This is a good point, it reminds me of how VAR has come into football. Before VAR, there were fewer penalties awarded. Now that referees have an official camera they can rely on, they can enforce the rules exactly as written, and it changes the game.

Re: AI and Mass Spying

#66
post #32

Time to decentralize everything. I think we are already in the early stages of this new trend. We can run AI locally and hard drives are so large we can have a local copy of an entire library, with millions of ebooks, in our own home now. That is in addition to generating our own energy off grid (so no smart meter data to monitor), thanks to the low cost of solar panels as well. Bye bye Big Brother.

I don't see how that leads to the reduction of the problem, though. Governments and corporations will still use AI for the things they want to use AI for.

Re: AI and Mass Spying

#67
post #43

Earlier quoted context omitted.

> Never in the history of humanity has such powerful privacy tech existed for anyone who wants to use it. True. > it's trivial today, even for a non-technical 10 year old Not even close. It's difficult even for a technical 30 year old. You're talking about acquiring cash that has passed through several people's hands without touching an ATM that recorded its serial numbers. Using it to acquire Bitcoin from a stranger…

Also stylometric analysis of your writing can be used to identify you.

This is one thing AI really can help with: rewriting what you wrote in order to make stylometric analysis worthless.

Re: AI and Mass Spying

#68

It's already happening. See this DHS memo issues on August 8th - page 3. https://www.dhs.gov/sites/default/files/2023-09/23_0913_mgmt... Fortunately the DHS has put together an expert team of non-partisan, honest, Americans to spearhead the effort to protect our democracy. Thank you James Clapper and John Brennan- for stepping up to the task. https://www.dhs.gov/news/2023/09/19/secretary-mayorkas-annou... And just in…

That James Clapper and John Brennan continue to be lauded by the media and their sycophants in government is one of the most disappointing things to happen in my lifetime. Both should be frog marched straight to prison along with their enablers.

Re: AI and Mass Spying

#69
post #42

I think another aspect of this is mass criminal law enforcement enabled by AI. Many of our criminal laws are written with the implicit assumption that it takes resources to investigate and prosecute a crime, and that this will limit the effective scope of the law. Prosecutorial discretion. Putting aside for the moment the (very serious) injustice that comes with the inequitable use of prosecutorial discretion, let's…

Yea this is a good point. If justice is executed by systems, rather than people (the end result from this scenario), we have lost the ability to challenge the process or the people involved in so many ways. It will make challenging how the law is executed almost impossible because there will be no person there to hold responsible.

I think that’s a good reason to question whether this would be due process.

Why do we have due process? One key reason is that it gives people the opportunity to be heard. One could argue that being heard by an AI is no different from being heard by a human, just more efficient.

But why do people want the opportunity to be heard? It’s partly the obvious, to have a chance to defend oneself against unjust exercises of power, and of course against simple error. But it’s also so that one can feel heard and not powerless. If the exercise of justice requires either brutal force or broad consent, giving people the feeling of being heard and able to defend themselves encourages broad consent.

Being heard by an AI then has a brutal defect, it doesn’t make people feel heard. A big part of this may come from the idea that an AI cannot be held accountable if it is wrong or if it is acting unfairly.

Justice, then, becomes a force of nature. I think we like to pretend justice is a force of nature anyway, but it’s really not. It’s man-made.

Re: AI and Mass Spying

#70
post #42

I think another aspect of this is mass criminal law enforcement enabled by AI. Many of our criminal laws are written with the implicit assumption that it takes resources to investigate and prosecute a crime, and that this will limit the effective scope of the law. Prosecutorial discretion. Putting aside for the moment the (very serious) injustice that comes with the inequitable use of prosecutorial discretion, let's…

>Suddenly, an AI monitoring public activity can trigger an AI investigator to draft a warrant to be signed by an AI judge to approve the warrant and draft an opinion.

Or the AI just sends a text message to all the cops in the area saying "this person has committed a crime". Like this case where cameras read license plates, check to see if the car is stolen, and then text nearby cops. At least when it works and doesn't flag innocent people like in the below case:

https://www.youtube.com/watch?v=GUvZlEg8c8c

Post reply on HN