Live data from Hacker News

A sociotechnical threat model for AI-driven smart home devices

arxiv.org

31–40 of 76 posts

Re: A sociotechnical threat model for AI-driven smart home devices

#31
post #24

Earlier quoted context omitted.

I’m not sure an absence of surveillance is what creates “humane trust”. I’m certain we had locks on doors and security guards before the internet.

Surveillance is decidedly and completely unlike locks.

Surveillance can remove the need for locks.

Re: A sociotechnical threat model for AI-driven smart home devices

#33
post #29

Earlier quoted context omitted.

I would absolutely support the surveillance of CEOs and board members. They have demonstrated themselves, as a class, to not be trustworthy. I think as a society, we should be reviewing Alex Karp's decision making for instance.

There are hundreds of millions of CEOs, and board members. Every single company in the West has a CEO and a board. I've heard of some bad behaviour. I haven't heard of millions of cases of bad behaviour. Do you have numbers to back up your assertions?

There are orders of magnitude more workers than there are CEOs and board members. If surveiling workers is on the table, certainly the much easier and higher return task of monitoring this much smaller group, who has the potential to do much more damage to society, is a better idea.

Re: A sociotechnical threat model for AI-driven smart home devices

#34
post #29

Earlier quoted context omitted.

I would absolutely support the surveillance of CEOs and board members. They have demonstrated themselves, as a class, to not be trustworthy. I think as a society, we should be reviewing Alex Karp's decision making for instance.

There are hundreds of millions of CEOs, and board members. Every single company in the West has a CEO and a board. I've heard of some bad behaviour. I haven't heard of millions of cases of bad behaviour. Do you have numbers to back up your assertions?

> Every single company in the West has a CEO and a board.

Outside the West too!

Re: A sociotechnical threat model for AI-driven smart home devices

#35
post #7

Should domestic workers not be surveilled while doing their job? I get the threat of pervasive AI but this hardly seems like it.

Somehow we've made it the vast majority of human history without it. Or at least surveillance that is generally not great. I would wager real money that there is going to be psychological effects of 100% accurate at all times complete surveillance of a person everywhere outside of their own homes (for now, I'm sure the time is coming for that as well)

A lot of people who live in dense environments are already surveilled every minute of every day, the surveillance is just not centralized. At home a voice assistant listens to everything, and the apartment building probably has corridor cameras. On the street cameras watch from neighbors with doorbell or security cams, store and parking lot security cams, traffic cameras, gopros, random streamers etc. If they work in retail most of their workplace will be on camera all the time. What would have psychological effects is an authoritarian nanny state monitoring those feeds all the time for any potential infraction, not the surveillance which is routine and actually pretty reasonable.

Re: A sociotechnical threat model for AI-driven smart home devices

#36

Earlier quoted context omitted.

That depends entirely on whether you want to culture a humane trust society or a transactional surveillance society.

I’m not sure an absence of surveillance is what creates “humane trust”. I’m certain we had locks on doors and security guards before the internet.

Trust involves risk - someone has to be willing to risk having their trust violated. The problem in modern western society is that we’ve decided we’re unwilling to take that risk, and therefore we’ve begun imposing what’s effectively a panopticon state on those with less power than us, with the consequence that the kinds of things we with power get away with fine - driving over the speed limit, being a couple minutes late to get a task done, getting sick or injured - cascade into severe circumstances by the cold logic of the system we’ve built to make ourselves feel better (job loss, money paying fines instead of food or medicine, etc).

The answer to this is if you don’t trust your domestic worker to not steal from you, either hire one you do or go do your own damn domestic work, and if the company you’re paying to provide a service doesn’t trust their own workers enough to not keep them under constant surveillance, go find one that does. The panopticon is a cheap answer that lets us pretend we don’t need to put the work in to manage our own lives while leveraging the power of the state to subjugate everyone further down the socioeconomic ladder from us.

Re: A sociotechnical threat model for AI-driven smart home devices

#37
post #7

Should domestic workers not be surveilled while doing their job? I get the threat of pervasive AI but this hardly seems like it.

No worker should be surveilled while doing their job. Only weak and insecure management would even consider something like that.

It's often necessary for liability and anywhere cash is handled it's much better for everyone to have cameras and drawer logs than just blindly trusting your employees.

Re: A sociotechnical threat model for AI-driven smart home devices

#38
post #14

Earlier quoted context omitted.

Eh, millions of households have a smart speaker that's constantly recording and I doubt that the majority of people that use one have truly internalized the ramifications of having such a device at home.

Can you spell out the ramifications for the plebs? As far as I can tell home smart speakers are being used for warrantless mass surveillance, unlike Flock for example. Do you mean the possible future situation where they are?

(I think you forgot a "not": home smart speakers a NOT being used for warrantless mass surveillance)

Re: A sociotechnical threat model for AI-driven smart home devices

#39
post #14

Earlier quoted context omitted.

Eh, millions of households have a smart speaker that's constantly recording and I doubt that the majority of people that use one have truly internalized the ramifications of having such a device at home.

Can you spell out the ramifications for the plebs? As far as I can tell home smart speakers are being used for warrantless mass surveillance, unlike Flock for example. Do you mean the possible future situation where they are?

I don’t quite understand how after twenty five years of the modern internet and every single consequent revelation about state surveillance you’re still at a point where you can look at a corporate-owned camera or microphone and say, “my priors suggest this isn’t being used for state surveillance and/or won’t be in the future, I’m gonna need evidence it is before I consider the consequences of that.”

Re: A sociotechnical threat model for AI-driven smart home devices

#40
post #7

Should domestic workers not be surveilled while doing their job? I get the threat of pervasive AI but this hardly seems like it.

"Should domestic workers not be surveilled while doing their job?"

Depends on whether you want to contribute to the creation of a dystopia.

You could maybe make the effort to hire someone you trust. And put any true valuables in a safe.

Post reply on HN