Live data from Hacker News

Hacked billboards make Teslas see phantom objects causing them to swerve or stop

newsweek.com

51–60 of 264 posts

Re: Hacked billboards make Teslas see phantom objects causing them to swerve or stop

#51
post #20

This is clever, and Tesla's software is awful, but anyone doing this for real, with intent to divert cars from the road etc. would be committing a pretty serious crime.

The wonderful thing about IoT is the criminal can be on the other side of the world with no chance of any justice coming to them.

Not to mention, from TFA:

"They're also so fleeting that they're difficult for the human eye to detect, and leave behind very little evidence."

We've already got people who do things purely for the lulz (swatting, anybody) who could easily justify away these kinds of activities.

Re: Hacked billboards make Teslas see phantom objects causing them to swerve or stop

#52

There are many reasons why I dont believe in self driving cars, the first (and strongest) is to imagine that the software was written by my collegues (and myself).

I sort of find the idea of self-driving cars as ... selfish? Don't want to drive, take the bus. The idea that we all need our personal chariots (and now robotic chauffeurs) seems to me to be the height of irresponsibility. And, yes, I am guilty of owning a car myself and feel guilt about it. But for some reason the self-driving bit just seems to take it to another level for me. Maybe too there's an air of elitism abo…

> Don't want to drive, take the bus.

Self-driving “cars” include taxis (that's one of the prime motivating use cases), trucks (another big one), and busses (not as frequently talked about, but once the technology is there, it's going to get applied to them, as well.)

It's not just about individually-owned vehicles for people who want to own, but not drive, a personal vehicle.

Re: Hacked billboards make Teslas see phantom objects causing them to swerve or stop

#53

Earlier quoted context omitted.

The wonderful thing about IoT is the criminal can be on the other side of the world with no chance of any justice coming to them.

Not to mention, from TFA: "They're also so fleeting that they're difficult for the human eye to detect, and leave behind very little evidence." We've already got people who do things purely for the lulz (swatting, anybody) who could easily justify away these kinds of activities.

Both good points - so this kind of crime would likely be indistinguishable from a random, terrifying software failure, with the blame falling on the car maker.

Re: Hacked billboards make Teslas see phantom objects causing them to swerve or stop

#54

Earlier quoted context omitted.

LIDAR maps out the world around you in three dimensions, so with that data, there's no way it would mistake "a 'Stop' sign hidden within a fast food commercial [...] only flashing on-screen for a fraction of a second" (article) for an actual stop sign

Well it probably would stop working if you confuse it with a whole bunch of confetti of reflective material or similar. Although I suppose that would work against humans as well. Still I wonder if it has failure modes that humans lack, which could result in situations where it does inexplicable things.

> Still I wonder if it has failure modes that humans lack

Almost certainly :)

Re: Hacked billboards make Teslas see phantom objects causing them to swerve or stop

#55
post #12

Earlier quoted context omitted.

I'd stop in most of those situations. Except for the bogus painted lines -- I'd see that they were trying to direct me into oncoming traffic and respond accordingly. The panel van (or drone) attack is highly targeted, and doesn't stick around like paint does. These aren't just "ridiculous what ifs," they're a rather plausible method for freshly unemployed Luddites.

Do you see anyone going around with a massive LED array on the back of their trucks to blind (targeted) human drivers? Because that's even easier than floating around a panel with a specially crafted video feed. Yet I've never heard someone do it. Sure, leading a self-driving car astray is more of an accomplishment than blinding a human, but comparing crimes by how entertaining they are to a bored unemployed DIY soci…

The massive LED array is on the front of their trucks, blinding the shit out of oncoming traffic.

Re: Hacked billboards make Teslas see phantom objects causing them to swerve or stop

#56
post #12

Earlier quoted context omitted.

I'd stop in most of those situations. Except for the bogus painted lines -- I'd see that they were trying to direct me into oncoming traffic and respond accordingly. The panel van (or drone) attack is highly targeted, and doesn't stick around like paint does. These aren't just "ridiculous what ifs," they're a rather plausible method for freshly unemployed Luddites.

Do you see anyone going around with a massive LED array on the back of their trucks to blind (targeted) human drivers? Because that's even easier than floating around a panel with a specially crafted video feed. Yet I've never heard someone do it. Sure, leading a self-driving car astray is more of an accomplishment than blinding a human, but comparing crimes by how entertaining they are to a bored unemployed DIY soci…

[deleted]

Re: Hacked billboards make Teslas see phantom objects causing them to swerve or stop

#57
post #12

Earlier quoted context omitted.

I'd stop in most of those situations. Except for the bogus painted lines -- I'd see that they were trying to direct me into oncoming traffic and respond accordingly. The panel van (or drone) attack is highly targeted, and doesn't stick around like paint does. These aren't just "ridiculous what ifs," they're a rather plausible method for freshly unemployed Luddites.

Do you see anyone going around with a massive LED array on the back of their trucks to blind (targeted) human drivers? Because that's even easier than floating around a panel with a specially crafted video feed. Yet I've never heard someone do it. Sure, leading a self-driving car astray is more of an accomplishment than blinding a human, but comparing crimes by how entertaining they are to a bored unemployed DIY soci…

[deleted]

Re: Hacked billboards make Teslas see phantom objects causing them to swerve or stop

#58

Why don't we build some experimental infrastructure that is designed specifically for self driving vehicles?

A number of dedicated test facilities for autonomous vehicles exist, some operated by universities, some by government agencies, and some of the autonomous vehicle vendors own their own (more common for those aligned with major automakers which generally already have large proving grounds, but Uber apparently has a small one). I think the issue is that a dedicated test area will just never reflect the full set of pro…

For those who are curious, Virginia Tech has had a test road for 20 years: https://www.vtti.vt.edu/facilities/virginia-smart-roads.html

Re: Hacked billboards make Teslas see phantom objects causing them to swerve or stop

#59
post #20

This is clever, and Tesla's software is awful, but anyone doing this for real, with intent to divert cars from the road etc. would be committing a pretty serious crime.

The wonderful thing about IoT is the criminal can be on the other side of the world with no chance of any justice coming to them.

How long until someone claims one of these images designed to cause trouble for AIs is free speech? And are they right?

Re: Hacked billboards make Teslas see phantom objects causing them to swerve or stop

#60
post #3
post #2

States just need to start mandating LIDAR for any level of autonomous certification, in the same way we finally figured out seatbelts were the minimum level of safety for passenger retention.

Mandating how a certain outcome should be achieved generally is not the best (efficient, quickest, cheapest, etc.) way in getting to that outcome. Autonomous certification should have its safety requirements for each level and require the vehicles meet that standard. Autonomous vehicles have the potential to reduce deaths and injuries dramatically and increasing the time to get there will cause thousands to millions…

This isn't necessarily that strict of a regulation. They could require the sensor be on board but not actually regulate any of its usage. It could be a scenario like the Model 3's rear view mirror camera, where it wasn't used at all for the first two or so years and then later got a software update that started interacting with it. The important part is that the LIDAR unit is physically wired in to the system so that they can start using it in software whenever they feel like it's necessary.
Post reply on HN