Live data from Hacker News

Will your self-driving car be programmed to kill you?

uab.edu

21–30 of 76 posts

Re: Will your self-driving car be programmed to kill you?

#21
post #11
post #8

Earlier quoted context omitted.

/s, right?

If not officialy I'm sure there will be unofficial path to do this.

Yeah, but if we ever get driverless cars, you can bet on it that the log files will be detailed enough for really fine accident reconstruction. In other words, a "replay" could expose such hacking.

Re: Will your self-driving car be programmed to kill you?

#22
post #7

Earlier quoted context omitted.

So when humans mount horses and go into the woods to hunt as entertainment, they are not superior either?

op meant superior to us. we are relative superior to foxes - who hunt for necessity, superior to us might not hunt at all i agree btw i am not worried that a superior dreadful AI will come to kill humanity, but that some little half-assed AI in charge of some minor side activity will not be capable of understand context beyond it's own complexity.

Yeah, scope is important. It's like child vs adult, tool vs AI. You don't want to be in between, having too much control without understanding the consequences.

Re: Will your self-driving car be programmed to kill you?

#23
I (perhaps somewhat naively) assumed that a self-driving car would be programmed to prioritise the occupants of the vehicle (as that most closely emulates the likely reactions of a human driver in that situation).

Self-driving cars are likely to be safer than human drivers anyway, so one has to consider how much risk there is of a situation like the Trolley Problem arising - i.e. not much.

Re: Will your self-driving car be programmed to kill you?

#25
post #14

It's an interesting thought experiment, but I think a real situation with such a stark binary choice is so improbable that it's barely worth considering. Cars are not on trolley tracks and computers can brake or swerve harder and faster than any human could.

No matter how fast they break or swerve, it's not improbable that they might be in a situation where the computer has a choice - hit someone standing on the side of the road, or don't hit them,but potentially kill everyone on board of the vehicle. What should it do? Would anyone of us want to be the programmer who writes that code? Because I know that I definitely wouldn't want to be in charge of that.

Re: Will your self-driving car be programmed to kill you?

#26
post #8
post #5

hmm... perhaps "the default" should be programmed maximize human life as a headcount. But maybe they could sell a pricey "upgrade option" that would cause the computer to favor preserving the life of the driver as top priority. The proceeds from these upgrade options could then go into pay-outs for the families of people killed by drivers with this option enabled?

/s, right?

touché !

Re: Will your self-driving car be programmed to kill you?

#27

don't program it to swerve in any direction, brakes and tires should do the trick.

what if going straight will kill more people than swerving? You are driving in a turn, a tyre blows - a system which "gives up" and just applies the brakes as hard as it can allows the car to continue forward - maybe in a path of a school bus, maybe into a group of bystanders, maybe off a cliff. But if you allow it to turn,even a little - how do you know you are not injuring more people?

Re: Will your self-driving car be programmed to kill you?

#28
post #18

If people become aware enough of this, the answer is almost certainly that cars will choose the life of their passengers in any situation, unless manufacturers will agree not to compete on this.

you forgot that the government has final say, in everything.

Re: Will your self-driving car be programmed to kill you?

#29
post #23

I (perhaps somewhat naively) assumed that a self-driving car would be programmed to prioritise the occupants of the vehicle (as that most closely emulates the likely reactions of a human driver in that situation). Self-driving cars are likely to be safer than human drivers anyway, so one has to consider how much risk there is of a situation like the Trolley Problem arising - i.e. not much.

[deleted]

Re: Will your self-driving car be programmed to kill you?

#30
post #7

Earlier quoted context omitted.

So when humans mount horses and go into the woods to hunt as entertainment, they are not superior either?

Computer may have the same intelligence as human, but their fundamental inner drive will be completely different. Human like any other animal has a deep genetically programmed drive: survive and reproduce. Hunting as entertainment, for example, is actually practicing for survival - all hunting animals do that. This deep drive is the result of evolution. AI on the other hand has a completely different evolution proces…

I program my AI's for self replication and aggression
Post reply on HN