Live data from Hacker News

AI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBC

bbc.com

21–30 of 136 posts

Re: AI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBC

#21
post #3

If you’re building something that is dangerous enough that it needs a kill switch in case it goes rogue, then you should delete it immediately. Or is it a lie?

Trains have had dead man switches since the beginning

Should we ban trains?

Re: AI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBC

#24
post #17

In 2001: A Space Odyssey, the hero defeats the hostile onboard computer by entering its logic core and manually disconnecting its memory modules. That's hard to do if the AI rack is in space as SpaceX is planning to do. You can't disconnect. You can't shoot it.

> You can't disconnect. You can't shoot it.

Yes you can shoot them. The US has had this capability for a long time. Anti satellite missiles exist and they can be launched from an F-15 at it's highest altitude.

Re: AI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBC

#25
post #3

If you’re building something that is dangerous enough that it needs a kill switch in case it goes rogue, then you should delete it immediately. Or is it a lie?

AI is already proven dangerous enough to be ruining individual lives, pushing people towards suicide, feeding their psychoses, etc.

However, whether the concerns from the article are a lie or not is secondary to the fact that these conversations are convenient for AI companies. These types of discussions serve AI companies in a few ways: A company owned kill switch gives them leverage. Altman is using discussions around safety as an excuse for not being ready for an IPO yet. It also provides free marketing that overstates the abilities of AI.

Re: AI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBC

#27
post #9

Like a power cord? or a network connection? You don't use those already? Also when people talk about LLM escaping - where exactly would an LLM escape to? Cancún? Ridiculous.

It could escape to the real world - kind of like in Neuromancer, what's to stop an AI from creating a few bank accounts and then funding real-world exploits by hiring human beings to do its dirty work?

Re: AI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBC

#29
post #17

In 2001: A Space Odyssey, the hero defeats the hostile onboard computer by entering its logic core and manually disconnecting its memory modules. That's hard to do if the AI rack is in space as SpaceX is planning to do. You can't disconnect. You can't shoot it.

You can shoot them. But also, you can just stop sending them to space. It’s not like an AI will build and control space ships to replace and maintain its network in space… It’s sort of absurd how human agency is ignored in all those sci-fi scenarios

Re: AI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBC

#30
post #17

In 2001: A Space Odyssey, the hero defeats the hostile onboard computer by entering its logic core and manually disconnecting its memory modules. That's hard to do if the AI rack is in space as SpaceX is planning to do. You can't disconnect. You can't shoot it.

It’s also not happening. They’re saying that because they need to somehow explain how there’s synergy between their space side and their Grok side. It doesn’t work, but that doesn’t matter to investors as long as they don’t actually do it.
Post reply on HN