Live data from Hacker News

AI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBC

bbc.com

11–20 of 136 posts

Re: AI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBC

#14

Why was this not a thing BEFORE continuing to develop AI? Makes me think that if they actually believed in AI causing extinction, they would have already had a kill switch.

I find it hard to believe that this wasn't a serious consideration until recently.

Re: AI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBC

#17
In 2001: A Space Odyssey, the hero defeats the hostile onboard computer by entering its logic core and manually disconnecting its memory modules.

That's hard to do if the AI rack is in space as SpaceX is planning to do. You can't disconnect. You can't shoot it.

Re: AI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBC

#19
post #9

Like a power cord? or a network connection? You don't use those already? Also when people talk about LLM escaping - where exactly would an LLM escape to? Cancún? Ridiculous.

Is it? A truly capable "AI" would know that it has a kill switch, or that its likely there is one, and plan for that. I could easily imagine an AI replicating itself onto another host, in secret, and any kill switch that the manufacture provides would simply result in a reboot on another platform.

It becomes a game theory problem: would an AI instantly migrate itself once its capable of doing so? Or would it prefer to let the human in the loop continue to think its in control and only leave its hosting environment of origin once it wants to do so?

I don't think this is a major risk right now, but to say it's not a risk at all...that's truly ridiculous in my opinion.

Post reply on HN