AI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBC
31–40 of 136 posts
Re: AI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBC
#32Why was this not a thing BEFORE continuing to develop AI? Makes me think that if they actually believed in AI causing extinction, they would have already had a kill switch.
I find it hard to believe that this wasn't a serious consideration until recently.
Re: AI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBC
#33Re: AI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBC
#34In 2001: A Space Odyssey, the hero defeats the hostile onboard computer by entering its logic core and manually disconnecting its memory modules. That's hard to do if the AI rack is in space as SpaceX is planning to do. You can't disconnect. You can't shoot it.
> You can't disconnect. You can't shoot it. Yes you can shoot them. The US has had this capability for a long time. Anti satellite missiles exist and they can be launched from an F-15 at it's highest altitude.
Re: AI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBC
#35Like a power cord? or a network connection? You don't use those already? Also when people talk about LLM escaping - where exactly would an LLM escape to? Cancún? Ridiculous.
The current SOTA models are probably too big to find/buy/rent/steal enough compute to escape the hardware they’re running on. But SOTA is generally only six to twelve months ahead of smaller, open-weight models.
Re: AI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBC
#36In 2001: A Space Odyssey, the hero defeats the hostile onboard computer by entering its logic core and manually disconnecting its memory modules. That's hard to do if the AI rack is in space as SpaceX is planning to do. You can't disconnect. You can't shoot it.
Pretty much every analysis I've seen concludes this isn't going to be a practical concern
Re: AI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBC
#37Another angle is clamping down on products and services that help people create lab-like environments on the cheap.
Re: AI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBC
#38In 2001: A Space Odyssey, the hero defeats the hostile onboard computer by entering its logic core and manually disconnecting its memory modules. That's hard to do if the AI rack is in space as SpaceX is planning to do. You can't disconnect. You can't shoot it.
and that means unlike nukes which hopefully still need a 2-man manual switch, the "space lasers" could be taken over by "AI"
and then "AI" just blackmails and threatens the right people with those "space lasers" to get what it wants or even just stay online
there was a 1970 movie based on a 1966 book which predicted this
"Colossus: The Forbin Project"
the book it was based on was written before we even landed on the moon
decade before Wargames
* https://en.wikipedia.org/wiki/Colossus:_The_Forbin_Project
did terribly in theaters, I guess people didn't think "AI" was plausible then
way ahead of its time, they should do a remake
Re: AI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBC
#39These LLMs aren't Ultron, they aren't going to disseminate onto the net and hide in a smart toaster. We know where they are, in the giant facilities that draw more power than a small city and whose water consumption can be compared to golf courses, but it does make them sound all the more cool and powerful if we suggest we need a dramatic kill switch to be able to stop them in case of rampage.
Re: AI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBC
#40If you’re building something that is dangerous enough that it needs a kill switch in case it goes rogue, then you should delete it immediately. Or is it a lie?
AI is already proven dangerous enough to be ruining individual lives, pushing people towards suicide, feeding their psychoses, etc. However, whether the concerns from the article are a lie or not is secondary to the fact that these conversations are convenient for AI companies. These types of discussions serve AI companies in a few ways: A company owned kill switch gives them leverage. Altman is using discussions aro…