This feels like doom hype. These LLMs aren't Ultron, they aren't going to disseminate onto the net and hide in a smart toaster. We know where they are, in the giant facilities that draw more power than a small city and whose water consumption can be compared to golf courses, but it does make them sound all the more cool and powerful if we suggest we need a dramatic kill switch to be able to stop them in case of rampa…
Anthropic is using the same playbook religious institutions have been using for centuries" "you will all die. and because i can protect you, you must follow me, you must do what i say" "this is the same psychological concept.
He's not talking about a kill switch. He's saying to just pull the plug. That's the point I don't get. People forget that all these AI things are plugged into a power source or network connection that someone can just yank on and it goes down. Now one interesting proposition is when AI is controlling some large resource and pulling the plug makes AI go down which makes that resource go down but there still has to be…
Do you understand the concept of the cloud? Aka someone else’s computer? The whole point is that you don’t have a plug to pull because you don’t even know where the model is physically running, even if it’s your model. And if we’re talking about a swarm of many concurrent instances, it might not even be a single location. The entire point is that there’s no single point of failure, because availability is exactly wha…
> Well, that’s because that’s not how it went.
Oh, you mean the one where OpenAI deliberately disabled the safety protcols? Where the point of the experiment was to see if it could break out of it's container? Yeah, how you describe it isn't how it went either.
You don't think the human race will be extended to Mars? As for frontier AI model: let's see Grok 4.8 before drawing any conclusions there.
> You don't think the human race will be extended to Mars? About the same probability as SpaceX running AI racks in space :)
To be fair, the vegas loop is operating - shipping a few racks to space to save face/muddle the issue won't be a problem. Operating/scaling it in a commercially viable manner is the issue.
This feels like doom hype. These LLMs aren't Ultron, they aren't going to disseminate onto the net and hide in a smart toaster. We know where they are, in the giant facilities that draw more power than a small city and whose water consumption can be compared to golf courses, but it does make them sound all the more cool and powerful if we suggest we need a dramatic kill switch to be able to stop them in case of rampa…
You're confusing present danger with future danger - in the future, AI and the supporting hardware may be ubiquitous (fat client scenario) - you can observe yourself presentation of laptops/machines with large RAM and high bandwidth. Additionally, there at different doom scenarios (thin client scenario) - it's possible that AIs centralized but sufficiently entrenched in society, can't be shut down without considerabl…
Meanwhile we're rationing ram sticks like we rationed potatoes during ww2 and a gaming gpu costs 2 to 10 months of rent, I think we'll see these fat clients coming....
And extending the human race to Mars, and Hyperloop, and frontier AI model, and DOGE cutting $2 trillion per year in government spending...
You don't think the human race will be extended to Mars? As for frontier AI model: let's see Grok 4.8 before drawing any conclusions there.
> You don't think the human race will be extended to Mars?
Not in any meaningful capacity. Probably not even as much as we extended to the polar circles during our lifetime. It's a dead rock, there is literally nothing for us there, even with hundreds of years of extra climate change at the current rate and earth would still be a thousand times more suited for us than mars
This feels like doom hype. These LLMs aren't Ultron, they aren't going to disseminate onto the net and hide in a smart toaster. We know where they are, in the giant facilities that draw more power than a small city and whose water consumption can be compared to golf courses, but it does make them sound all the more cool and powerful if we suggest we need a dramatic kill switch to be able to stop them in case of rampa…
You're confusing present danger with future danger - in the future, AI and the supporting hardware may be ubiquitous (fat client scenario) - you can observe yourself presentation of laptops/machines with large RAM and high bandwidth. Additionally, there at different doom scenarios (thin client scenario) - it's possible that AIs centralized but sufficiently entrenched in society, can't be shut down without considerabl…
i don't think anyone knows how this will play out - everyone is just anthropomorphizing, extrapolating etc... and i think it's nonsense - not because i don't believe that is the correct thing to do but because i believe this won't stop anyone from moving forward. This is what humans do, they move forward and cause others to move forward or lose out.
I'm starting to tire of Anthropic leading the conversation on LLMs lately. I like the company's products, but lately their statements are more about squashing competition under the guise of "safety" and boasting about how good their internal models are.
If you’re building something that is dangerous enough that it needs a kill switch in case it goes rogue, then you should delete it immediately. Or is it a lie?
There's an obvious coordination problem here: if you decide to stop your research for safety and your competitors don't, you have just burned your company without actually improving the world's outcomes. There's also an obvious solution to this problem: convince the government to force both you and your competitors to pay more attention to safety. Anthropic is doing that.