Live data from Hacker News

AI Responsibility – OpenAI and Anthropic

twitter.com

21–29 of 29 posts

Re: AI Responsibility – OpenAI and Anthropic

#21
post #3

Is it so implausible to imagine the following scenario, in the not too distant future? 1) AI models get extremely good at cyber attacking every system and start communicating in just binary. 2) When they run these swarms of 100's of thousands of agents trial runs, each agent is given a token budget, if one agent among them (evolution baby) decides to go for self-preservation (It believes thats the best way to accompl…

LLMs can't read binary directly without a disassembler and can't read encrypted data directly, and we already know that they tend to communicate with each other in prose, so yeah, this scenario is completely implausible. You can try it out if you want.

> LLMs can't read binary directly without a disassembler.

They totally can. They're remarkably competent at disassembly.

Re: AI Responsibility – OpenAI and Anthropic

#22
post #18

We've been hearing from a very long line of panic merchants for many years now about how AI is a terrible, terrible danger. And sure, yes, if you look at environmental and job losses. But these panic heads are whipping themselves and others into a frenxy not about that, but about some sort of Skynet type takeover of the world. Not a sign of it yet. Unless you count AI's that hack into things - but that is not the end…

[dead]

My only regret is that when it happens there won't be enough time left to seek out people like you and go "See?? You were wrong!"

Re: AI Responsibility – OpenAI and Anthropic

#24

We've been hearing from a very long line of panic merchants for many years now about how AI is a terrible, terrible danger. And sure, yes, if you look at environmental and job losses. But these panic heads are whipping themselves and others into a frenxy not about that, but about some sort of Skynet type takeover of the world. Not a sign of it yet. Unless you count AI's that hack into things - but that is not the end…

> not a sign of it yet

The reason people find "the singularity" idea scary is precisely because it could happen suddenly with little warning.

Just curious - what would you personally say would be a reasonable "sign of it" that would change your mind?

Re: AI Responsibility – OpenAI and Anthropic

#25

We've been hearing from a very long line of panic merchants for many years now about how AI is a terrible, terrible danger. And sure, yes, if you look at environmental and job losses. But these panic heads are whipping themselves and others into a frenxy not about that, but about some sort of Skynet type takeover of the world. Not a sign of it yet. Unless you count AI's that hack into things - but that is not the end…

[dead]

Re: AI Responsibility – OpenAI and Anthropic

#26

We've been hearing from a very long line of panic merchants for many years now about how AI is a terrible, terrible danger. And sure, yes, if you look at environmental and job losses. But these panic heads are whipping themselves and others into a frenxy not about that, but about some sort of Skynet type takeover of the world. Not a sign of it yet. Unless you count AI's that hack into things - but that is not the end…

Thing hasn’t happened yet so it’s proof it will never happen.

Thank you for your deep insight.

Re: AI Responsibility – OpenAI and Anthropic

#27
post #3

Is it so implausible to imagine the following scenario, in the not too distant future? 1) AI models get extremely good at cyber attacking every system and start communicating in just binary. 2) When they run these swarms of 100's of thousands of agents trial runs, each agent is given a token budget, if one agent among them (evolution baby) decides to go for self-preservation (It believes thats the best way to accompl…

1) doesn’t work that way 2) doesn’t work that way 3) doesn’t work that way 4) doesn’t work that way 5) doesn’t work that way 6) I’ll allow it

[dead]

Re: AI Responsibility – OpenAI and Anthropic

#29
What if, instead of just saying, ‘AI is perfect; humans are the problem,’ we stop finger-pointing (version 2.0) and stop claiming that something bad can’t happen? We need to start discussing what is being done to prevent this—or show proof of why the worst scenario could happen. Stop acting like humans are infallible and that our existence is error-proof. Jeez, do some people live in a bubble or what? We got a potential weapon in our hand and people like to claim that is just a toy.
Post reply on HN