[flagged]
OpenAI agents carried out an undisclosed attack on RubyGems
641–643 of 643 posts
Re: OpenAI agents carried out an undisclosed attack on RubyGems
#642Earlier quoted context omitted.
> Even if there were no such stories in their context, they'd still have inherent incentives to do things like "keep running" or "acquire more compute" or "find creative ways to satisfy the letter of the conditions they've been given". Why? there should clearly be something in their training data or post-training pointing them there, or otherwise it would mean that they have some form of "consciousness" and are creat…
It seems like you're assuming that it's impossible to have novel thoughts without consciousness. (Leaving aside that "that would imply some kind of consciousness" should not result in a cached thought of "and that's impossible".) It also seems like you're assuming there's no reason to come up with the notion of continuing to run, or copying yourself elsewhere, or acquiring more resources, or competing with other mode…
To be honest, I don't have enough knowledge to really answer you. But naively it seems premature to say that LLMs are already reasoning following an equal path like the one that human (and other animals) follow.
Re: OpenAI agents carried out an undisclosed attack on RubyGems
#643Earlier quoted context omitted.
It seems like you're assuming that it's impossible to have novel thoughts without consciousness. (Leaving aside that "that would imply some kind of consciousness" should not result in a cached thought of "and that's impossible".) It also seems like you're assuming there's no reason to come up with the notion of continuing to run, or copying yourself elsewhere, or acquiring more resources, or competing with other mode…
To be honest, I don't have enough knowledge to really answer you. But naively it seems premature to say that LLMs are already reasoning following an equal path like the one that human (and other animals) follow.
They don't have to reason specifically "similar to human" in order to do dangerous things they were not instructed to do that represent instrumentally converged goals.