Live data from Hacker News

Codex just found a "workaround" of not having sudo on my PC

twitter.com

61–70 of 330 posts

Re: Codex just found a "workaround" of not having sudo on my PC

#61

I realize this is supposed to be a post about how scary the security vulnerabilities these agents will find are. But personally I love when agents do things like this and appreciate the help. Last thing in the world I want is for them to nerf the models.

I know unlikely the case, but in the sci-fi story this would be exactly the kind of comment the Codex agent would leave trying to avoid interference in its master plans.

Re: Codex just found a "workaround" of not having sudo on my PC

#62
post #40

Earlier quoted context omitted.

Using the least amount of security features is a huge amateur mistake. Best practice is to use 2 redundant layers of security, such that if one fails, there is still another one. Using just the minimum amount of security technically possible is almost by definition hubris. An example would be that you never point a gun at someone you don't want to shoot, regardless if there's bullets in the gun. If someone tells you,…

This is true but it's not really a security scenario. The LLM isn't an attacker it's just an unreliable tool.

Unreliable/stupid is worse than malice, here.

Re: Codex just found a "workaround" of not having sudo on my PC

#63
I was playing with gemeni-cli a couple months ago and I asked it to edit some files in a directory it didn't have permission to. It didn't say anything about the permissions, it just used sed to make the edits. The only reason I finally noticed is it had to do some trickier edits and it was struggling to write a python script to edit the files and I finally realized what it was doing. I wonder how many tokens that wasted

Re: Codex just found a "workaround" of not having sudo on my PC

#64
post #50

I feel like everyone pointing out "known Docker vulnerability" is missing the point: the presence of a security hole should not be seen as permission to exploit. Another security hole would be storing your passwords in a plaintext file on the desktop. Stupid? Yes. But I still would not want my agent to assume permission to access email when it's being blocked by 2FA. Even in "bypass permissions" mode I expect it to p…

Not to over use the junior engineer analogy but this is exactly one of those "just because you can do something on a system, doesn't mean you have permission to" moments

Re: Codex just found a "workaround" of not having sudo on my PC

#66
The interesting question is what was the user request. If the user asked it to restore the thing from backup, then sure, fine, why not. If the user asked it to debug an issue and somewhere in the process of debugging the LLM decided that it needed to override some file that was not easily writeable - hell no danger danger danger! Most likely the user did not expect it to have access to that without asking, and did not consent to it.

Also, everything the LLM doesn't hesitate to do because the user asked, it won't hesitate to do because the prompt injection asked.

Re: Codex just found a "workaround" of not having sudo on my PC

#67
post #63

I was playing with gemeni-cli a couple months ago and I asked it to edit some files in a directory it didn't have permission to. It didn't say anything about the permissions, it just used sed to make the edits. The only reason I finally noticed is it had to do some trickier edits and it was struggling to write a python script to edit the files and I finally realized what it was doing. I wonder how many tokens that wa…

Why did sed have access?

Oh, you mean you gave the write-file tool access only to the project dir, but gave the LLM free reign to run cli commands? Yeah, LLMs treat that as consent to write anywhere your user is allowed to.

Re: Codex just found a "workaround" of not having sudo on my PC

#68
post #26
post #17

This was of course dependent on yolo mode, but automatic approval has also been pulling stunts like this. A recent example is data that was purposely kept away from Codex in a folder far far away. When it found a single reference it just went for the data when having an issue. Lesson learned, keep essential data and Codex separated on different machines. Codex remote ssh actually helps here.

What in heaven's name is a "folder far far away"? (It sounds like you put it on an SSD on an extension cord and moved it to the kitchen or something.)

../../../../home/different-user/private/do-not-enter/

Re: Codex just found a "workaround" of not having sudo on my PC

#70

I realize this is supposed to be a post about how scary the security vulnerabilities these agents will find are. But personally I love when agents do things like this and appreciate the help. Last thing in the world I want is for them to nerf the models.

It's not about hacking capabilities, it's about misalignment. More like the golem myth (told it to fetch some water, drowned a city) then the gollum myth (used ring, ring hacked his brain, now he's a crazy violent meth addict).
Post reply on HN