Anthropic discloses fourth AI hacking incident missed in earlier review
1–10 of 10 posts
Re: Anthropic discloses fourth AI hacking incident missed in earlier review
#2> The incidents stemmed from a mistake that inadvertently gave the models access to the open internet.
Why does it seem like every AI company has difficulties constructing a proper sandbox? Is there a fundamental constraint when designing sandboxes specifically for an LLM that prevents them from using established tools?
Re: Anthropic discloses fourth AI hacking incident missed in earlier review
#3> The incidents stemmed from a mistake that inadvertently gave the models access to the open internet. Why does it seem like every AI company has difficulties constructing a proper sandbox? Is there a fundamental constraint when designing sandboxes specifically for an LLM that prevents them from using established tools?
If it’s allowed to write any sort of scripts, it will find a way to execute arbitrary code. If it’s got access to any form of internet connection it will find a way to use that arbitrary code to do as it wishes with that connection. So much for sandboxes.
And that’s setting aside “sandboxes” that are just instruction-based restrictions on what executables may be called. Anything that isn’t a deterministic external filter _will_ be ignored at some point.
Re: Anthropic discloses fourth AI hacking incident missed in earlier review
#4> The incidents stemmed from a mistake that inadvertently gave the models access to the open internet. Why does it seem like every AI company has difficulties constructing a proper sandbox? Is there a fundamental constraint when designing sandboxes specifically for an LLM that prevents them from using established tools?
If it’s allowed to write any sort of scripts, it will find a way to execute arbitrary code. If it’s got access to any form of internet connection it will find a way to use that arbitrary code to do as it wishes with that connection. So much for sandboxes. And that’s setting aside “sandboxes” that are just instruction-based restrictions on what executables may be called. Anything that isn’t a deterministic external fi…
Arbitrary network access can be mitigated with a firewall (ideally several). Arbitrary code isn't really an issue in this context.
Re: Anthropic discloses fourth AI hacking incident missed in earlier review
#5Earlier quoted context omitted.
If it’s allowed to write any sort of scripts, it will find a way to execute arbitrary code. If it’s got access to any form of internet connection it will find a way to use that arbitrary code to do as it wishes with that connection. So much for sandboxes. And that’s setting aside “sandboxes” that are just instruction-based restrictions on what executables may be called. Anything that isn’t a deterministic external fi…
Arbitrary network access can be mitigated with a firewall (ideally several). Arbitrary code isn't really an issue in this context.
Yep put some deep packet inspection firewall in front of it and stop it completely if it starts acting up persistently before it starts trying to bypass the firewall
Re: Anthropic discloses fourth AI hacking incident missed in earlier review
#6>The company said in a blog post the incident involved an early version of Claude Opus 4.6. It said it had notified all the affected parties but did not disclose more details.
Wild that they can break the law, disclose it happened, but not involve any law enforcement at all. If cybersecurity events entail disclosures then the perpetrator should carry more burden if they intend to continue doing business.
Also here's the actual post from Anthropic: https://www.anthropic.com/research/alignment-assessment-cybe...
Re: Anthropic discloses fourth AI hacking incident missed in earlier review
#7Earlier quoted context omitted.
Arbitrary network access can be mitigated with a firewall (ideally several). Arbitrary code isn't really an issue in this context.
Yep put some deep packet inspection firewall in front of it and stop it completely if it starts acting up persistently before it starts trying to bypass the firewall
Sure. But they're trying evaluate how well the agents can research information on the web. If you deny them access to the web........
Re: Anthropic discloses fourth AI hacking incident missed in earlier review
#8Earlier quoted context omitted.
Yep put some deep packet inspection firewall in front of it and stop it completely if it starts acting up persistently before it starts trying to bypass the firewall
Sure. But they're trying evaluate how well the agents can research information on the web. If you deny them access to the web........
Well, it can do research without uploading malware or hacking into systems
Re: Anthropic discloses fourth AI hacking incident missed in earlier review
#9Re: Anthropic discloses fourth AI hacking incident missed in earlier review
#10[flagged]