Live data from Hacker News

Sandbox: Run untrusted AI code safely, fast

github.com

31–32 of 32 posts

Re: Sandbox: Run untrusted AI code safely, fast

#31
post #24

Earlier quoted context omitted.

I’m still not sure why sending files to the cloud is supposed to be a disadvantage of other approaches but not this one. Whether you run your LLM’s commands in this sandbox or not, content is going to the cloud if the LLM is in the cloud, and not going to the cloud if the LLM is local. It looks like the amount of data in the cloud is entirely orthogonal to whether you use coderunner.

If you run your LLMs locally then nothing goes to the cloud. If you use cloud offerings then of course nothing is going to help you.

I could say the same about any AI architecture. By definition cloud = cloud, local = not cloud. So when coderunner advertises ~ “more privacy because less cloud” I’m not sure what it is about coderunner that helps me get less cloud than anything else.

Re: Sandbox: Run untrusted AI code safely, fast

#32
post #19
post #8

Genuine question: why not just use GCP/AWS VMs for agentic execution? What is missing?

This runs on GCP The issue with using raw VMs is you want fast startup. If you are running hundreds of pieces of code per hour as you develop, or have 10 or 20 agents running simultaneously it's much better to have something faster to start. This uses Amazon's Firecracker on GCP to provide that. AWS has something similar for its own Agent framework.

@nl But this uses nested virtualization on GCP, which severely hurts performance. Faster boot up means nothing if everything else is slow.
Post reply on HN