Viewing profile — edunteman

Nice work! Had to do similar serverside for stripping named entities and ended up burning way too much LLM cash

I hate to be that guy, but you can just choose to do these things. Learn to set SMART goals. Then set just one, so there's no excuses around priorities. Obviously, choose well. Mak…

I’ve been a big fan of “what’s the thinnest this could be” interpretations of sandboxes. This is a great example of that. On the other end of the spectrum there’s just-bash from th…

The llm detector in my brain went off too

Your repo was actually a major point of reference! Thank you for open sourcing it. Ironically when I first got into zig I built a similar generator for python bridging which your p…

Exactly, that’d be the intention. For compute-heavy or long running jobs you’d still probably want a dedicated VM like on E2B but for quick stuff, bVisor

Correct, your PATH resolves to your local tools as if it was unprotected bash, but syscalls are filtered/virtualized

Hell yeah, love to hear it! Happy to answer any questions or issues you run into

bVisor is an SDK and runtime for safely executing bash commands directly on your host machine. We built it on the belief that "sandbox" doesn't need to mean shipping off to remote …

The part that most resonates with me is the lingering feeling of “oh but it must be my fault for underspecifying” which blocks the outright belief that models are just still sloppy…

[dead]

Good question, I imagine you’d need to set up an ngrok endpoint to tunnel to local LLMs. In those cases perhaps an open source (maybe even local) version would make more sense. For…

Ah yes that makes sense, have heard of those cases too but hadn’t put much thought into it. Thanks for pointing it out!

I’d love your opinion here! Right now, we assume first call is correct, and will eagerly take the first match we find while traversing the tree. One of the worst things that could …

Very, very common approach! Wrote more on that here: https://blog.butter.dev/the-messy-world-of-deterministic-age...

Awesome to hear you’ve done similar. JSON artifacts from runs seem to be a common approach for building this in house, similar to what we did with the muscle mem. Detecting cache m…

I feel the same - we’ll use it as long as we can since it’s customer aligned but I wouldn’t be surprised if competitive or COGs costs force us to change in the future.

It’s bring-your-own-key, so any calls proxied to OpenAI just end up billing directly to your account as normal. You’d only pay Butter for calls that don’t go to the provider. That’…

I couldn’t see how it wouldn’t be, as it’s a free market opt-in decision to use Butter

Hi HN! I'm Erik. We built Butter, an LLM proxy that makes agent systems deterministic by caching and replaying responses, so automations behave consistently across runs. - It’s a c…

I've got a blog on this from the launch of Muscle Mem, which should paint a better picture https://erikdunteman.com/blog/muscle-mem Computer use agents (as an RPA alternative) is t…

Thanks! For langchain you can repoint your base_url in the client. Autogpt I'm not as familiar with. Closed loop robotics using LLMs may be a stretch for now, especially since visi…