Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

My Agent Setup

chad.cm

Post reply on HN
Print view View original

61–69 of 69 posts

Re: My Agent Setup

#61

Post by ljlolel »

shostack wrote: post #58

Love the post and have a similar setup. But I have questions about how you handle sensitive personal info with Codex and Claude with this setup given Hermes has no boundaries on its own with its integrations with Codex for example. It can leak memory and tool calls and context through. At home I have Hermes on a VPS with matrix and mnemosyne and it is largely for personal use. While I was excited to try out the seaml…

Keep the memory/tool silo in Hermes. I run TrustedRouter; trustedrouter/zdr gives that agent a ZDR-only model hop, but it cannot make Codex or Claude subscriptions ZDR. https://trustedrouter.com/blog/one-api-all-llms-provably-pri...

Re: My Agent Setup

#62

Post by shostack »

ljlolel wrote: post #61
shostack wrote: post #58

Love the post and have a similar setup. But I have questions about how you handle sensitive personal info with Codex and Claude with this setup given Hermes has no boundaries on its own with its integrations with Codex for example. It can leak memory and tool calls and context through. At home I have Hermes on a VPS with matrix and mnemosyne and it is largely for personal use. While I was excited to try out the seaml…

Keep the memory/tool silo in Hermes. I run TrustedRouter; trustedrouter/zdr gives that agent a ZDR-only model hop, but it cannot make Codex or Claude subscriptions ZDR. https://trustedrouter.com/blog/one-api-all-llms-provably-pri...

I already have that effectively via pinning Fireworks on Openrouter. I am unclear how this would solve the architecture issue I raised though.

Re: My Agent Setup

#63

Post by kolli_kumar »

This is awesome! I have a similar setup, with multiple Nanobot Docker instances across three different VMs, along with Matrix and Gitea. I also have a few connected with Obsidian.

I’d love to understand more about your Obsidian setup and Buzz.

The Matrix app on iOS isn’t as good as Telegram.

I have 16 Nanobot instances—4 for my parents and 12 for me and my spouse.

With OpenWebUI and its Knowledge feature, I was thinking of moving some of them there.

I have only one small VPS for ntfy and Matrix. Everything else is self-hosted.

A few years ago, I bought way too much RAM for my Dell server and added more storage just to experiment. Now I’m sitting on a gold mine, with prices having nearly tripled!

I also have a Synology for VM snapshots and backups to Google Drive and B2.

Re: My Agent Setup

#65

Post by carimura »

shostack wrote: post #58

Love the post and have a similar setup. But I have questions about how you handle sensitive personal info with Codex and Claude with this setup given Hermes has no boundaries on its own with its integrations with Codex for example. It can leak memory and tool calls and context through. At home I have Hermes on a VPS with matrix and mnemosyne and it is largely for personal use. While I was excited to try out the seaml…

It depends on what you mean by sensitive personal data. I actually don't give any agents access to my main email boxes instead they access a business google workspace that is spinning up.

I do separate the agents duties somewhat to try and give them the least privileges they need to do a job, and talk to all of them through buzz, and they talk to each other (occasionally) when they need something they don't have access to.

As mentioned in the post I still do a majority of my coding at my local terminal with just bits and pieces sent to my "dev-agent" through Buzz. This is a next experiment for me - (that's a hyphen!) to offload more coding to agents.

Re: My Agent Setup

#66

Post by carimura »

kolli_kumar wrote: post #63

This is awesome! I have a similar setup, with multiple Nanobot Docker instances across three different VMs, along with Matrix and Gitea. I also have a few connected with Obsidian. I’d love to understand more about your Obsidian setup and Buzz. The Matrix app on iOS isn’t as good as Telegram. I have 16 Nanobot instances—4 for my parents and 12 for me and my spouse. With OpenWebUI and its Knowledge feature, I was think…

Obsidian is like the shared knowledge base that everyone has access to and that I can easily read/review (although I try not to too often). It has architecture stuff, go-to-market section, howtos (setting up new agents, dns backups, etc.), info on my main projects, writing, etc. It gets synced between my machine and the VPS. I also store in github as a backup occasionally (thx for reminder!).

I use the actual Buzz ios app which I was building on my own but at first glance it appears is now in the iOS store.

Re: My Agent Setup

#67

Post by carimura »

moss_dog wrote: post #64

Thanks for the write-up! I'm interested in doing something similar. How are you sandboxing the agents?

I use the term sandbox loosely. They're on a VPS running as user hermes but they share everything with each other in their own user space. I could/should probably improve this. Maybe make them their own unix user. They are separated from the root-access agent.

Re: My Agent Setup

#68

Post by phplovesong »

carimura wrote: post #22
phplovesong wrote: post #21

I would never have the power to have AI just do everything. I like to create, not have some slop machine do whatever.

AI is far from doing everything in my setup. just looking for incremental wins to see if my slop machine can be useful.

These days it seems that just having AI dom SOMETHING is the goal, no one cares about what it does, or what kind of quality it runs.

Its basically just a weird limbo thing that runs and you dont care how bad it is, not even considering what bugs it has. Outout is usually only glanced over.

Re: My Agent Setup

#69

Post by nduwork »

shostack wrote: post #58

Love the post and have a similar setup. But I have questions about how you handle sensitive personal info with Codex and Claude with this setup given Hermes has no boundaries on its own with its integrations with Codex for example. It can leak memory and tool calls and context through. At home I have Hermes on a VPS with matrix and mnemosyne and it is largely for personal use. While I was excited to try out the seaml…

[flagged]
Post reply on HN