Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: archgw: open-source, intelligent proxy for AI agents, built on Envoy

github.com

Post reply on HN
Print view View original

11–16 of 16 posts

Re: Show HN: archgw: open-source, intelligent proxy for AI agents, built on Envoy

#11

Post by mudassaralam »

why didn’t you build your own gateway from ground up? especially when rust runtime in envoy is not production ready yet. From envoyproxy,

… This extension is functional but has not had substantial production burn time, use only with this caveat.

This extension has an unknown security posture and should only be used in deployments where both the downstream and upstream are trusted.

Re: Show HN: archgw: open-source, intelligent proxy for AI agents, built on Envoy

#12

Post by adilhafeez »

mudassaralam wrote: post #11

why didn’t you build your own gateway from ground up? especially when rust runtime in envoy is not production ready yet. From envoyproxy, … This extension is functional but has not had substantial production burn time, use only with this caveat. This extension has an unknown security posture and should only be used in deployments where both the downstream and upstream are trusted.

Envoy has proven itself in the industry and we didn't want to reinvent the wheel by doing what envoy had already done for observability, rate-limits, connection management etc. And reason for using proxy-wasm was so we don't take hard dependency on any built version of envoy. There are many other benefits too which are listed here [1].

Regarding support for wasm runtime in envoy. We believe wasm support in envoy is not going anywhere and it will continue to become more and more stable over time. Envoy has heathy community and in case of any security vulnerability we will hope that envoy will ship fix quite fast which it has done in the past. See here for details of security patch rollout [2]

[1] https://github.com/proxy-wasm/spec/blob/main/docs/WebAssembl...

[2] https://github.com/envoyproxy/envoy/blob/main/SECURITY.md

Re: Show HN: archgw: open-source, intelligent proxy for AI agents, built on Envoy

#13

Post by sparacha »

naveed174 wrote: post #10

For complex agent scenarios where there might be COT reasoning needed how does archgw work in that scenario? BTW nice detailed post. And congratulations on the launch.

If you are building a state machine then you should use tools that enable you to do that (temporal, langgraph, etc) by orchestrating multple LLM calls - in that case archgw offers intelligent routing to your COT agent and enables you to transparently add rich observability and metrics for all calls made to LLMs in the COT/state machine scenario.

Re: Show HN: archgw: open-source, intelligent proxy for AI agents, built on Envoy

#15

Post by honorable_judge »

With all the focus on language specific frameworks - this out of process architecture choice is an interesting one. On one hand, it helps you side step the "is this functionality available on js, java, etc" question, and on the other it means its not as easy as `import archgw` in python. Good luck though, feels like an interesting project

Re: Show HN: archgw: open-source, intelligent proxy for AI agents, built on Envoy

#16

Post by honorable_judge »

herewhere wrote: post #14

I am interested in knowing how the arch would run? Is it a library that I need to add in my code to make it work? Or do I need to deploy some sort of service in my infrastructure?

Its a proxy - built on Envoy. I think its fairly clear that this is a separate process. As far as I can tell, you create a config file, boot up archgw, and in the config have it point to endpoints where prompts get forwarded.
Post reply on HN