Live data from Hacker News

Show HN: Aurora – AI Gateway built in Go

github.com

1–4 of 4 posts

Show HN: Aurora – AI Gateway built in Go

#1
Every Ai project needs the same infra - API keys, providers SDKs, retry logic, cost tracking. it should be infra layer. Aurora is a Go gateway that handles that layer, ~15MB binary, no dependencies. It proxies requests to OpenaAI, Anthropic, Gemini etc, and can convert between formats - use the OpenAi SDK and Aurora translates to Anthropic's wire format automatically. No format conversion code in backend.

It helps: - track costs per customer/team - switch models and providers without changing code - debug requests and responses flows more easily - reduce costs with exact and semantic caching

How its different than other gateways: - auto-discovers providers models - provider pools with automatic failover switch - built in guardials, audit logging with export, analytics, admin dashboard - model aliases, regional deployment to reduce latency. - can be used in infra directly and admin endpoints let control everything, creating managed api keys on user onboard and more.

The oss version (Apache 2.0) includes everyhting. Enterprise adds SSO, RBAC, and tenant isolation.

npm install -g iaurora

website: https://aurorallm.online

feedbacks are welcome!

Show HN: Aurora – AI Gateway built in Go
github.com

Re: Show HN: Aurora – AI Gateway built in Go

#3
post #2

Curious how semantic cache works,are cache hit based on embeddings, exact prompt normalization, how do you avoid serving stale incorrect cache..

for semantic cache, there is configurable similarity threshold. using it you can control the incorrect cache serving.

Re: Show HN: Aurora – AI Gateway built in Go

#4
post #2

Curious how semantic cache works,are cache hit based on embeddings, exact prompt normalization, how do you avoid serving stale incorrect cache..

for semantic cache, there is configurable similarity threshold. using it you can control the incorrect cache serving.

[flagged]