Show HN: AI Proxy with Support for OpenAI, Anthropic, LLaMa2, Mistral
braintrustdata.com
Show HN: AI Proxy with Support for OpenAI, Anthropic, LLaMa2, Mistral
1–10 of 20 posts
Re: Show HN: AI Proxy with Support for OpenAI, Anthropic, LLaMa2, Mistral
#2We've been using Braintrust for evals at Zapier and it's been really great -- pumped to try out this proxy (which should be able to replace some custom code we've written internally for the same purpose!).
Re: Show HN: AI Proxy with Support for OpenAI, Anthropic, LLaMa2, Mistral
#3We've been using Braintrust for evals at Zapier and it's been really great -- pumped to try out this proxy (which should be able to replace some custom code we've written internally for the same purpose!).
Thanks for all the support Bryan and team!
Re: Show HN: AI Proxy with Support for OpenAI, Anthropic, LLaMa2, Mistral
#4This is neat. It is more obvious than ever that everyone should be building in redundancy, testing across models.
Re: Show HN: AI Proxy with Support for OpenAI, Anthropic, LLaMa2, Mistral
#5this is great. redundancy across models (closed and open-source) seems like an obvious need, esp in light of everything this weekend
Re: Show HN: AI Proxy with Support for OpenAI, Anthropic, LLaMa2, Mistral
#6where is the github?
Re: Show HN: AI Proxy with Support for OpenAI, Anthropic, LLaMa2, Mistral
#7where is the github?
It's not open source at the moment, but we're definitely open to it.
Re: Show HN: AI Proxy with Support for OpenAI, Anthropic, LLaMa2, Mistral
#8Very timely release in terms of interoperability. Auto caching seems like a no-brainer too. Nice job team for shipping this past weekend
Re: Show HN: AI Proxy with Support for OpenAI, Anthropic, LLaMa2, Mistral
#9how does this differ from a model “router” (e.g. withmartian.com)?
Re: Show HN: AI Proxy with Support for OpenAI, Anthropic, LLaMa2, Mistral
#10from first glance, it looks similar to LiteLLM[0]. Are there any key differences?
Also, in light of this weekend's madness, are you reconsidering using the OpenAI API as the canonical interface? Do you think there could be changes in the future?