Viewing profile — retrovrv

Your best bet is having an account on AWS Bedrock & Vertex AI so you're able to route your request to the same model (such as claude-sonnet-4) but on a different provider.

there's portkey that we've been working on: https://github.com/portkey-AI/gateway

we essentially built the gateway as a service rather than an SDK: https://github.com/portkey-AI/gateway

just wanted to say, fantastic note. thanks for sharing!

thank you! we don't have a strong Evals module within our Prompt Studio at the moment. So there's no straightforward way to do that. however, we do have one of the better modules f…

lol. i get you - i think the 3rd point you shared - it's not exactly about CI issue - CI is already as fast as it can be. It's just that a prompt is a critical part of your AI app …

Hey HN! Long-time reader, occasional commenter here. I wanted to share something my team and I have been building to solve our own frustrations. We've all seen the explosion of pro…

This is actually pretty cool. Would love to try it!

I'm affiliated with Portkey, so can answer who would need such a proxy/gateway: Sidenote: Arch is def interesting! A typical user we've seen at Portkey is a mid or a large size eng…

came across this guide earlier - valuable insights. thanks for sharing!

there's an open source ai gateway - https://github.com/Portkey-AI/gateway

Phenomenal to see how Ragas has progressed. Congratulations on the launch

https://portkey.ai/ - is also a nice addition to the list

Thank you! We have built out the cache system -- we do both simple caching (matching the request strings 100%) and also do semantic caching (returning a cache hit for semantically …

Pretty excited to announce this! While there are some popular and awesome AI gateways out there, like litellm, bricksai - none are written in TS, and for the TS ecosystem. Looking …

I really liked request_format param to enforce JSON outputs, and seed param to enforce deterministic outputs - both I've already started to use.

Thanks for sharing my blog here! Quick notes on the analysis: - This is based on data from 100+ organizations globally, doing million+ requests a day via Portkey.ai. - I've randoml…

Super cool! Looks quite intuitive, especially for function calls.

There are quite a few LLM monitoring tools in the market. But for monitoring (or evaluating) RAG systems, I found Ragas to be the most helpful: https://blog.langchain.dev/evaluatin…

There are some programs that match founders, bring in VCs and overall facilitate "Networking" - those are tagged as such. Hope that helps!

Looks very interesting