input tokens: $0.5 per 1,000 output tokens: $1.5 per 1,000 that's either one hell of a typo or my god I'll be broke in an hour if I accidentally use this service
The website looks like AI, so do we call it a typo or a hallucination?
API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)
21–30 of 41 posts
Re: API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)
#22[flagged]
This comment is likely AI. Consider author post history as well. (this comment) > This idea sits in a really interesting space because on paper (previous comments) > I really like this class of work because it sits at a strange intersection: > It’s wild how Voyager forces two truths to sit together: The pattern is " " > becomes workflow-aware, not just price-aware. > human mental model instead of the mathematically c…
The post itself is AI too, so we've got a perfect closed circle. Soon HN won't even need the humans anymore, as long as it drives enough hype and seed round funding.
Re: API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)
#23Earlier quoted context omitted.
> Typical savings: 60-90% on most requests, since Gemini Flash is often free/cheapest, but you still get Claude or GPT-4 when needed. This claim seems overstated. Accurately routing arbitrary prompts to the cheapest viable model is a hard problem. If it were reliably solvable, it would fundamentally disrupt the pricing models of OpenAI and Anthropic. In practice, you'd either sacrifice quality on edge cases or end up…
I genuinely wonder the use cases are where the required accuracy is so low (or I guess the prompts are so strong) that you don't need to vigorously use evals to prevent regressions with the model that works best--let alone actually just change models on the fly based on what's cheaper.
Yes and in addition for some reason that use case is also not a fit for some cheap OS model like qwen or kimi, but must be run on the cheapest model of the big three.
Re: API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)
#24input tokens: $0.5 per 1,000 output tokens: $1.5 per 1,000 that's either one hell of a typo or my god I'll be broke in an hour if I accidentally use this service
The website looks like AI, so do we call it a typo or a hallucination?
Not only is it AI its outdated AI.
https://tokensaver.org/api/pricing
Is offering GPT 3.5 Turbo and Gemini 1.5 Pro.
Re: API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)
#25A free router is https://huggingface.co/models
Re: API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)
#26I am not sure who is the intended customer for this service. The prompt and the model go hand in hand. If you randomly select the model the likelihood of getting something consistent is basically zero. Also model pricing don't very that much. I have never heard of spot-instance equivalent for inference although that will be cool. The demand for GPU is so high right now that I think most datacenters are at 100% utilis…
> Also model pricing don't very that much.
I'm curious when AI pricing will couple with energy markets. Then the location of the datacentre will matter considerably
Re: API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)
#27This has a nice made up "case study": https://tokensaver.org/blog/how-i-saved-500-dollars-on-ai-co... > Six months ago, I was running a customer support chatbot for a SaaS product. Nothing fancy - ... I'm sure this toooootally happened > curl -X POST https://tokensaver.org/api/chat \ -H "Content-Type: application/json" \ -d '{ "email": "your@email.com", "messages": [ {"role": "user", "content": "Hello!"} ] }' Am I ge…
Vibe coded most likely. The creator might figure out the problems with that approach the hard way.
Re: API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)
#28[flagged]
This comment is likely AI. Consider author post history as well. (this comment) > This idea sits in a really interesting space because on paper (previous comments) > I really like this class of work because it sits at a strange intersection: > It’s wild how Voyager forces two truths to sit together: The pattern is " " > becomes workflow-aware, not just price-aware. > human mental model instead of the mathematically c…
Interesting, I read the comment and it had some very valid points and didn’t veer off into AI brabble. If it is AI I’d like to see the prompt!
Re: API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)
#29I am not sure who is the intended customer for this service. The prompt and the model go hand in hand. If you randomly select the model the likelihood of getting something consistent is basically zero. Also model pricing don't very that much. I have never heard of spot-instance equivalent for inference although that will be cool. The demand for GPU is so high right now that I think most datacenters are at 100% utilis…
Depends on what you're doing. Something like "read this text and extract all the phone numbers" or "write a 3-point summary of this email" will perform about the same on all good models.
Re: API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)
#30Out of frustration, I built an AI API proxy that automatically routes each request to the cheapest available provider in real-time. The problem: AI API pricing is a mess. OpenAI, Anthropic, and Google all have different pricing models, rate limits, and availability. Switching providers means rewriting code. Most devs just pick one and overpay. The solution: One endpoint. Drop-in replacement for OpenAI's API. Behind t…
You should probably take the service down before the HN crowd maxes out your credit card with the already discovered security and auth issues. Then find a technical co founder of you still want to pursue this idea and build it from scratch.