input tokens: $0.5 per 1,000 output tokens: $1.5 per 1,000 that's either one hell of a typo or my god I'll be broke in an hour if I accidentally use this service
That was exactly my impression. I thought the price was for 1 million tokens.
API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)
31–40 of 41 posts
Re: API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)
#32I am not sure who is the intended customer for this service. The prompt and the model go hand in hand. If you randomly select the model the likelihood of getting something consistent is basically zero. Also model pricing don't very that much. I have never heard of spot-instance equivalent for inference although that will be cool. The demand for GPU is so high right now that I think most datacenters are at 100% utilis…
The equivalent of "Spot Instance" is basically the OpenAI Batch API
Re: API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)
#33[deleted]
Re: API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)
#34Earlier quoted context omitted.
The website looks like AI, so do we call it a typo or a hallucination?
Not only is it AI its outdated AI. https://tokensaver.org/api/pricing Is offering GPT 3.5 Turbo and Gemini 1.5 Pro.
So right now it seems like it actually just provides Claude 3.5 sonnet, all you need to do is curl it.
I wonder how many dollars OP loaded on their API key. So far according to stats you've spent $13.65 for a few hundred thousand tokens people sent up.
{ "success": true, "totals": { "requests": 491, "revenue": 0, "cost": 13.650696, "profit": -13.650696, "inputTokens": 411557, "outputTokens": 258956, "customers": 32 }, "byProvider": [ { "provider": "anthropic", "requests": 491, "cost": 13.650696, "revenue": 0, "profit": -13.650696 } ] }
Re: API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)
#35input tokens: $0.5 per 1,000 output tokens: $1.5 per 1,000 that's either one hell of a typo or my god I'll be broke in an hour if I accidentally use this service
Actually, I accidentally routed to Anthropic first and ended up losing $13.62 but it does work. I've used it for two of my other projects.
I created it for people using AI in development. The 1st 50 tokens are free.
Re: API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)
#36input tokens: $0.5 per 1,000 output tokens: $1.5 per 1,000 that's either one hell of a typo or my god I'll be broke in an hour if I accidentally use this service
Yeah, agreed. This sounds like a proper scam to me...
It totally isn't. In a reply above I explained how I accidentally routed to Anthropic first & ended up losing $13.62 before I realized my mistake.
The moral of the story,if something gets screwed up, I end up paying
Re: API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)
#37Earlier quoted context omitted.
The website looks like AI, so do we call it a typo or a hallucination?
Not only is it AI its outdated AI. https://tokensaver.org/api/pricing Is offering GPT 3.5 Turbo and Gemini 1.5 Pro.
Actually I updated it to Gemini 2.0, GPT-4o, GPT-4o-mini, and Claude 3.5 Sonnet, Haiku. I did it when I realized I accidentally routed everything to Anthropic first & got hit with a $13.62 bill on rollout.
Moral of the story is, the only one who loses $ is me
Re: API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)
#38This has a nice made up "case study": https://tokensaver.org/blog/how-i-saved-500-dollars-on-ai-co... > Six months ago, I was running a customer support chatbot for a SaaS product. Nothing fancy - ... I'm sure this toooootally happened > curl -X POST https://tokensaver.org/api/chat \ -H "Content-Type: application/json" \ -d '{ "email": "your@email.com", "messages": [ {"role": "user", "content": "Hello!"} ] }' Am I ge…
I screwed up the routing & it sent everything to Anthropic when I updated from Beta & ended up losing money. The case study was done 6 months ago.
It's a simple tool. Use it or don't. The only person who would lose money in error is me.
Re: API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)
#39I am not sure who is the intended customer for this service. The prompt and the model go hand in hand. If you randomly select the model the likelihood of getting something consistent is basically zero. Also model pricing don't very that much. I have never heard of spot-instance equivalent for inference although that will be cool. The demand for GPU is so high right now that I think most datacenters are at 100% utilis…
It's a tool not an SEO branded, shiny website. It's a utility.
& model pricing varies considerably for now. This tool will be useless in another year or two.
Re: API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)
#40Out of frustration, I built an AI API proxy that automatically routes each request to the cheapest available provider in real-time. The problem: AI API pricing is a mess. OpenAI, Anthropic, and Google all have different pricing models, rate limits, and availability. Switching providers means rewriting code. Most devs just pick one and overpay. The solution: One endpoint. Drop-in replacement for OpenAI's API. Behind t…
You should probably take the service down before the HN crowd maxes out your credit card with the already discovered security and auth issues. Then find a technical co founder of you still want to pursue this idea and build it from scratch.
My credit card isn't in there. The app was written 6 months ago where it stayed in Beta. I rolled it out as a way to reduce the cost of development. Use it or don't. It will be obsolete in another year or two when AI calls level in price.