Live data from Hacker News

API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)

tokensaver.org

11–20 of 41 posts

Re: API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)

#15

[flagged]

I see that you have a few LLM-generated comments here, although this one is probably the most egregious amongst them. HN is mostly for humans to interact, so please do not do this here. Thank you.

Re: API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)

#17

[flagged]

This comment is likely AI. Consider author post history as well.

(this comment)

> This idea sits in a really interesting space because on paper

(previous comments)

> I really like this class of work because it sits at a strange intersection:

> It’s wild how Voyager forces two truths to sit together:

The pattern is " "

> becomes workflow-aware, not just price-aware.

> human mental model instead of the mathematically convenient one.

> run for that mindset more than for the tech.

My meta comment is not breaking the HN guidelines by letter, but may be spiritually breaking guidelines. See:

> Please don't post insinuations about astroturfing, shilling, brigading, foreign agents, and the like.

I think clarification on AI-accusations should be added to the guidelines if it falls under this class of comment.

Re: API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)

#18
The authentication for the API seems poorly designed. The auth token is your email address rather than a real auth token. If I know someone uses this service I can send a massive number of requests to cause a large credit card charge with just their email address. I thought this was just a mistake in the obviously LLM-written home page, but the API really does work this way after testing.

On top of that logging in does not require a password, just an email address.

Re: API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)

#19
This has a nice made up "case study": https://tokensaver.org/blog/how-i-saved-500-dollars-on-ai-co...

> Six months ago, I was running a customer support chatbot for a SaaS product. Nothing fancy - ...

I'm sure this toooootally happened

> curl -X POST https://tokensaver.org/api/chat \ -H "Content-Type: application/json" \ -d '{ "email": "your@email.com", "messages": [ {"role": "user", "content": "Hello!"} ] }'

Am I getting this right that there's no auth? Just provide an email and get free requests?

Edit:

This seems to always use sonnet 3.5 no matter the request. I asked it a USAMO problem and it still used sonnet (and hallucinated the wrong answer of course).

Re: API that auto-routes to the cheapest AI provider (OpenAI/Anthropic/Gemini)

#20
I am not sure who is the intended customer for this service.

The prompt and the model go hand in hand. If you randomly select the model the likelihood of getting something consistent is basically zero.

Also model pricing don't very that much. I have never heard of spot-instance equivalent for inference although that will be cool. The demand for GPU is so high right now that I think most datacenters are at 100% utilisation.

Btw landing page does not bring much confidence this is serious. Might want to change it to communicate better and also to be attractive to "developers" I guess.

Post reply on HN