Earlier quoted context omitted.
Both OpenAI and Anthropic have billing caps… who doesn’t?
Google Vertex
https://aistudio.google.com/spend ? Monthly spend cap
OpenRouter raises $113M Series B
31–40 of 279 posts
Re: OpenRouter raises $113M Series B
#32Aren’t they totally dependent on the good will of the model providers?
Re: OpenRouter raises $113M Series B
#33It took me quite a while to come round to OpenRouter. Originally I didn't understand why anyone would put a proxy between them and an LLM, but it actually adds some quite significant value: 1. By far the lowest friction way to support and try out all the models. 2. They offer billing caps! Most model providers still don't do this [EDIT: maybe they do, see reply comment], but if you're going to run anything in public…
Good points. The easy experimentation factor is helpful for development, though I would gently encourage everyone to migrate to the 1st party APIs for pricing at scale. OpenRouter is also a good place to find free LLM access with a catch: You should expect that any inputs and outputs are going into someone's training database. Clearly anyone who can pay should be using paid models with privacy protections, but the fr…
It’s interesting all the focus on opt-out from training. Sometimes I worry there is an intentional focus on that so people don’t think about the other ways the company might be profiting off our data. Like I pay for Anthropic and they don’t train on that but are they selling my “anonymized” usage data in some other way?
Re: OpenRouter raises $113M Series B
#34It took me quite a while to come round to OpenRouter. Originally I didn't understand why anyone would put a proxy between them and an LLM, but it actually adds some quite significant value: 1. By far the lowest friction way to support and try out all the models. 2. They offer billing caps! Most model providers still don't do this [EDIT: maybe they do, see reply comment], but if you're going to run anything in public…
Out of interest, why OpenRouter over a free option like Cloudflare’s AI gateway or another paid option like Vercel’s — any specific benefit to OpenRouter you’ve found, or just first you used that’s good enough?
[deleted]
Re: OpenRouter raises $113M Series B
#35Is the Open in OpenRouter the same as in Open AI? I couldn’t find any repository or hosted code. Thought it'd be a open source, self hostable tool with a cloud offering but seems its just the latter?
tbh anyone can rig up something like openrouter in a few nights with claude code.
its just a proxy
Re: OpenRouter raises $113M Series B
#36As someone who uses OpenRouter extensively (and wrote an unintentional adjacent PR piece a few days ago: https://news.ycombinator.com/item?id=48317294 ), it's definitely the best way to try out new models without fiddling with each providers distinct APIs which is becoming a recurring concern as of late. That said, I don't understand the people who use something a full agentic backbone with expensive models like Clau…
>> it's definitely the best way to try out new models without fiddling with each providers distinct APIs which is becoming a recurring concern as of late
Why not... Cursor?
Re: OpenRouter raises $113M Series B
#37Every tech company now seems to be invested in every AI startup.
Re: OpenRouter raises $113M Series B
#38> ... with participation from NVentures (NVIDIA's venture capital arm), ServiceNow Ventures, MongoDB Ventures, Snowflake Ventures, Databricks Ventures ... Are tech companies FOMOing so hard that they're now all running AI venture arms themselves instead of you know, developing their own products? Except for NVIDIA who needs to keep pumping the bubble I didn't expect the others.
> ServiceNow Ventures
Well, at least for them, investing into AI is actually developing their own product. The push to replace "Actually Indians" [1] with LLMs is huge because large Western companies want to save even the pittances they're paying Indian body shops.
[1] for those OOTL: https://www.reddit.com/r/ProgrammerHumor/comments/1l3rpow/ac...
Re: OpenRouter raises $113M Series B
#39It took me quite a while to come round to OpenRouter. Originally I didn't understand why anyone would put a proxy between them and an LLM, but it actually adds some quite significant value: 1. By far the lowest friction way to support and try out all the models. 2. They offer billing caps! Most model providers still don't do this [EDIT: maybe they do, see reply comment], but if you're going to run anything in public…
Another neat thing is, they publish hourly caching states for ALL model/provider combinations. I did some research on it to come up with a provider tiers list and found a bunch of open-source 3rd party hosts are simply trash tier https://dirac.run/posts/cache-hit-rates-agents
Re: OpenRouter raises $113M Series B
#40[dead]