my highlights of this report: https://news.smol.ai/issues/25-12-04-openrouter
State of AI: An Empirical 100T Token Study with OpenRouter
51–60 of 97 posts
Re: State of AI: An Empirical 100T Token Study with OpenRouter
#52I like to see stats like that, but I find it very concerning that OpenRouter don't mind inspecting its user/customer data without shame. Even if you pretend that the classifier respect anonymity, if I pay for the inference, I would expect that it would be a closed tube with my privacy respected. If at least it was for "safety" checks, I don't like that but I would almost understand, now it is for them to have "market…
They explicitly give you a discount if you opt in to allowing your data to be used for (anonymized) analytics. That’s pretty fair imho.
Cynical take: they could look at everyone and give a discount for optics.
I'd feel a lot better if "OpenRouter" were open source.
Re: State of AI: An Empirical 100T Token Study with OpenRouter
#53I am a person who wants to maintain a distance from the AI-hype train, but seeing a chart like this [1], I can't help think that we are nowhere near the peak. The weekly token consumption keeps on rising, and it's already in trillions, and this ignores a lot of consumption happening directly through APIs.
Nvidia could keep delivering record-breaking numbers, and we may well see multiple companies hit six, seven, or even eight trillion dollars in market cap within a couple of years. While I am skeptical of claims like AI will make programming obsolete, but it’s clear that the adoption is still going like crazy and it's hard to anticipate when the plateau happens.
[1]: https://openrouter.ai/state-of-ai#open-vs_-closed-source-mod...
Re: State of AI: An Empirical 100T Token Study with OpenRouter
#54According to the report, 52% of all open-source AI is used for *roleplaying*. They attribute it to fewer content filters and higher creativity. I'm pretty surprised by that, but I guess that also selects for people who would use openrouter
Or maybe it’s just strange classification. I see a lot of prompts on the internet looking like “act as a senior xxx expert with over 15 years of industry experience and answer the following: [insert simple question]” I hope those are not classified as “roleplaying” the “roleplay” here is just a trick to get better answer from the model, often in a professional setting that has nothing to do with creative writing of N…
I strongly bet that this is it.
Re: State of AI: An Empirical 100T Token Study with OpenRouter
#55I am a person who wants to maintain a distance from the AI-hype train, but seeing a chart like this [1], I can't help think that we are nowhere near the peak. The weekly token consumption keeps on rising, and it's already in trillions, and this ignores a lot of consumption happening directly through APIs. Nvidia could keep delivering record-breaking numbers, and we may well see multiple companies hit six, seven, or e…
When it's as cheap as 5 cents per million tokens I don't see "trillions" as being a particularly large number. Even at the most expensive level($120/1M for 5 Pro) 100 trillion tokens is only like $12 billion dollars.
Re: State of AI: An Empirical 100T Token Study with OpenRouter
#56Very interesting how Singapore ranks 2nd in terms of token volume. I wonder if this is potentially Chinese usage via VPN, or if Singaporean consumers and firms are dominating in AI adoption. Also interesting how the 'roleplaying' category is so dominant, makes me wonder if Google's classifier sees a system prompt with "Act as a X" and classifies that as roleplay vs the specific industry the roleplay was intended to s…
Almost certainly VPN traffic. Most major LLMs block both China and Hong Kong (surprisingly, not the other way around), so Singapore ends up being the fastest nearby endpoint that isn't restricted.
Re: State of AI: An Empirical 100T Token Study with OpenRouter
#57Very interesting how Singapore ranks 2nd in terms of token volume. I wonder if this is potentially Chinese usage via VPN, or if Singaporean consumers and firms are dominating in AI adoption. Also interesting how the 'roleplaying' category is so dominant, makes me wonder if Google's classifier sees a system prompt with "Act as a X" and classifies that as roleplay vs the specific industry the roleplay was intended to s…
Almost certainly VPN traffic. Most major LLMs block both China and Hong Kong (surprisingly, not the other way around), so Singapore ends up being the fastest nearby endpoint that isn't restricted.
Why do major LLMs block china? Isn't that a potentially huge market for them?
Re: State of AI: An Empirical 100T Token Study with OpenRouter
#58Earlier quoted context omitted.
Almost certainly VPN traffic. Most major LLMs block both China and Hong Kong (surprisingly, not the other way around), so Singapore ends up being the fastest nearby endpoint that isn't restricted.
Why do major LLMs block china? Isn't that a potentially huge market for them?
I'm not sure, but my guess is that it's due to pressure (or perceived pressure) from the U.S. government.
Re: State of AI: An Empirical 100T Token Study with OpenRouter
#59I like to see stats like that, but I find it very concerning that OpenRouter don't mind inspecting its user/customer data without shame. Even if you pretend that the classifier respect anonymity, if I pay for the inference, I would expect that it would be a closed tube with my privacy respected. If at least it was for "safety" checks, I don't like that but I would almost understand, now it is for them to have "market…
>I would expect that it would be a closed tube with my privacy respected Lol hahaha
Yeah, welcome to "AI".
Re: State of AI: An Empirical 100T Token Study with OpenRouter
#60According to the report, 52% of all open-source AI is used for *roleplaying*. They attribute it to fewer content filters and higher creativity. I'm pretty surprised by that, but I guess that also selects for people who would use openrouter
Or maybe it’s just strange classification. I see a lot of prompts on the internet looking like “act as a senior xxx expert with over 15 years of industry experience and answer the following: [insert simple question]” I hope those are not classified as “roleplaying” the “roleplay” here is just a trick to get better answer from the model, often in a professional setting that has nothing to do with creative writing of N…
OpenRouter classifies content by the app that's used to interact with the llm.
https://openrouter.ai/docs/app-attribution