Just to put this in context. If every company did this, all over the world, with that same limit, we are talking about something around $45B monthly in revenue for all AI companies to share.
Uber's $1,500/month AI limit is a useful signal for AI tool pricing
401–410 of 819 posts
Re: Uber's $1,500/month AI limit is a useful signal for AI tool pricing
#402Earlier quoted context omitted.
That's just Simon Willison since LLMs came out. It's glaringly obvious that he's a paid shill.
oh come on, a paid shill? Simon is very fascinated by AI and at times he can be a little too optimistic but he is generally balanced and his perspective evolves over time which can be seen in his writing. Nerd who loves nerd things a little too much? Sure. Paid shill by Big LLM? Nah.
The issue is he’s not actually balanced at all. I’ve never seen him say anything negative about an AI product.
Re: Uber's $1,500/month AI limit is a useful signal for AI tool pricing
#403Earlier quoted context omitted.
Chips age and fail with age. You can check hot-carrier injection, bias-temperature instability and electromigration as they are the main aging mechanisms. All if these are a linear function of time but exponentieal of temperature. 90-100C these chips are running at are really tough, so they are likely to fail at couple of percent to 10% range in 2-3 years depending on the margins they have in the design. The solder j…
If those don't go the caps and coils will eventually.
those are easy and cheap to replace
Re: Uber's $1,500/month AI limit is a useful signal for AI tool pricing
#404How many more months do we need to wait, until big companies realize that flash models work just fine if you: 1) Don't ask LLMs for big changes 2) Review everything and point them in the right direction Large models still suck at big changes, they produce questionable architecture and you still have to review the code, if your project is serious enough. The codebase quickly become a mess, if you don't pay enough atte…
Is your argument that $1500 / mo is too much? Why would the engineering team not be more rigorous in their model selection given a constraint?
If you had a business task to complete that was only possible with ai and it cost you >$1500/month of work, how long would you have to delay the task so that it's cheaper long run to buy hardware and do local models?
$1,500/mo * 14 months = $21,000.
If local models are 14mo behind as many in HN say it may be profitable to just wait. Maybe just spend a few hundred dollars of your tokens and buy hardware piece by piece.
Re: Uber's $1,500/month AI limit is a useful signal for AI tool pricing
#405Earlier quoted context omitted.
sounds like planned depreciation on Intel's part, they definitely do not design server grade chips for longevity since that would harm their own revenues
It was not planned depreciation, as many chips were failing even before 2 years and this impacted not only PC Builders and Gamers, but also some server infra providers too. This was simply poor design, it took Intel ages to really figure out what went wrong and "resolve" it. It cost them far more than it made.
They didn't replace all the chips like with the FDIV bug though. What did it cost them? Only reputation?
Re: Uber's $1,500/month AI limit is a useful signal for AI tool pricing
#406Lock-in / switching costs are increasingly concerning me. I am using Claude for a good year now and have been accumulating so much "knowledge" in there by now. If Claude became less favorable in terms of price/performance in the future, that would worry me. I've started to think about a distributed solution, where my storage is detached from the inference, but currently Claude is still the way to go for me. Wondering…
What knowledge? Unless you work in some obscure domain, chances are that any general "knowledge" Claude has "learned" is already public data somewhere. If you don't believe me, launch Codex and immediately start working on the same project (s). You might discover that all the knowledge accumulated means almost nothing.
Claude Code definitely remembers things about you. For just one of the more obvious examples: I was recently asking it to make some suggestions on software alternatives, and part of the answer included (paraphrased) "While a hosted service may be attractive due to your small ops team size, your experience with hosting Linux container-based services puts this squarely in the realm of an option for you." My prompt mentioned nothing about this.
This isn't something that is public knowledge, in the sense that you mean it.
Just earlier today it asked me if I wanted to create a jira ticket for something I asked it about doing. My prompt mentioned nothing about jira.
If you use Claude Code, you might want to take a look at the "auto memories" files that it creates. See "/memory" for some more information.
Re: Uber's $1,500/month AI limit is a useful signal for AI tool pricing
#407Earlier quoted context omitted.
Most sane US companies will disallow use of cloud-based Chinese AI providers, because everything including code, data, PII, etc is being sent to them.
Deepseek has some models in Bedrock. There is definitely a huge market for a "good enough" model running within the country of the company
> Deepseek has some models in Bedrock.
Just looked into it, seems like at most they have just 3.2, not 4: https://aws.amazon.com/bedrock/pricing/
Looking around their catalogue more, most of their models seem quite outdated, aside from the OpenAI and Anthropic ones (but those get more expensive). I wouldn't willingly pick Bedrock and would instead throw money at OpenRouter, that has both a bunch of providers, as well as almost any model for you to try.
Re: Uber's $1,500/month AI limit is a useful signal for AI tool pricing
#408I think the main thing companies should try to understand is avoiding the use of 'claude -p'.
I definitely have written a goal file, and then just ran claude in a loop over the goal in order to 'token max'... why not? I'm doing research and have some clear KPIs where research into all kinds of techniques / tuning can improve the results. I can spend my budget on a "experiment with blah blah blah to improve blah blah" or give it a list of things to try that I know will take awhile.
Its no problem hitting hundreds of $ of API spend while sitting at a computer with 3 monitors have 6 windows of useful claude code interactive sessions, while working on 2 or 3 projects and using worktrees, and it's a little weird when you hit your limit by 2 o'clock and have to wait for token budgets to reset; god forbid, I manually edit code... which I did do for the first time in months.
You can also start to generate a lot of token spend if you do something like "hey make me a stylized slide deck using internal skill / agent XYZ based on commits A through C", which as an engineer, makes presentations building much less painful.
This uber limit is not high compared to the big SV companies.
Re: Uber's $1,500/month AI limit is a useful signal for AI tool pricing
#409Earlier quoted context omitted.
One aspect Paul Kedrosky mentioned recently is the concept of „duration mismatch“. The price per token goes down over time (either because the AI vendor reduces due to competition pressure, or because customers are now incentivized to use older cheaper models). But datacenters are financed through debt, with the assumption their revenue increases over time. Quoting him: „[AI vendors are] paying for a fixed cost with…
Current AI datacenter/model development investment rate is roughly 1T/year. That's a lot. But the US economy is 33T/year. So the investment pays back (roughly) over ten years if, each year, the AI investments increase overall productivity by 0.6%, assuming the AI companies can capture half of the value of that productivity gain. > „[AI vendors are] paying for a fixed cost with a depreciating commodity“ That's just a…
These are similar numbers to the dotcom bubble. With GDP growth and the percentage of productivity AI contributes staying the same in this scenario this requires regular gains in revenue or growth. If things just stumble, like with most datacenters going unbuilt the bubble will pop.
Re: Uber's $1,500/month AI limit is a useful signal for AI tool pricing
#410Just to put this in context. If every company did this, all over the world, with that same limit, we are talking about something around $45B monthly in revenue for all AI companies to share.
45 billion / 1500 $ is 30 million workers. How did we arrive at 30 million?