Live data from Hacker News

Corporate America Has Suddenly Decided to Stop Blowing Money on AI

wsj.com

21–30 of 94 posts

Re: Corporate America Has Suddenly Decided to Stop Blowing Money on AI

#21
post #8

Yet OpenAI and Anthropic combined are somehow making $100B in revenue...

Yea, that tracks. I just looked it up and AWS made ~130bn.

Given how big AI is, and how those two are pretty much the only players (in comparison aws is 1/3 market share), that seems about right.

It's a far cry from "nobody's going to be writing any code, and ai will do all the things in 6 months".

Re: Corporate America Has Suddenly Decided to Stop Blowing Money on AI

#22
post #6

Nowadays I don't understand why you wouldn't use a (more-or-less) nearby hosted Chinese model. You have the security, you have roughly the same performance, and you have an order of magnitude more bang for your buck. Bonus point : the models aren't censored and won't refuse to answer in the middle of your coding session.

Is censorship not an issue with Chinese models?

It's about whether or not their censorship affects you. Their models are censored for the Chinese audience. Meanwhile Anthropic OpenAI etc models are censored for the American audience.

So by default you'd be better with one of the Chinese models if you're American.

Re: Corporate America Has Suddenly Decided to Stop Blowing Money on AI

#24
post #6

Nowadays I don't understand why you wouldn't use a (more-or-less) nearby hosted Chinese model. You have the security, you have roughly the same performance, and you have an order of magnitude more bang for your buck. Bonus point : the models aren't censored and won't refuse to answer in the middle of your coding session.

Is censorship not an issue with Chinese models?

As long as you’re not asking it for help discussing a trip to tiananmen square. “Censor” is probably the wrong word. Chinese models are “censored” but much less restricted. For all intents and purposes, Chinese models are less “censored” / “restricted” / “limited”.

Re: Corporate America Has Suddenly Decided to Stop Blowing Money on AI

#25

Never spent more than 40 euros per month on the base plans for Claude and OpenAI. And I’m doing 10x the amount of work I did before. As long as my computer isn’t running at night as well, I’m not upgrading.

Same experience. There was a period where Claude was burning through it's limits very quickly (~2 months ago?), but other than that, the $20/month plan is enough to do loads of work+personal coding. I am curious what workflows people are using that requires the expensive plans, and what they're building/maintaining.

Re: Corporate America Has Suddenly Decided to Stop Blowing Money on AI

#26
post #6

Nowadays I don't understand why you wouldn't use a (more-or-less) nearby hosted Chinese model. You have the security, you have roughly the same performance, and you have an order of magnitude more bang for your buck. Bonus point : the models aren't censored and won't refuse to answer in the middle of your coding session.

How does it connect to let's say, vscode. I would love to move away from Claude, but it's really easy to set up. Just add a vscode extension

Re: Corporate America Has Suddenly Decided to Stop Blowing Money on AI

#27
post #6

Nowadays I don't understand why you wouldn't use a (more-or-less) nearby hosted Chinese model. You have the security, you have roughly the same performance, and you have an order of magnitude more bang for your buck. Bonus point : the models aren't censored and won't refuse to answer in the middle of your coding session.

Is censorship not an issue with Chinese models?

I'd say no more than in Usanian models?

Re: Corporate America Has Suddenly Decided to Stop Blowing Money on AI

#28
post #6

Nowadays I don't understand why you wouldn't use a (more-or-less) nearby hosted Chinese model. You have the security, you have roughly the same performance, and you have an order of magnitude more bang for your buck. Bonus point : the models aren't censored and won't refuse to answer in the middle of your coding session.

Is censorship not an issue with Chinese models?

Not for coding or office work which is the majority of use cases.

Re: Corporate America Has Suddenly Decided to Stop Blowing Money on AI

#29
post #2

We’re at a small startup and we mix models. But mainly just between the major providers. I wouldn’t say it’s as much to avoid spending money as it is to get the maximum benefit out of different capability spectrums.

Well, you can say that all day long but realistically would your “small startup” even exist if your firm was charged Enterprise rates or the actual compute costs and denied access to capital to subsidize your users? It’s a fair question.

The other, more complex one would be “what benefit” are you talking about? Clearly there are some differences in performance regarding speed and token cost, but industry news indicates not a single one has solved the inherent hallucination problem which makes the reliability akin to an untreated schizophrenic research or coding assistant.

Re: Corporate America Has Suddenly Decided to Stop Blowing Money on AI

#30

If you sell "AI" maybe, if you sell products that happen to use LLMs to provide services previously not possible, the money still exists in my experience. When I first heard of tokenmaxxing, I thought it had to be a joke. But no, it turned out to be a widespread phenomenon. I still cannot believe that was a thing. What I keep saying in internal meetings is: "I am so glad these people are this bad at deploying these t…

It’s a forcing function. If you are running a company you need to be in control. Some engineers dngaf or will sandbag everything. We did a 90 day push and identified where we found value and where we didn’t. Our tools teams really upped their game, more than expected, and it would have been unlikely to have been funded if they tried to justify the budget as an individual initiative. There’s a spectrum of people - som…

Exactly. People misunderstand the point of the tokenmaxxing time period, it was to force people to use AI so as to not have them stuck in their way, as some people are, and then to evaluate how it can help the company.
Post reply on HN