Inference is profitable. Companies lose money because: 1. Training is expensive. Not just compute but getting the data, researchers salaries etc 2. You have to keep producing new models to ensure people use your inference and there seems to be no end to this. So they have to pour more billions to keep the cycle going on 3. People salary and other admin cost are not that high compared to 1 and 2.
So? How does it change the equation? Nobody is going to charge "inference price" for model usage.
AI subscriptions are a ticking time bomb for enterprise
51–60 of 426 posts
Re: AI subscriptions are a ticking time bomb for enterprise
#52I think I'm going to puke if I see one more "It's not X. It's Y." phrase or the word "load-bearing" used metaphorically.
Re: AI subscriptions are a ticking time bomb for enterprise
#53Article is mistaken these subs are not available to businesses. Companies are paying much closer to API prices. The strategy is to get you accustomed to infinite tokens on your personal sub and bet that behavior transfers to work.
Re: AI subscriptions are a ticking time bomb for enterprise
#54I think I'm going to puke if I see one more "It's not X. It's Y." phrase or the word "load-bearing" used metaphorically.
Re: AI subscriptions are a ticking time bomb for enterprise
#55Re: AI subscriptions are a ticking time bomb for enterprise
#56Article is mistaken these subs are not available to businesses. Companies are paying much closer to API prices. The strategy is to get you accustomed to infinite tokens on your personal sub and bet that behavior transfers to work.
Re: AI subscriptions are a ticking time bomb for enterprise
#57Brad Gerstner confirmed that tokens aren't being sold at a loss. Whatever the formula, API + Subscription split, the companies are making a profit on net token sale. They maybe running at loss after all the salaries and stock comp, but tokens are in profit now.
It's like witnessing a rocket using the most powerful engine on Earth then once it escaped orbit turn off the engine and said "It is flying without power!". Yes, sure, right now it is ... but that's NOT how it got here. There are trillions invested to recoup and at most billions in sales. It doesn't add up to tokens making a profit any time soon.
But if all the AI companies stopped training new models, they would all instantly become profitable (and stick around)
The thing that makes them unprofitable, is having to compete (which means training models). If / when enough companies exit the market, the cost to compete goes down and you end up in an equilibrium
Re: AI subscriptions are a ticking time bomb for enterprise
#58I think I'm going to puke if I see one more "It's not X. It's Y." phrase or the word "load-bearing" used metaphorically.
Re: AI subscriptions are a ticking time bomb for enterprise
#59I think I'm going to puke if I see one more "It's not X. It's Y." phrase or the word "load-bearing" used metaphorically.
Re: AI subscriptions are a ticking time bomb for enterprise
#60Article is mistaken these subs are not available to businesses. Companies are paying much closer to API prices. The strategy is to get you accustomed to infinite tokens on your personal sub and bet that behavior transfers to work.
You can also do everything metered. There are multiple ways to buy.