Earlier quoted context omitted.
It's not clear to me that each new generation of models is going to be "that" much better vs cost. Anecdotally moving from model to model I'm not seeing huge changes in many use cases. I can just pick an older model and often I can't tell the difference... Video seems to be moving forward fast from what I can tell, but it sounds like the back end cost of compute there is skyrocketing with it raising other questions.
Locally run video models that are just as good as today’s closed models are going to be the watershed moment The companies doing foundational video models have stakeholders that don’t want to be associated with what people really want to generate But they are pushing the space forward and the uncensored and unrestricted video model is coming
Anthropic raises $13B Series F
131–140 of 661 posts
Re: Anthropic raises $13B Series F
#132why would nvidia not create their own foundational model?
Because Nvidia is making actual profit selling hardware to those who do, not hoping for a big payout sometime in the future. Different risk/reward model, different goals.
Re: Anthropic raises $13B Series F
#133The compute moat is getting absolutely insane. We're basically at the point where you need a small country's GDP just to stay in the game for one more generation of models. What gets me is that this isn't even a software moat anymore - it's literally just whoever can get their hands on enough GPUs and power infrastructure. TSMC and the power companies are the real kingmakers here. You can have all the talent in the w…
The wildest part is that the frontier models have a lifespan of 6 months or so. I don't see how it's sustainable to keep throwing this kind of money at training new models that will be obsolete in the blink of an eye. Unless you believe that AGI is truly just a few model generations away and once achieved it's game over for everyone but the winner. I don't.
And for the newcomers, the scale needs to be bigger than what the incumbents (Google and Microsoft) have as discretionary spending - which is at least a few billion per year. Because at that rate, those companies can sustain it forever and would be default winners. So I think yearly expenditure is going to be 20B year++
Re: Anthropic raises $13B Series F
#134Earlier quoted context omitted.
It's not clear to me that each new generation of models is going to be "that" much better vs cost. Anecdotally moving from model to model I'm not seeing huge changes in many use cases. I can just pick an older model and often I can't tell the difference... Video seems to be moving forward fast from what I can tell, but it sounds like the back end cost of compute there is skyrocketing with it raising other questions.
We do seem to be hitting the top of the curve of diminishing returns. Forget AGI - they need a performance breakthrough in order to stop shoveling money into this cash furnace.
Re: Anthropic raises $13B Series F
#135Earlier quoted context omitted.
The trustee's reports on FTX's internal processes were damning. Even they had held their Anthropic on the way up, who's to say their internal FTT ledger and black holes in the Alameda books would not have eclipsed that? The issue wasn't that crypto markets in general were down at that point; the issue was they were doing frauds.
the frauds were stopped by Sam going to jail. There was still money left by liquidating, which in hindsight was a very poor timing.
If the liquidators had perfect hindsight, they'd be trading their own money. Not cleaning up other people's messes.
Their job is to be responsible and follow procedure.
Re: Anthropic raises $13B Series F
#136The compute moat is getting absolutely insane. We're basically at the point where you need a small country's GDP just to stay in the game for one more generation of models. What gets me is that this isn't even a software moat anymore - it's literally just whoever can get their hands on enough GPUs and power infrastructure. TSMC and the power companies are the real kingmakers here. You can have all the talent in the w…
It's not clear to me that each new generation of models is going to be "that" much better vs cost. Anecdotally moving from model to model I'm not seeing huge changes in many use cases. I can just pick an older model and often I can't tell the difference... Video seems to be moving forward fast from what I can tell, but it sounds like the back end cost of compute there is skyrocketing with it raising other questions.
Re: Anthropic raises $13B Series F
#137Earlier quoted context omitted.
If I had a dime for every time I see this kind of hot take, I'd be able to buy an H200 with that. A man looks at economics. Understands nothing. Thinks it must be all fake and made up. He must be so smart for seeing it through!
It is all fake and made up, and the numbers are detached from the real world, but it's not like the market doesn't know that. Btw there's a decentish board game called Modern Art based around the pricing of art with no intrinsic value.
Re: Anthropic raises $13B Series F
#138Earlier quoted context omitted.
It's still bleeding money with no profitability in sight, niche product or household name
same again for Amazon, Tesla, Uber and others. Then they began making billions. Anthropic is not a niche anymore though. Same for Chat GPT.
Re: Anthropic raises $13B Series F
#139Earlier quoted context omitted.
It's not clear to me that each new generation of models is going to be "that" much better vs cost. Anecdotally moving from model to model I'm not seeing huge changes in many use cases. I can just pick an older model and often I can't tell the difference... Video seems to be moving forward fast from what I can tell, but it sounds like the back end cost of compute there is skyrocketing with it raising other questions.
The raw model scale is not increasing by much lately. AI companies are constrained by what fits in this generation of hardware, and waiting for the next generation to become available. Models that are much larger than the current frontier are still too expensive to train, and far too expensive to serve them en masse. In the meanwhile, "better data", "better training methods" and "more training compute" are the main w…
Does this apply to Google that is using custom built TPUs while everyone else uses stock Nvidia?
Re: Anthropic raises $13B Series F
#140The compute moat is getting absolutely insane. We're basically at the point where you need a small country's GDP just to stay in the game for one more generation of models. What gets me is that this isn't even a software moat anymore - it's literally just whoever can get their hands on enough GPUs and power infrastructure. TSMC and the power companies are the real kingmakers here. You can have all the talent in the w…