The compute moat is getting absolutely insane. We're basically at the point where you need a small country's GDP just to stay in the game for one more generation of models. What gets me is that this isn't even a software moat anymore - it's literally just whoever can get their hands on enough GPUs and power infrastructure. TSMC and the power companies are the real kingmakers here. You can have all the talent in the w…
Just in case, can they be repurposed for bitcoin mining? :) Edit: for the curious, no. An H100 costs about ~25k and produces $1.2/day mining bitcoin. Without factoring in electricity.
Anthropic raises $13B Series F
141–150 of 661 posts
Re: Anthropic raises $13B Series F
#142The compute moat is getting absolutely insane. We're basically at the point where you need a small country's GDP just to stay in the game for one more generation of models. What gets me is that this isn't even a software moat anymore - it's literally just whoever can get their hands on enough GPUs and power infrastructure. TSMC and the power companies are the real kingmakers here. You can have all the talent in the w…
Re: Anthropic raises $13B Series F
#143The compute moat is getting absolutely insane. We're basically at the point where you need a small country's GDP just to stay in the game for one more generation of models. What gets me is that this isn't even a software moat anymore - it's literally just whoever can get their hands on enough GPUs and power infrastructure. TSMC and the power companies are the real kingmakers here. You can have all the talent in the w…
In this imaginary timeline where initial investments keep increasing this way, how long before we see a leak shutter a company? Once the model is out, no one would pay for it, right?
Well who does the inference at the scale we're talking about here? That's (a key part of) the moat.
Re: Anthropic raises $13B Series F
#144I feel like the money itself makes less and less sense these days. It's just numbers that are becoming increasingly detached from the real world
* I’m an equal opportunity critic of comments that are indistinguishable from people yelling into the void with whatever pops into their head. So yes, I’m extremely critical of this very human tendency that isn’t helpful.
Re: Anthropic raises $13B Series F
#145Re: Anthropic raises $13B Series F
#146Substitute fiber and routers for GPUs and this starts to look familiar.
Re: Anthropic raises $13B Series F
#147Earlier quoted context omitted.
Alphabet 2024 revenue: 350 billions dollars Anthropic 2024 revenue: 1 billion dollars Unreasonable doesn’t even start to capture it. Anthropic being worth 10% of Alphabet is beyond insane.
So all it takes is Anthropic 35x-ing their revenue once they start selling ad spots? That sounds pretty reasonable to me. Right now nobody wants to be the first to offer advertising in LLM services, but LLM conversation history provides a wealth of data for ad targeting. And in more permissive jurisdictions you can have the LLM deliver ads organically in the conversation or just shift the opinions and biases of the m…
Re: Anthropic raises $13B Series F
#148Earlier quoted context omitted.
It's not clear to me that each new generation of models is going to be "that" much better vs cost. Anecdotally moving from model to model I'm not seeing huge changes in many use cases. I can just pick an older model and often I can't tell the difference... Video seems to be moving forward fast from what I can tell, but it sounds like the back end cost of compute there is skyrocketing with it raising other questions.
Locally run video models that are just as good as today’s closed models are going to be the watershed moment The companies doing foundational video models have stakeholders that don’t want to be associated with what people really want to generate But they are pushing the space forward and the uncensored and unrestricted video model is coming
Re: Anthropic raises $13B Series F
#149The compute moat is getting absolutely insane. We're basically at the point where you need a small country's GDP just to stay in the game for one more generation of models. What gets me is that this isn't even a software moat anymore - it's literally just whoever can get their hands on enough GPUs and power infrastructure. TSMC and the power companies are the real kingmakers here. You can have all the talent in the w…
When you consider where most of that money ends up (Jensen &co), it's bizarre nobody can really challenge their monopoly - still.
Re: Anthropic raises $13B Series F
#150Impressive round but it seems unlikely this game can go on much longer before something implodes. Given the amount of cash you need to set of fire to stay relevant it’s becoming nearly impossible for all but a few players to stay competitive, but those players have yet to demonstrate a viable business model. With all these models converging, the big players aren’t demonstrating a real technical innovation moat. Every…
This ignores differential quality, efficiency, partnerships, and lots more.