I think this is a minor speed bump and VC’s believe that cost of inference will decrease over time and this is a gold rush to grab market share while cost of inference declines. I don’t think they got it right and the market share and usage grew faster than inference dropped, but inference costs will clearly drop and these companies will eventually be very profitable. Reality is that startups like this assume moore’s…
I think if these companies are gambling their future on COGS going down, that’s a gamble they’re going to lose.