Live data from Hacker News

Why AI Infrastructure Startups Are Insanely Hard to Build

nextword.substack.com

101–110 of 190 posts

Re: Why AI Infrastructure Startups Are Insanely Hard to Build

#101
post #62
post #48

Earlier quoted context omitted.

We had the exact same problem before genAI became the next big thing. All the startups were selling generic fine tuning and labeling services both of which are super easy to build, and they didn't even work on our unique super high quality super high resolution 40TB dataset. Our problem was we had a real world problem and real data. All the startups were solving for imaginary problems and had no data.

Sounds like you need a consultancy and not a startup to solve your problem.

Probably the best play of the cycle if you're not Nvidia

Re: Why AI Infrastructure Startups Are Insanely Hard to Build

#102
post #33
post #27

Earlier quoted context omitted.

> We need a Dropbox or a Slack or an Instagram: something people love that makes their life easier or better. People seem to not mind ChatGPT or Claude and safe to say that a very large majority of AI products are using one of the APIs of those companies.

In my humble opinion, a chat interface (API or not) does not a product make. Not to mention that Llama is free and competitive with both (same with Mistral, heck the 7B model works great on my RTX 3080). If you started a company that blew up because you made a badass product (and let's say you used ChatGPT under the hood), you would just eventually train and deploy your own model because an LLM is not a product .

> In my humble opinion, a chat interface (API or not) does not a product make.

Well, you are humbly wrong then.

> You would just eventually train and deploy your own model because an LLM is not a product.

Hallucinations aren't exclusive to LLMs it seems.

Re: Why AI Infrastructure Startups Are Insanely Hard to Build

#103
post #91
post #82

Earlier quoted context omitted.

> We need a Dropbox or a Slack or an Instagram: something people love that makes their life easier or better. None of those three make my life better or easier: Dropbox -> We drop your data directly on S3 but give you worst security... Slack -> Being able to navigate our messy interface is an IQ test in itself... Instagram -> Only makes your life better if you have bikini posts to share....

Didn’t expect curlftpfs+svn to strike again in 2024.

Those who don't learn their history are doomed to repeat it...

For those interested, the first comment on the launch thread for Dropbox here on HN had very similar sentiments to belter...

https://news.ycombinator.com/item?id=8863

Re: Why AI Infrastructure Startups Are Insanely Hard to Build

#104
post #33

Earlier quoted context omitted.

In my humble opinion, a chat interface (API or not) does not a product make. Not to mention that Llama is free and competitive with both (same with Mistral, heck the 7B model works great on my RTX 3080). If you started a company that blew up because you made a badass product (and let's say you used ChatGPT under the hood), you would just eventually train and deploy your own model because an LLM is not a product .

> In my humble opinion, a chat interface (API or not) does not a product make. Well, you are humbly wrong then. > You would just eventually train and deploy your own model because an LLM is not a product. Hallucinations aren't exclusive to LLMs it seems.

We’re already seeing a lot of competition between LLMs. They are quickly becoming commodities. Margins will approach zero and the real value proposition will be with consumer products that extend beyond an .

Re: Why AI Infrastructure Startups Are Insanely Hard to Build

#105
Gen AI feels more and more like NFTs and blockchains, and overall, a lot like pre-2001-bubble (or more accurately post y2k).

A very exciting and expensive solution in search of an actual problem, that will ultimately find its way, commoditised, in a small niche, while adjacent technologies take the lead for productive use-cases.

Re: Why AI Infrastructure Startups Are Insanely Hard to Build

#106
I work for a foundational AI company. I guess we're technically AI infra. We're inherently "narrowly" focused since our origin (which was well before the recent hype in past 2-3 years).

Our customers are really the type of AI infra companies being talked about in this article. And yea, the new ones I work with everyday are often a dime a dozen. A revolving door of small startups trying to make the same general purpose AI infra targeting other traditional "boring enterprise infra" companies.

The ones that I'm seeing get the most traction, have the best products, and best chances of success have zeroed in on specific niches and sub-industries. (Think AI infra that helps B2B2B companies where that last "B" is like Roofing companies and the value provided is helping Roofing companies easily and drastically scale their outbound and inbound marketing and sales.)

The startups I work with that make me scratch my head are the ones trying to build "disruptive" AI infra that does nothing different, provides nothing special, other than potentially nice UI/UX, and is liable to have their lunch eaten by either natural iterations and improvements of our own services they essentially just white label, or some other incumbent.

To me, it's like trying to create a new company to compete against Walmart and Target on groceries because they're too massive scale to win against "a well tailored customer experience" but then forgetting Costco, Aldi's, Trader Joes, and Whole Foods exist. And why would any of those aforementioned companies feel the need to acquire you rather than casually crush you as they go about their business either ignoring you as you wither or taking your good ideas and incorporating them into their own offering?

It's not impossible, just has to make sense and even then a certain degree of "the stars aligning" is required. Which is why there inevitably can only be a small group of winners out of this massive sea of hopefuls.

And I of course can only shrug my shoulders if asked if the AI infra startup I work at is differentiated, necessary, and lucky enough to be at the finish line with the survivors at the end. (We're finding our PMF and potential road to incumbency mainly with two-ish markets: old and new school enterprise infra and non-tech Fortune 500 type of companies.)

Re: Why AI Infrastructure Startups Are Insanely Hard to Build

#107
post #24

Earlier quoted context omitted.

> Even OpenAI doesn't really have a product. They are making a ton of money off subscriptions.

Yes. Author here. OpenAI is at near 4bn ARR and growing (api plus SaaS)

Source?

Re: Why AI Infrastructure Startups Are Insanely Hard to Build

#108
post #32

Earlier quoted context omitted.

> VC pouring money in LLM infra is legitimately crazy to me. VC business model is throwing money at the wall and seeing what sticks. They love congratulating themselves on how smart they are but at the end of the day their overall returns trail S&P 500. They are salespeople and their job is to sell themselves to private capital on how smart and connected they are.

Does their return trail s&p 500? I guess there are some of them that are successful and some that aren't, but to be honest I've only heard about vc as people who on average have a very very high return. Now, it is very possible that's just survivor bias, but I would need to search for some data

Most of the funds, even the big ones, trail the overall market, and even the successful ones have difficulty maintaining a long track record of success.

The reason for the big pension funds and endowments to invest in VC is that it’s a bit counter cyclical. Also it’s a tiny pimple on the side of the PE sector overall.

You can see how marginal it is in the financial sector by going to an LP meeting — the big institutionals send kids — first year analysts — to attend because it isn’t that important.

Re: Why AI Infrastructure Startups Are Insanely Hard to Build

#109
post #91
post #82

Earlier quoted context omitted.

> We need a Dropbox or a Slack or an Instagram: something people love that makes their life easier or better. None of those three make my life better or easier: Dropbox -> We drop your data directly on S3 but give you worst security... Slack -> Being able to navigate our messy interface is an IQ test in itself... Instagram -> Only makes your life better if you have bikini posts to share....

Didn’t expect curlftpfs+svn to strike again in 2024.

[deleted]

Re: Why AI Infrastructure Startups Are Insanely Hard to Build

#110
post #91
post #82

Earlier quoted context omitted.

> We need a Dropbox or a Slack or an Instagram: something people love that makes their life easier or better. None of those three make my life better or easier: Dropbox -> We drop your data directly on S3 but give you worst security... Slack -> Being able to navigate our messy interface is an IQ test in itself... Instagram -> Only makes your life better if you have bikini posts to share....

Didn’t expect curlftpfs+svn to strike again in 2024.

[deleted]
Post reply on HN