Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild

servethehome.com

Post reply on HN
Print view View original

111–120 of 188 posts

Re: Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild

#116

Post by latchkey »

CapeTheory wrote: post #104
latchkey wrote: post #22

Earlier quoted context omitted.

This is something I'd like to offer via my business (Hot Aisle) at some point in the near future. Right now, we are just getting started and focused on MI300x, but the long term goal is to offer any type of high end compute that people are willing to rent.

What USP are you aiming for, to differentiate from the many companies who have tried and failed to offer some form of HPCaaS over the last 10-15 years?

Great question! I'm going to answer it the only way I know how... with a bit of a story of the history of things. Sorry if this bores you.

The problem I realized over a year ago was that nobody had hourly rental access to high end AMD GPUs. In addition, access to high end Nvidia was equally difficult. I signed up for a CoreWeave account, put in my credit card and was told a few weeks later that my account was not approved.

In effect, the only way to get access to super high end compute, was to be involved in HPC and that requires connections. At the time, we also didn't even know if AMD was going to seriously adopt AI as a strategy.

My view was that there were actually two problems, lack of general access and that everyone was putting all their eggs into a single basket. Mostly because of that lack of access, and because AMD was lacking a great developer flywheel story.

I spent August to December building a business plan, closing funding, forming the business, hiring my co-founder full time, securing data center space, securing direct relationships with vendors, and designing the system we were going to deploy. There are a million other little details in there, but this is long enough as it is.

Oct/Nov of last year rolls around and suddenly AMD has changed their tune. Lisa Su doubles down. Dec 6th, MI300x rolls out. We made our first PoC order in January, received it in March. It just goes to show how cutting edge and how long all of this takes. 3 more small (not hyperscaler) businesses sprung up during that time, all offering effectively the same product. We went to the data center, deployed our PoC and about 2 weeks later, we had our first customer onboarded. I call all of that validation, and was able to secure further funding based on it.

To answer your question, I'm not sure that I need a specific USP. The demand for compute isn't going down. If I have a product that people want, and I can offer them ethical, honest, truthful, great service around that product. All based on decades of experience. Can't that be enough? Myself and my investors believe so.

Post reply on HN