I'm more interested in what normal folks are running at home. What are your builds?
Google Launches AI Supercomputer Powered by Nvidia H100 GPUs
31–40 of 182 posts
Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs
#32So this is why Nvidia isn't lowering the price on the GPUs despite them sitting on the shelves and not selling. They make enough money from customers in the data center and supercomputer businesses that gaming is just a small market.
I bought a desktop in New York City a month ago with a Nvidia RTX 4090 card at Best Buy - 4090 being the most powerful Nvidia card Best Buy had in stock. At that time (a month ago) there were several desktops with this card in stock around the city, and I bought the one I wanted (if I had more time my purchase might have been different).
Looking right now - I don't see any unbundled Nvidia RTX 4090 cards for sale at Best Buy in New York City that you can go and pick up today. I don't see any desktops with 4090 cards that you can pick up today. I do see one Best Buy in New York City has one laptop with a 4090 card.
Looking at Best Buy in Los Angeles - I see one desktop with a 4090 for sale in West LA that can be picked up today. I don't see any unbundled 4090 cards for sale or laptops with 4090 cards.
I don't know if Nvidia lower end GPUs are sitting on shelves and not selling, but it doesn't look like Nvidia's higher end GPUs are sitting on shelves and not selling.
Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs
#33Kinda feels like the main thing google launches is waiting lists.
Quote of the year
Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs
#34I'm more interested in what normal folks are running at home. What are your builds?
2x 3090 but just getting started with fine tuning so I’m not sure how far I can push it
Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs
#35I'm more interested in what normal folks are running at home. What are your builds?
Honestly it's a $79 Lonovo 3 Chromebook running a Gcloud A3 virtual workstation over 5G from the golf course ;)
Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs
#36So can we train now 10t or 100t LLM models? I mean assuming that the dataset is large enough
Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs
#37Kinda feels like the main thing google launches is waiting lists.
The Gmail waiting list was one of the most legendary waiting lists. Anyone else remember inviting people to Google Docs?
Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs
#38Does this mean Google is giving up on TPUs?
TPUs were supposed to be their unfair advantage in the cloud ML/DL space. But from what I've experienced, and have heard from other engineers, there's always some subtle incompatibility with TPUs that requires modifying the training/eval scripts. I wonder why they didn't try to polish the rough edges with Pytorch, et al.
If they're admitting TPUs aren't their competitive advantage, then why not sell it to other hosting providers, or hell, even directly to ML scientists and enthusiasts? They'll finally get economies of scale, and take business (and mind share) away from NVidia's monopoly.
Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs
#39Going Slightly Off Topic. This is why Leading Edge Node will continue to be well funded. Consumer Electronics ( Mainly Smartphone ) Silicon usage has been the main push behind the development of Pure Play leading edge foundry in the past 10 years. Despite the predicted / expected drop of Smartphone sales, considering the potential shown by ChatGPT or Bard, GPU or Wafers dedicated for AI will continue to be in demand…
Can you elaborate on the supposed “wonky physics” that goes on when things get small? I’ve seen it thrown around that 3nm is “almost” the smallest size that can be made before different classes of physical errors are introduced due to the extremely small distance between gates.