Earlier quoted context omitted.
Does that come with the model weights? Not really relevant then to their announced products is it?
What model weights is the Google's A3 supercomputer supposed to come with? It's an announcement of new hardware available in GCP.
Google Launches AI Supercomputer Powered by Nvidia H100 GPUs
151–160 of 182 posts
Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs
#152Earlier quoted context omitted.
It is unknown how much pricing power NVDA has. Can they 3x the price of everything And still sell out?
Why not? They seem to be a lot of leeway before any specific company will find it cheaper to design their own chips, or even to move to AMD (ROCm is not as well supported). Perhaps someone like OpenAI has both the expertise and incentive to do so, but not many others.
I'm not saying you are wrong or right, btw
Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs
#153Earlier quoted context omitted.
I wish that humanity gets to harvest static energy one day, so that everyone is able to run the experiments required in large-scale deep learning research, not only a handful of deep pocketed organizations.
You likely would not want to live in a future where every individual could each 'harvest' several gigajoules of 'static energy'.
Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs
#154Earlier quoted context omitted.
A significant part of the 2021 peak may be explained by the crypto craze from which Nvidia benefited greatly and which has almost completely vanished since. Thinking about it, it’s hard to believe how fast the hype cycle moved on from crypto. Only 1-2 years ago every media person, influencer, YouTuber, tweeter etc. were talking about/selling/shilling some kind of crypto, and now all of it seems to have moved on to AG…
Cryptocurrencies still had high barriers for entry for the public at large - not really a means of payment, and high risk as an investment. Generative AI is used by millions, has very low barrier for entry (it's even free!) and most importantly does not require a network effect so can be valuable immediately.
Surprisingly, they left that out of their sales pitch.
With LLMs everyone+dog is coming out of the woodwork to let people know that it will lead to the extinction of the species.
Not that I don’t think generative AI is a lot more useful than crypto and deserves (some of) the hype. The problem is the hucksters jumping on the hypetrain to continue their $new_hotness grift.
Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs
#155Earlier quoted context omitted.
It's more than just that: for the money, their consumer GPUs don't compete in compute tasks (especially inference/training) and their Linux compute drivers are a pile of steaming garbage on consumer hardware. It's really interesting/depressing to watch as they've done a nice job of supplying good open source graphics drivers. They really seem to be lacking something at a leadership level in terms of understanding GPU…
I'd think their leadership is aware. Likely they are just picking their battles to be in strategic areas where they'll capture the most revenue to resource-investment. AMD has a lot of catching up to do and they cannot compete on all fronts at once.
Usually when I see this, it symptomatic of major organizational dysfunction of some type. One time, I was in a firm where 100% of the energy was spent on quarterly objectives for some executive bonus pay structure. No one cared if the organization lived or died, since there were always other jobs.
Nothing AMD is doing in the GPU space is aligned with long-term survival or competitiveness.
Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs
#156Earlier quoted context omitted.
Gaming is a huge chunk of their revenue, around $2B in recent quarters, with datacenter around $3.5B. Despite the AI hype, Nvidia’s datacenter revenue was down QoQ and only up 10% YoY. It remains to be seen if the growth trajectory has changed meaningfully over the last quarter, because the stock is priced for massive earnings growth while their revenue and earnings have been actually shrinking. We’ll find out on the…
>Gaming is a huge chunk of their revenue, around $2B in recent quarters, with datacenter around $3.5B. Is it? I remember hearing they didn't make much money from their consumer GPU products a few years back. This was one of the reasons why they tried to clamp down so aggressively on people using desktop GPUs for computing. They had made a number of driver changes which restricted the capabilities of anything but the…
Not that big of a deal these days and I doubt they’d make it so someone couldn’t take an off the shelf GPU and play around with llamas.
Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs
#157Earlier quoted context omitted.
The word TPU isn't even mentioned here. A sentence that reads "I am going to eat nothing but vegetables from now on" doesn't mention meat, but you can infer that I won't eat meat again from the sentence. A sentence that says Google are going all in on nVidea GPUs for AI doesn't need to mention TPUs to convey information about their future either.
Sure. That's why I mentioned multiple ways in which the article could have been relevant to TPUs, which you chose not to quote. But it didn't have any of those either. The sentence you're offering up as a demonstration is just something you made up that does not appear in the article. If anything, this just reinforces the point I was making. There is nothing at all in the article supporting this narrative. So, where…
Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs
#158Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs
#159Kinda feels like the main thing google launches is waiting lists.
And my main worry is: are they just going to cancel the new thing that my company invested six months and $250,000 of engineering time integrating with…
I don't know of a single GCP product that's been shut down, although I could be missing something. But their track record for GCP is, I think, what you would want a cloud provider's record to be.
(I should mention that I work for GCP. But this is just based on my own memory.)
Re: Google Launches AI Supercomputer Powered by Nvidia H100 GPUs
#160Earlier quoted context omitted.
Whereas NVIDIA is basically just “we’re an AI company now”.
No, they've become a general compute company selling pickaxes for whatever the current goldrush tends to be. Now it's AI, yesterday it was crypo-currencies, the day before is was PC games and video editing. They've been trying to push their GPUs as CPU alternatives everywhere especially in the datacenters where their presence grew since the acquisition of Mellanox. They also tried to acquire ARM, to squeeze both Inte…