131–140 of 182 posts
Earlier quoted context omitted.
they have to pay for the power and the staff to set them up/manage it
I wish that humanity gets to harvest static energy one day, so that everyone is able to run the experiments required in large-scale deep learning research, not only a handful of deep pocketed organizations.
Should we buy Nvidia stock then? The greatest technological advancement in recent years critically depends on the hardware from a single company with no competition. yet Nvidia stock is still below its 2021 peak. How so?
https://www.cerebras.net/andromeda/ https://tenstorrent.com/grayskull/
Earlier quoted context omitted.
It's more than just that: for the money, their consumer GPUs don't compete in compute tasks (especially inference/training) and their Linux compute drivers are a pile of steaming garbage on consumer hardware. It's really interesting/depressing to watch as they've done a nice job of supplying good open source graphics drivers. They really seem to be lacking something at a leadership level in terms of understanding GPU…
Whereas NVIDIA is basically just “we’re an AI company now”.
They've been trying to push their GPUs as CPU alternatives everywhere especially in the datacenters where their presence grew since the acquisition of Mellanox. They also tried to acquire ARM, to squeeze both Intel and AMD out of the CPU market completely.
I hate what they've done to the PC gamers, but as a company trying to grow in more markets and make even more money, they've executed insanely well strategically, leaps ahead of AMD.
AMD should be gifting their GPUs by the dozens to the most prolific Open Source contributors if they want a piece of the cake. Their lack of access to CUDA is really harming them badly.
https://www.anandtech.com/show/18721/ces-2023-amd-instinct-m...
Earlier quoted context omitted.
Then sell it for more. Just give me a price. Or let me bid on it. Or, don't announce it like it's launched until it's usable.
If your demand for this is so urgent, it sounds like you want your own hardware. Here you go, that’ll be 38k for just the H100: https://serverevolution.com/nvidia-900-21010-0000-000.html
Not really relevant then to their announced products is it?
Technical detail: > Each A3 supercomputer is packed with 4th generation Intel Xeon Scalable processors backed by 2TB of DDR5-4800 memory. But the real "brains" of the operation come from the eight Nvidia H100 "Hopper" GPUs, which have access to 3.6 TBps of bisectional bandwidth by leveraging NVLink 4.0 and NVSwitch.
So it's not a super-computer, its a single server with 8 GPUs. Hilarious branding.
Earlier quoted context omitted.
After the big hype of it yes. And the models are not really available, they've got a little playground for some unspecified model.
There are models available in GCP under Vertex AI category, I'm using the API to access them.
Side smaller complaint - whats the point in these wait-lists if they never tell me when stuff actually launched.
Compared to decades ago now everyone carries a supercomputer.
It is interesting how the definition of a supercomputer changes over time. Compared to decades ago now everyone carries a supercomputer.