71–79 of 79 posts
What software will those Nvidia servers run? Are they creating their own software stack or working with one or more partners?
They have a Ubuntu derivative called DGX OS, that they use on their current lines.
Earlier quoted context omitted.
Are TPU’s a bad business model?
Customers are increasingly wary of building their business on someone else's land because they've seen it happen too many times that once you're locked in the price goes up, or the company who is now your only viable supplier decides to enter your own market. And at least if anyone can buy the hardware you'll have your own or have multiple competing providers you can lease it from. If you can only lease it and only f…
Earlier quoted context omitted.
That's one way to arrive at an IBM Mainframe like model I guess. It'll work until you can buy comparable expansion cards for open systems (if history is any guide).
Yep, tech is incredibly circular. Once Nvidia gets there is highly probable that "disruptive" competition will apear due to mere desire/pressure for more freedom and options (and knowing NVDA, also costs).
Nvidia already sells servers? What I don't really get, is that Nvidia is worth like $4.5T on $130B revenue. If they want to sell servers, why don't they just buy Dell or HP? If they want CPUs want not buy AMD, Qualcomm, Broadcom or TI? (I know they got blocked on their ARM attempt before the AI boom) Their revenue is too low to support their value, shouldn't they use this massive value to just buy up companies to up…
But nVidia already sells servers (NVL72), and CPUs (Grace). Why buy a bunch of overlapping companies? And no sane regulator on the planet will allow them to takeover AMD, Qualcomm, or Broadcom.
Earlier quoted context omitted.
Are TPU’s a bad business model?
Customers are increasingly wary of building their business on someone else's land because they've seen it happen too many times that once you're locked in the price goes up, or the company who is now your only viable supplier decides to enter your own market. And at least if anyone can buy the hardware you'll have your own or have multiple competing providers you can lease it from. If you can only lease it and only f…
Meanwhile, at the hardware level, TPU's provide some competition for NVidia.
Nvidia already sells servers? What I don't really get, is that Nvidia is worth like $4.5T on $130B revenue. If they want to sell servers, why don't they just buy Dell or HP? If they want CPUs want not buy AMD, Qualcomm, Broadcom or TI? (I know they got blocked on their ARM attempt before the AI boom) Their revenue is too low to support their value, shouldn't they use this massive value to just buy up companies to up…
But nVidia already sells servers (NVL72), and CPUs (Grace). Why buy a bunch of overlapping companies? And no sane regulator on the planet will allow them to takeover AMD, Qualcomm, or Broadcom.
https://www.npr.org/2025/04/09/nx-s1-5356480/nvidia-china-ai...
Earlier quoted context omitted.
Customers are increasingly wary of building their business on someone else's land because they've seen it happen too many times that once you're locked in the price goes up, or the company who is now your only viable supplier decides to enter your own market. And at least if anyone can buy the hardware you'll have your own or have multiple competing providers you can lease it from. If you can only lease it and only f…
Lock-in is a valid concern, but on the other hand, for many apps, it seems like this can be fairly easily mitigated? If you can swap in a different LLM, I don't think it matters if it's running on Google TPU's or NVidia? Meanwhile, at the hardware level, TPU's provide some competition for NVidia.
Can anyone comment on wafer-scale systems, multiple equivalent chips on an entire wafer? Seems like where things are heading?
Only Cerebras is doing wafer-scale. It seems to be working for them but no one is copying them. The minimum unit (one wafer) costs millions and it's not clear how good their multi-wafer scaling is.
[1]: https://www.tomshardware.com/tech-industry/tsmcs-wafer-prici...