> Nvidia uses a new NVLink Switch System with 36 NVLink switches to tie together 256 GH200 Grace Hopper chips and 144 TB of shared memory into one cohesive unit that looks and acts like one massive GPU Is there more information about this?
Nvidia's next DGX supercomputer is all about generative AI
11–17 of 17 posts
Re: Nvidia's next DGX supercomputer is all about generative AI
#12https://www.anandtech.com/show/18877/nvidia-grace-hopper-has...
Re: Nvidia's next DGX supercomputer is all about generative AI
#13After Nvidia is done selling crypto mining and AI generating hardware, maybe they can also focus a bit on their PC gaming side-hustle and throw us a bone in the form of a mid-range GPU that can run AAA games and doesn't cost both kidneys, that would be great.
Re: Nvidia's next DGX supercomputer is all about generative AI
#14After Nvidia is done selling crypto mining and AI generating hardware, maybe they can also focus a bit on their PC gaming side-hustle and throw us a bone in the form of a mid-range GPU that can run AAA games and doesn't cost both kidneys, that would be great.
It's more like that AAA devs always target high-end GPUs.
Re: Nvidia's next DGX supercomputer is all about generative AI
#15> Nvidia uses a new NVLink Switch System with 36 NVLink switches to tie together 256 GH200 Grace Hopper chips and 144 TB of shared memory into one cohesive unit that looks and acts like one massive GPU Is there more information about this?
Re: Nvidia's next DGX supercomputer is all about generative AI
#16After Nvidia is done selling crypto mining and AI generating hardware, maybe they can also focus a bit on their PC gaming side-hustle and throw us a bone in the form of a mid-range GPU that can run AAA games and doesn't cost both kidneys, that would be great.
Right now AI/datacenter is outbidding the gamers for constrained fab capacity. Until that changes, recent generation nodes won't come down in price and neither will gamer GPU's.
Allow me to doubt this. Intel Arc A770 16GB has a TSMC manufactured die but it's much larger in size that an RTX 3060 12GB sells for way less, also at a (small) profit.
Re: Nvidia's next DGX supercomputer is all about generative AI
#17Earlier quoted context omitted.
Right now AI/datacenter is outbidding the gamers for constrained fab capacity. Until that changes, recent generation nodes won't come down in price and neither will gamer GPU's.
>Right now AI/datacenter is outbidding the gamers for constrained fab capacity. Allow me to doubt this. Intel Arc A770 16GB has a TSMC manufactured die but it's much larger in size that an RTX 3060 12GB sells for way less, also at a (small) profit.
I don't think either of these are intended for the datacenter? So this would be a price comparison between two gaming / general purpose GPUs?
The A770 is going for $350ish, is manufactured on a higher tech node (TSMC N6), and has a die size of 406mm square.
The 3060 is going for $250ish, was manufactured on two lower tech nodes (originally Samsung 8nm then moved to TSMC 7nm), and has a die size of 392.5.
I'm not sure the description "much larger in size" makes sense here. If anything it seems like pricing follows node-area costs.