Given how larger non-mobile chips are jumping to the LPDDR standard what is the point of having a separate DDR standard? Is there something about LPDDR5 that makes upgradable dimms not possible?
[deleted]
Nvidia Grace CPU
31–40 of 197 posts
Re: Nvidia Grace CPU
#32How likely is it that one of AWS / GCP / Azure will deploy these? Nvidia has some relationships there for the A100 chips.
Pretty sure they all will, they all already have the past gens of these things and it's a simple upgrade.
Re: Nvidia Grace CPU
#33Interesting that this has 7x the cores of a M1 Ultra, but only 25% more memory bandwidth. Those will be some thirsty cores!
Re: Nvidia Grace CPU
#34Anyone have a sense for how much these will cost? Is this more akin to the Mac Studio that costs 4k or an A100 gpu that costs upward of 30k? Looking for an order of magnitude.
The top-end datacenter GPUs have been slowly creeping up from $5k a few generations back to about $15k for the A100's now. So this one will probably continue the trend, probably to $20k or maybe $30k but probably not beyond that.
Re: Nvidia Grace CPU
#35This is interesting. So without actually targeting a specific Cloud / server market for their CPU, which often ends with a chicken and egg problem with HyperScaler making their own Design or Chip. Nvidia manage to enter the Server CPU market leveraging their GPU and AI workload. All of a sudden there is real choice of ARM CPU on Server. ( What will happen to Ampere ? ) The LPDDR5X used here will also be the first to…
I wonder if Apple also intends to introduce ECC LPDDR5 on the Mac Pro. Other than additional expansion, I’m struggling to see what else they can add to distinguish it from the Mac Studio.
Re: Nvidia Grace CPU
#36This is interesting. So without actually targeting a specific Cloud / server market for their CPU, which often ends with a chicken and egg problem with HyperScaler making their own Design or Chip. Nvidia manage to enter the Server CPU market leveraging their GPU and AI workload. All of a sudden there is real choice of ARM CPU on Server. ( What will happen to Ampere ? ) The LPDDR5X used here will also be the first to…
I wonder if Apple also intends to introduce ECC LPDDR5 on the Mac Pro. Other than additional expansion, I’m struggling to see what else they can add to distinguish it from the Mac Studio.
More cores and more RAM is really kind of it. I guess PCIe but I’m kind of wondering if they’ll do that.
Re: Nvidia Grace CPU
#37How likely is it that one of AWS / GCP / Azure will deploy these? Nvidia has some relationships there for the A100 chips.
AWS+Azure (and I believe GCP) installed prev advances, and are having huge GPU shortages in general... so probably!
An interesting angle here is these support partitioning even better than in the A100's. AFAICT, the cloud vendors are not yet providing partitioned access, so everyone just exhausts worldwide g4dn capacity for smaller jobs / devs / etc. But partitioning can solve that...
Re: Nvidia Grace CPU
#38Interesting that this has 7x the cores of a M1 Ultra, but only 25% more memory bandwidth. Those will be some thirsty cores!
The M1 memory bandwidth is mostly for the GPU but Grace does not include an (on-chip) GPU.
Re: Nvidia Grace CPU
#39soooo... would something like this be a viable option for a non-mac desktop similar to the 'mac studio' ? def seems targeted at the cloud vendors and large labs... but it'd be great to have a box like that which could run linux.
Nvidia Orin would be a better fit for an ARM desktop/laptop but Nvidia seemingly isn't interested in that market.
Re: Nvidia Grace CPU
#40Interesting that this has 7x the cores of a M1 Ultra, but only 25% more memory bandwidth. Those will be some thirsty cores!
https://twitter.com/benbajarin/status/1506296302971334664?s=...
396MB of on-chip cache… (198MB per die)
That’s a significant part of it too.