Live data from Hacker News

Nvidia Grace CPU

nvidia.com

81–90 of 197 posts

Re: Nvidia Grace CPU

#81
post #56

Maybe it's just me, but it's just cool to see the CPU market competitive again for the first time since the late 90s.

I wonder why Intel never had a really good go at GPU's? It seems strange, given the demand.

Intel produced good, as in "cheap and always working", integrated GPUs. For great many tasks, they are adequate. I'm not a gamer, and if I needed to run some ML stuff, my laptop's potential discrete GPU won't be much help anyway.

Re: Nvidia Grace CPU

#82
post #77

Earlier quoted context omitted.

It was the most affordable DVD player. I think Sony owned patents on some DVD player tech? Same with PS4/5 and Blu Ray if I'm remembering correctly

This was also kind of the case with the PS3. Its sales weren't fantastic at release, partially because of its... $600 (?) price tag. But even at that price, at its release, it was one of the cheapest ways to get a Blu-ray player, and many people bought it for that.

If memory serves, there was less than 1 game per PS3 sold at launch.

Re: Nvidia Grace CPU

#83
post #77

Earlier quoted context omitted.

It was the most affordable DVD player. I think Sony owned patents on some DVD player tech? Same with PS4/5 and Blu Ray if I'm remembering correctly

This was also kind of the case with the PS3. Its sales weren't fantastic at release, partially because of its... $600 (?) price tag. But even at that price, at its release, it was one of the cheapest ways to get a Blu-ray player, and many people bought it for that.

Not just a Blu-ray player, but one that is guaranteed to be able to play practically all blu-ray discs as long as Blu ray discs are made or the console hardware fails.

Sony pushed updates to the firmware. Most commodity Blu ray players don't have an (easy) way to update.

Re: Nvidia Grace CPU

#84

This leads me to wonder about the microprocessor shortage. So many computing devices such as Nvidia Jetson and Raspberry Pi are simply not available anywhere. I wonder what's he point of bringing out new products when existing products can't be purchased? Won't the new products also simply not be available?

What? They are sold out, not "can't be purchased".

What's the difference? If they are perpetually sold out, then they cannot be purchased.

Re: Nvidia Grace CPU

#85
I think we're all missing the forest because all the cores are in the way:

The contention on that memory means that only segregated non-cooporative as in not "joint parallel on the same memory atomic" will scale on this hardware better than on a 4-core vanilla Xeon from 2018 per watt.

So you might aswell buy 20 Jetson Nanos and connect them over the network.

Let that sink in... NOTHING is improving at all... there is ZERO point to any hardware that CAN be released for eternity at this point.

Time to learn JavaSE and roll up those sleves... electricity prices are never coming down (in real terms) no matter how high the interest rate.

As for GPUs, I'm calling it now: nothing will dethrone the 1030 in Gflops/W in general and below 30W in particular; DDR4 or DDR5, doesn't matter.

Memory is the latency bottleneck since DDR3.

Please respect the comment on downvote principle. Otherwise you don't really exist; in a quantum physical way anyway.

Re: Nvidia Grace CPU

#86
post #84

Earlier quoted context omitted.

What? They are sold out, not "can't be purchased".

What's the difference? If they are perpetually sold out, then they cannot be purchased.

There is constant production and deliveries being made, just no standing inventory.

Re: Nvidia Grace CPU

#87
post #81

Earlier quoted context omitted.

I wonder why Intel never had a really good go at GPU's? It seems strange, given the demand.

Intel produced good, as in "cheap and always working", integrated GPUs. For great many tasks, they are adequate. I'm not a gamer, and if I needed to run some ML stuff, my laptop's potential discrete GPU won't be much help anyway.

Also, Intel has a history of producing or commissioning open-source drivers for its GPU. I like the peace of mind I get from knowing I'm not going to have to fight dirty for the privilege of getting my own GPU to do the work I bought it to perform.

Re: Nvidia Grace CPU

#88

This leads me to wonder about the microprocessor shortage. So many computing devices such as Nvidia Jetson and Raspberry Pi are simply not available anywhere. I wonder what's he point of bringing out new products when existing products can't be purchased? Won't the new products also simply not be available?

The products don't get produced in order. The high value products get priority and continuously bump out low value chips like those on the RPI. Not sure what the cost of this Grace chip is but it looks to be targeting high value users so it gets priority. Notice how there is no shortage of chips for iPhones, because Apple just buys the capacity at whatever cost it takes.

Re: Nvidia Grace CPU

#89

What are people's experience of developing with NVIDIA? I know what Linus thinks: https://www.youtube.com/watch?v=iYWzMvlj2RQ

I like CUDA, that stuff works and is rewarding to use. The only problem is the tons and tons of hoops one must jump to use it in servers. Because a server with a GPU is so expensive, you can't just rent one and have it running 24x7 if you don't have work for it to do, so you need a serverless or auto-scaling deployment. That increases your development workload. Then there is the matter of renting a server with GPU; that's still a bit of a specialty offering. Until the other day, even major cloud providers (i.e. AWS and Google) offered GPUs only in certain datacenters.

Re: Nvidia Grace CPU

#90

This leads me to wonder about the microprocessor shortage. So many computing devices such as Nvidia Jetson and Raspberry Pi are simply not available anywhere. I wonder what's he point of bringing out new products when existing products can't be purchased? Won't the new products also simply not be available?

The products don't get produced in order. The high value products get priority and continuously bump out low value chips like those on the RPI. Not sure what the cost of this Grace chip is but it looks to be targeting high value users so it gets priority. Notice how there is no shortage of chips for iPhones, because Apple just buys the capacity at whatever cost it takes.

Though, there is a shortage of m1 MacBooks. Is it really because they are low value (margin?) products relative to iPhone? I'm not sure.
Post reply on HN