Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Threadripper 7000 Storm Peak CPU Surfaces with 64 Zen 4 Cores

tomshardware.com

Post reply on HN
Print view View original

51–58 of 58 posts

Re: Threadripper 7000 Storm Peak CPU Surfaces with 64 Zen 4 Cores

#51

Post by frognumber »

bitL wrote: post #15
frognumber wrote: post #14

I recently ran some machine learning benchmarks on CPU versus GPU. The gap for a multicore CPU was much smaller than I expected. I, for one, am excited by a 64-core CPU in a way I wouldn't have been a year ago. Between Hugging Face, Stable Diffusion, and Whisper, I'm using ML workloads a lot more. Being able to do so: * with a standard instruction set * with open-source software * with my full system RAM * without ha…

Inference or training? I think with full training you are out of luck with CPUs, the gap is much bigger. 64c TR could only get to roughly 1TFlops.

Fair enough. My benchmark was inference. I care about inference much more than training for most of what I do.

Re: Threadripper 7000 Storm Peak CPU Surfaces with 64 Zen 4 Cores

#52

Post by fomine3 »

jakuboboza wrote: post #2

Anyone is using 64 cores besides Linus :) I'm much more excited for 7900x on 12 cores rather than 64 cores. But I understand the limited amount of people that needs this power on desktop can also be excited.

I thought whether Torvalds or Sebastian

Re: Threadripper 7000 Storm Peak CPU Surfaces with 64 Zen 4 Cores

#53

Post by bluescarni »

lostmsu wrote: post #43
bluescarni wrote: post #42

Earlier quoted context omitted.

Those are Tensor flops, the numbers for the Zen CPU are "general-purpose" flops (sometimes called "vector flops" in marketing material). The vector flops for the 3090Ti are 33 TFlops for single precision, 0.5 TFlops for double precision. So, 16x faster than the 5950x in single precision, 2x slower for double precision. At almost 3x the price and >4x the power consumption. Of course, if all you care about is AI, then…

I think you missed that this whole discussion is in the context of deep learning, therefore your comment does not apply. It is 30x slower that 3090Ti for that purpose.

My initial comment was correcting a factually inaccurate statement regarding CPU performance.

It is you who barged into the thread with unrelated GPU performance numbers, but whatever :)

Re: Threadripper 7000 Storm Peak CPU Surfaces with 64 Zen 4 Cores

#54

Post by lostmsu »

bluescarni wrote: post #53
lostmsu wrote: post #43

Earlier quoted context omitted.

I think you missed that this whole discussion is in the context of deep learning, therefore your comment does not apply. It is 30x slower that 3090Ti for that purpose.

My initial comment was correcting a factually inaccurate statement regarding CPU performance. It is you who barged into the thread with unrelated GPU performance numbers, but whatever :)

You are missing forest for the trees.

Here's the comment I assume you are allegedly trying to "correct":

> with full training you are out of luck with CPUs, the gap is much bigger. 64c TR could only get to roughly 1TFlops

1TFlops is not the main part of that statement, and it is qualified with "roughly" which I suppose is not too far from the truth in the context. And the context is "training ... the gap is much bigger", and in this case "much" is at least 30x even with the updated number.

Re: Threadripper 7000 Storm Peak CPU Surfaces with 64 Zen 4 Cores

#55

Post by anotherhue »

lakomen wrote: post #23

I'm reminded of ... that ... Was it power cpu or risc? The one with the 1024 cpu cores. I did a search but can't find it. Essentially 1024 cores soc server, affordable. Compared to that 64 cores sounds rather unimpressive. IMHO.

https://en.wikipedia.org/wiki/Connection_Machine

Re: Threadripper 7000 Storm Peak CPU Surfaces with 64 Zen 4 Cores

#56

Post by imtringued »

lakomen wrote: post #23

I'm reminded of ... that ... Was it power cpu or risc? The one with the 1024 cpu cores. I did a search but can't find it. Essentially 1024 cores soc server, affordable. Compared to that 64 cores sounds rather unimpressive. IMHO.

Having 64 powerful cores sounds more impressive than 1024 weak cores.

Also why even mention that 1024 core CPU instead of upmem. 128 cores per DIMM slot and up to 2560 cores in a single machine and they are fast precisely because they are directly attached to memory with a total memory bandwidth of 2.56TB/s.

Re: Threadripper 7000 Storm Peak CPU Surfaces with 64 Zen 4 Cores

#57

Post by imtringued »

bitL wrote: post #49
revanx_ wrote: post #24

Imho if cpu manufacturers figure out how to slap a large cache on the same die (something like amd 3D V-Cache but much more) we may actually see graphic cards become obsolete in favor of software rendering.

GPU is a bandwidth monster, CPU is a latency monster. You can't have both on the same silicon.

Every console SoC designed by AMD proves you wrong.

Re: Threadripper 7000 Storm Peak CPU Surfaces with 64 Zen 4 Cores

#58

Post by bitL »

imtringued wrote: post #57
bitL wrote: post #49

Earlier quoted context omitted.

GPU is a bandwidth monster, CPU is a latency monster. You can't have both on the same silicon.

Every console SoC designed by AMD proves you wrong.

APU has two parts, there is no GPUCPU hybrid in the same functional package, they are separate modules.
Post reply on HN