Live data from Hacker News

Ryzen Threadripper Pro 3995WX Spotted

guru3d.com

111–120 of 170 posts

Re: Ryzen Threadripper Pro 3995WX Spotted

#111

Earlier quoted context omitted.

The underlying reason is that at around 32GB the JVM internally shifts from 32bit pointers for HEAP management to 64bit. The feature is called compressed object pointers (compressed oops) The increased pointer size uses substantial amounts of RAM, a reasonable estimate is that you need at least ~45GB to not have a loss in total available HEAP. Also, GC cycles get longer the more HEAP you have. However, some workloads…

Lacking value types, larger pointers will probably penalize JVM programs more than their peers.

While there are no JEP 169 style Value Types, you can still layout your data in a way that significantly reduces the number of pointers. For example using parallel arrays of primitives. It's not as clean, but it is one mitigation.

Re: Ryzen Threadripper Pro 3995WX Spotted

#112
post #12

I feel like 64 cores is getting rather close to a tipping point: What workloads are so massively parallel that they can use 64 cores of x86 but can’t use the thousands of CUDA cores on a Quadro card? I’m sure right now there are workloads that just need particular x86 instructions, but that feels like a temporary problem. Am I wrong about that being a temporary problem (that would feel frustrating)? Are these cores j…

GPUs are good for split join parallelism. They don't even really have real branching and you mostly have to loop a constant amount of times. Meanwhile any data without dependencies can be dealt with on a CPU core.

Not only that, huge amounts of software could use a lot more concurrency if it was structured differently. Even a web browser (to my knowledge) doesn't split up DOM layout, parsing individual files, decompressing images, decompressing video etc. into separate threads for each file.

Re: Ryzen Threadripper Pro 3995WX Spotted

#113
post #85
post #12

I feel like 64 cores is getting rather close to a tipping point: What workloads are so massively parallel that they can use 64 cores of x86 but can’t use the thousands of CUDA cores on a Quadro card? I’m sure right now there are workloads that just need particular x86 instructions, but that feels like a temporary problem. Am I wrong about that being a temporary problem (that would feel frustrating)? Are these cores j…

> What workloads are so massively parallel that they can use 64 cores of x86 but can’t use the thousands of CUDA cores on a Quadro card? Building software, for one. C compilers and python interpreters don't run on a GPU. Lots of stuff doesn't run on a GPU. In fact in practice the only things that run on a GPU are the tiny handful of known subproblems that the industry has collectively decided are "GPU problems". Like…

.. and chrome and your IDE. They're very bursty, but those bursts can go smoothly over many cores or slowly over a few.

Re: Ryzen Threadripper Pro 3995WX Spotted

#114

It’s unclear to me what eight channel memory actually means, I’m not used to seeing that mentioned in casual architecture overviews. What’s the benefit of that? Is that something that a programmer must explicitly take advantage of, or is that just an automatic part of the CPU?

More channels allow more memory bandwidth, though actual performance gain is marginal unless the data being processed has very strict spatial locality (e.g. fluid dynamics simulations), most other workloads are more constrained by cache.

The real reason for adding more memory channels to a general purpose CPU is actually to increase the maximum amount of memory per node. A few years ago, workstation and server platforms often allowed 3 or more DIMMs per channel with performance declining sharply with memory density. Since then both AMD and Intel have limited each channel to 2 DIMMs and increase the number of memory channels from 4 to 6/8 to make up for the loss.

While more memory channels do enable better performance scaling, it has also made the CPU socket more complex and fragile than ever: The TRX40 socket has 4094 pins and literally requires the CPU to be bolted down using a torque wrench to ensure good contact.

Re: Ryzen Threadripper Pro 3995WX Spotted

#115
post #12

I feel like 64 cores is getting rather close to a tipping point: What workloads are so massively parallel that they can use 64 cores of x86 but can’t use the thousands of CUDA cores on a Quadro card? I’m sure right now there are workloads that just need particular x86 instructions, but that feels like a temporary problem. Am I wrong about that being a temporary problem (that would feel frustrating)? Are these cores j…

The impending doom that is WASM will mean that 'dynamic' and 'interactive' adverts will use all these cores.

wasm can only do what javascript can already do, but faster. What specifically do you think wasm will change?

Re: Ryzen Threadripper Pro 3995WX Spotted

#116

Earlier quoted context omitted.

The article mentions support for up to 2 TB of RAM.

True, and 3990x supports more than 256, but not in practice (motherboards)

The (bit of) article mentioned 2T, but the thing that was interesting was the 8 channel memory. My current TR4 boards are doing quad, so 2 banks of 4 slots. Sounds like a single set of 8... so wonder if this is a potential BIOS update on the sTR4 or if there is a new chipset on route?

Re: Ryzen Threadripper Pro 3995WX Spotted

#117
post #12

I feel like 64 cores is getting rather close to a tipping point: What workloads are so massively parallel that they can use 64 cores of x86 but can’t use the thousands of CUDA cores on a Quadro card? I’m sure right now there are workloads that just need particular x86 instructions, but that feels like a temporary problem. Am I wrong about that being a temporary problem (that would feel frustrating)? Are these cores j…

Give me 1 core for the Chrome shell and then 1 core per tab :)

Re: Ryzen Threadripper Pro 3995WX Spotted

#118
post #37

A lot of people question the usefulness of 64+ cores on a workstation CPU. It is true that audio/visual tools like Adobe After Effects stop benefiting from extra cores at around 32 cores. [1] But if you want to simulate production workloads on your machine say with Apache Spark or Flink, you are in the prime. You couple that CPU with 256+ GB memory, and you can start exploring the bottlenecks in your batch algorithms…

I think we will be contending with this sort of barrier for a while on desktop software. 32 cores used to be massively parallel 10 years ago, 15 years ago it was nuts to think that we'd have that in a get-it-from-Newegg offering.

Massively parallel operations take a different focus on your MPI/bus/queue architecture than we've ever needed for desktop software. BUT I think what we've already seen is that in general purpose computing there will always be someone ready to consume resources as they are available.

Both feet don't move at the same time, one takes a step and then the other.

Re: Ryzen Threadripper Pro 3995WX Spotted

#119
post #8

Earlier quoted context omitted.

The 64-core 3990x is MSRP $4000. I’d expect this new fangled 3995WX to be that much or more.

CPU and motherboard prices aren't really relevant since RAM is so expensive. And only real reason for getting this instead of 3990x is that you need e.g. 1 terabyte of RAM. https://www.amazon.com/Tech-12x128GB-2933MHz-PC4-23400-288-P...

Saying a $4k USD CPU's price is irrelevant because 128GB DIMMs are expensive is absurd. There is no reason to think everyone who buys one is going to be spending $12k on RAM.

Re: Ryzen Threadripper Pro 3995WX Spotted

#120

Earlier quoted context omitted.

Also, GPU has VERY limited memory and no virtual memory.

> VERY limited memory and no virtual memory This is incorrect.

Compared to 2-4TB max in a 2 socket server system, the 16 or 32GB/card you get on a GPU is pretty small.

The other issue is loading that memory - PCIe 4 is still the transfer time bottleneck between GPU and main memory.

Post reply on HN