Earlier quoted context omitted.
The underlying reason is that at around 32GB the JVM internally shifts from 32bit pointers for HEAP management to 64bit. The feature is called compressed object pointers (compressed oops) The increased pointer size uses substantial amounts of RAM, a reasonable estimate is that you need at least ~45GB to not have a loss in total available HEAP. Also, GC cycles get longer the more HEAP you have. However, some workloads…
Lacking value types, larger pointers will probably penalize JVM programs more than their peers.
Ryzen Threadripper Pro 3995WX Spotted
111–120 of 170 posts
Re: Ryzen Threadripper Pro 3995WX Spotted
#112I feel like 64 cores is getting rather close to a tipping point: What workloads are so massively parallel that they can use 64 cores of x86 but can’t use the thousands of CUDA cores on a Quadro card? I’m sure right now there are workloads that just need particular x86 instructions, but that feels like a temporary problem. Am I wrong about that being a temporary problem (that would feel frustrating)? Are these cores j…
Not only that, huge amounts of software could use a lot more concurrency if it was structured differently. Even a web browser (to my knowledge) doesn't split up DOM layout, parsing individual files, decompressing images, decompressing video etc. into separate threads for each file.
Re: Ryzen Threadripper Pro 3995WX Spotted
#113I feel like 64 cores is getting rather close to a tipping point: What workloads are so massively parallel that they can use 64 cores of x86 but can’t use the thousands of CUDA cores on a Quadro card? I’m sure right now there are workloads that just need particular x86 instructions, but that feels like a temporary problem. Am I wrong about that being a temporary problem (that would feel frustrating)? Are these cores j…
> What workloads are so massively parallel that they can use 64 cores of x86 but can’t use the thousands of CUDA cores on a Quadro card? Building software, for one. C compilers and python interpreters don't run on a GPU. Lots of stuff doesn't run on a GPU. In fact in practice the only things that run on a GPU are the tiny handful of known subproblems that the industry has collectively decided are "GPU problems". Like…
Re: Ryzen Threadripper Pro 3995WX Spotted
#114It’s unclear to me what eight channel memory actually means, I’m not used to seeing that mentioned in casual architecture overviews. What’s the benefit of that? Is that something that a programmer must explicitly take advantage of, or is that just an automatic part of the CPU?
The real reason for adding more memory channels to a general purpose CPU is actually to increase the maximum amount of memory per node. A few years ago, workstation and server platforms often allowed 3 or more DIMMs per channel with performance declining sharply with memory density. Since then both AMD and Intel have limited each channel to 2 DIMMs and increase the number of memory channels from 4 to 6/8 to make up for the loss.
While more memory channels do enable better performance scaling, it has also made the CPU socket more complex and fragile than ever: The TRX40 socket has 4094 pins and literally requires the CPU to be bolted down using a torque wrench to ensure good contact.
Re: Ryzen Threadripper Pro 3995WX Spotted
#115I feel like 64 cores is getting rather close to a tipping point: What workloads are so massively parallel that they can use 64 cores of x86 but can’t use the thousands of CUDA cores on a Quadro card? I’m sure right now there are workloads that just need particular x86 instructions, but that feels like a temporary problem. Am I wrong about that being a temporary problem (that would feel frustrating)? Are these cores j…
The impending doom that is WASM will mean that 'dynamic' and 'interactive' adverts will use all these cores.
Re: Ryzen Threadripper Pro 3995WX Spotted
#116Earlier quoted context omitted.
The article mentions support for up to 2 TB of RAM.
True, and 3990x supports more than 256, but not in practice (motherboards)
Re: Ryzen Threadripper Pro 3995WX Spotted
#117I feel like 64 cores is getting rather close to a tipping point: What workloads are so massively parallel that they can use 64 cores of x86 but can’t use the thousands of CUDA cores on a Quadro card? I’m sure right now there are workloads that just need particular x86 instructions, but that feels like a temporary problem. Am I wrong about that being a temporary problem (that would feel frustrating)? Are these cores j…
Re: Ryzen Threadripper Pro 3995WX Spotted
#118A lot of people question the usefulness of 64+ cores on a workstation CPU. It is true that audio/visual tools like Adobe After Effects stop benefiting from extra cores at around 32 cores. [1] But if you want to simulate production workloads on your machine say with Apache Spark or Flink, you are in the prime. You couple that CPU with 256+ GB memory, and you can start exploring the bottlenecks in your batch algorithms…
Massively parallel operations take a different focus on your MPI/bus/queue architecture than we've ever needed for desktop software. BUT I think what we've already seen is that in general purpose computing there will always be someone ready to consume resources as they are available.
Both feet don't move at the same time, one takes a step and then the other.
Re: Ryzen Threadripper Pro 3995WX Spotted
#119Earlier quoted context omitted.
The 64-core 3990x is MSRP $4000. I’d expect this new fangled 3995WX to be that much or more.
CPU and motherboard prices aren't really relevant since RAM is so expensive. And only real reason for getting this instead of 3990x is that you need e.g. 1 terabyte of RAM. https://www.amazon.com/Tech-12x128GB-2933MHz-PC4-23400-288-P...
Re: Ryzen Threadripper Pro 3995WX Spotted
#120Earlier quoted context omitted.
Also, GPU has VERY limited memory and no virtual memory.
> VERY limited memory and no virtual memory This is incorrect.
The other issue is loading that memory - PCIe 4 is still the transfer time bottleneck between GPU and main memory.