This is yet not the grok acquisition, so there is another update coming with that claiming more improvements?
Nvidia Launches Vera CPU, Purpose-Built for Agentic AI
51–60 of 109 posts
Re: Nvidia Launches Vera CPU, Purpose-Built for Agentic AI
#52It is a 88-core ARM v9 chip, for somewhat more detailed spec.
Hmm, the 128-core Ampere Altra CPU is already available, and in a case from System76. I wonder what else differentiates it. If they're going to build CPUs I wish they had used Risc-V instead. They are using it somewhat already.
You can see here[1] what the specs are for the CPU (listed as "NVIDIA Vera Rubin Superchip").
The CPU is integrated with two Rubin GPUs but each of the CPU cores has dedicated FP8 acceleration as well.
1. https://www.nvidia.com/en-us/data-center/vera-rubin-nvl72/
Re: Nvidia Launches Vera CPU, Purpose-Built for Agentic AI
#53Earlier quoted context omitted.
>are not competitive in the consumer space AFAIK they still dominate on clock rate, which I was surprised to see when doing some back of the envelope calculations regarding core counts. I felt my 8 core i9 9900K was inadequate, so shopped around for something AMD, and IIRC the core multiplier of the chip I found was dominated by the clock rate multiplier so it’s possible that at full utilization my i9 is still toward…
Your 9900k at 5ghz does work slower than a Ryzen 9800X3D at 5ghz. A lot slower (1700 single core geekbench vs 3300, and just about any benchmark will tell the same story). Clock speed alone doesn't mean anything.
From the newegg listing:
>8 Cores and 16 processing threads, based on AMD "Zen 5" architecture
which is the same thread geometry as my 9900K.
My main concerns at the time were:
1. More cores for running large workloads on k8s since I had just upgraded to 128G RAM
2. More thread level parallelism for my C++ code
Naively I thought that, ceteris paribus and assuming good L1 cache utilization, having more physical cores with a higher clock rate would be the ticket for 2.
Does the 9800X3D have a wider pipeline or is it some other microarchitectural feature that makes it faster?
Re: Nvidia Launches Vera CPU, Purpose-Built for Agentic AI
#54"democratize access to AI and accelerating innovation." So they make inference cheaper and the models get even worse. Or Jensen Huang has AI psychosis. Or both. Here is a new business idea for Nvidia: Give me $3000 in a circular deal which I will then spend on a graphics card.
Me too plz. To quote (more or less) Harvey Pekar: “I’m trying to sell out, but nobody’s buying!”
Re: Nvidia Launches Vera CPU, Purpose-Built for Agentic AI
#55Earlier quoted context omitted.
>are not competitive in the consumer space AFAIK they still dominate on clock rate, which I was surprised to see when doing some back of the envelope calculations regarding core counts. I felt my 8 core i9 9900K was inadequate, so shopped around for something AMD, and IIRC the core multiplier of the chip I found was dominated by the clock rate multiplier so it’s possible that at full utilization my i9 is still toward…
A 9700X is twice the performance of a 9900K and M5 Max is almost 3X the performance. The megahertz myth is a myth.
I replied to the sibling comment: I was making simplifying assumptions for two specific use cases and naively treated physical cores and clock rate as my variables.
Re: Nvidia Launches Vera CPU, Purpose-Built for Agentic AI
#56Ahhh, so is this a chip "more optimised" for connecting GPU's to reality ... or are they skipping the GPU step entirely? Are GPU's only for training now?
Re: Nvidia Launches Vera CPU, Purpose-Built for Agentic AI
#57Ahhh, so is this a chip "more optimised" for connecting GPU's to reality ... or are they skipping the GPU step entirely? Are GPU's only for training now?
have you seen this: https://chatjimmy.ai/
It's quite impressive what purpose build inference can/will do once everyone stops trying to become kind of the best model.
Re: Nvidia Launches Vera CPU, Purpose-Built for Agentic AI
#58Earlier quoted context omitted.
Your 9900k at 5ghz does work slower than a Ryzen 9800X3D at 5ghz. A lot slower (1700 single core geekbench vs 3300, and just about any benchmark will tell the same story). Clock speed alone doesn't mean anything.
From the newegg listing: >8 Cores and 16 processing threads, based on AMD "Zen 5" architecture which is the same thread geometry as my 9900K. My main concerns at the time were: 1. More cores for running large workloads on k8s since I had just upgraded to 128G RAM 2. More thread level parallelism for my C++ code Naively I thought that, ceteris paribus and assuming good L1 cache utilization, having more physical cores…
You don't even need to go into the pipeline details. The 9800X3D has 8x more L2 cache, 6x more L3 cache, 2x the memory bandwidth than the now 8 years old i9 9900K. 3D V-cache is pretty cool.
Re: Nvidia Launches Vera CPU, Purpose-Built for Agentic AI
#59> Purpose-Built for Agentic AI From the "fridge purpose-built for storing only yellow tomatoes" and "car only built for people whose last name contains the letter W" series. When can this insanity end? It is a completely normal garden-variety ARM SoC, it'll run Linux, same as every other ARM SoC does. It is as related to "Agentic $whatever" as your toaster is related to it
> It is as related to "Agentic $whatever" as your toaster is related to it These things have hardware FP8 support, and a 1.8TB/s full mesh interconnect between CPUs and GPUs. We can argue about the "agentic" bit, but those are features that don't really matter for any workload other than AI.
The huge interconnect would also useful be for HPC tasks. The FP8 not so much, HPC still loves FP64.
Re: Nvidia Launches Vera CPU, Purpose-Built for Agentic AI
#60A GPU purpose-built for Slop.