11–20 of 132 posts
Earlier quoted context omitted.
> but has hyper-threading (!!!) meaning you get 384 threads... So this means that AMD is essentially on par with ARM cpus So you’re saying ‘essentially’ an AMD thread is the same as an ampere core?!
Always has been. Most ARM cores are closer to x86 E-cores.
Weird, but this makes me thing X86-64 might actually be better? It isn't mentioned anywhere in __this__ article, but the power draw of that chip is 276W. I got this from Phoronix [1]: > The AmpereOne A192-32X boasts 192 AmpereOne cores, a 3.2GHz clock frequency, a rated 276 Watt usage power Which is interesting because it's almost half of AMD's 192-core offering [2]. Why is this interesting? the AMD offering draws a…
But also this: "The big difference is the AmpereOne A192-32X is $5,555, while the EPYC 9965 is almost $15,000!"
So you have to look at TCO over a period of years, but that's still quite significant.
Weird, but this makes me thing X86-64 might actually be better? It isn't mentioned anywhere in __this__ article, but the power draw of that chip is 276W. I got this from Phoronix [1]: > The AmpereOne A192-32X boasts 192 AmpereOne cores, a 3.2GHz clock frequency, a rated 276 Watt usage power Which is interesting because it's almost half of AMD's 192-core offering [2]. Why is this interesting? the AMD offering draws a…
Hyperthreading doesn't even get close to doubling actual performance, it depends on the workload but AMDs Zen5 gains about 15% from HT on average according to Phoronix's benchmarks. https://www.phoronix.com/review/amd-ryzen-zen5-smt/8
It seems some benchmarks are as high as 50% with zen5.
AMD really improved HT with Zen 5 by adding a second instruction decoder per core. I expect even better per-thread performance from Zen 6.
Suddenly it sounds less impressive ...
Weird, but this makes me thing X86-64 might actually be better? It isn't mentioned anywhere in __this__ article, but the power draw of that chip is 276W. I got this from Phoronix [1]: > The AmpereOne A192-32X boasts 192 AmpereOne cores, a 3.2GHz clock frequency, a rated 276 Watt usage power Which is interesting because it's almost half of AMD's 192-core offering [2]. Why is this interesting? the AMD offering draws a…
> Cores are great, but it's all about how you slice them. Don't think of this as a single 192-core server. Think of it more like 48 dedicated 4-core servers in one box. And each of those servers has 10 gigs of high-speed RAM and consistent performance. Suddenly it sounds less impressive ...
Is the estimate that it is cheaper based on comparable server with the same or similar core count?
Weird, but this makes me thing X86-64 might actually be better? It isn't mentioned anywhere in __this__ article, but the power draw of that chip is 276W. I got this from Phoronix [1]: > The AmpereOne A192-32X boasts 192 AmpereOne cores, a 3.2GHz clock frequency, a rated 276 Watt usage power Which is interesting because it's almost half of AMD's 192-core offering [2]. Why is this interesting? the AMD offering draws a…
Jeff says as much. The AMD EPYC core does offer better performance per watt, which says more about AMD than it does about Ampere. But also this: "The big difference is the AmpereOne A192-32X is $5,555, while the EPYC 9965 is almost $15,000!" So you have to look at TCO over a period of years, but that's still quite significant.
He once told me that he also had a rack of thongs. Now, the thongs didn't have a lot of material, obviously, and were inexpensive to manufacture, so if he'd do his regular markup on them they'd end up selling for $15.
"However, notice the price tag is $25. I add an extra $10, because if a guy's looking to buy a thong, he's going to buy a thong".
I think about what he said when I see the chip prices on these high-end server CPUs.
Weird, but this makes me thing X86-64 might actually be better? It isn't mentioned anywhere in __this__ article, but the power draw of that chip is 276W. I got this from Phoronix [1]: > The AmpereOne A192-32X boasts 192 AmpereOne cores, a 3.2GHz clock frequency, a rated 276 Watt usage power Which is interesting because it's almost half of AMD's 192-core offering [2]. Why is this interesting? the AMD offering draws a…
You can do all the benchmarks you want, but if you don't factor in price, then of course the more expensive product (in general) is going to be better.
It is the same thing with the Snapdragon Elite and Mediatek Dimensity 9400. The SDE is the faster processor and more expensive.
> Also, with 512 gigs of RAM and a massive CPU, it can run a 405 billion parameter Large Language Model. It's not fast, but it did run, giving me just under a token per second.
If you're serious about running LLMs and you can afford it, you'll of course want GPUs. But this might be a relatively affordable way to run really huge models like Llama 405B on your own hardware. This could be even more plausible on Ampere's upcoming 512-core CPU, though RAM bandwidth might be more of a bottleneck than CPU cores. Probably a niche use case, but intriguing.