91–100 of 132 posts
Weird, but this makes me thing X86-64 might actually be better? It isn't mentioned anywhere in __this__ article, but the power draw of that chip is 276W. I got this from Phoronix [1]: > The AmpereOne A192-32X boasts 192 AmpereOne cores, a 3.2GHz clock frequency, a rated 276 Watt usage power Which is interesting because it's almost half of AMD's 192-core offering [2]. Why is this interesting? the AMD offering draws a…
Really a pity that Oracle killed off SPARC. They already had 32-core CPUs almost a decade ago but Oracle never really understood the value that SPARC and Solaris brought to the table.
I was a huge Sun fan for most of the 90's and had several Sun systems at home. By the early 2000's, Sun was no longer competitive. Between Intel and Linux, the writing was on the wall. I haven't seen a Sun system used in production since 2003.
Solaris seemed to be much more solid than linux overall.
Earlier quoted context omitted.
It's really slow. Like, unusably slow. For those interested in self-hosting, this is a really good resource: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inferen...
You know, there's nothing wrong with running a slow LLM. For some people, they lack the resources to run an LLM on a GPU. For others, they want to try certain models without buying thousands of dollars of equipment just to try things out. Either way, I see too many people putting the proverbial horse before the cart: they buy a video card, then try to fit LLMs in to the limited VRAM they have, instead of playing arou…
Earlier quoted context omitted.
I just looked it up - that is a mistaken statistic. 50% of their CPUs are not Arm, but AWS has 50% of all server-side Arm CPUs. "But that total is beaten by just one company – Amazon – which has slightly above 50 percent of all Arm server CPUs in the world deployed in its Amazon Web Services (AWS) datacenters, said the analyst."[0] [0]: https://www.theregister.com/2023/08/08/amazon_arm_servers/
In part that'll be because they mandated every service team migrate to ARM. Service teams had to have extensive justification to avoid it. With good reason, too, the reason for the effort was the significant cost savings.
Earlier quoted context omitted.
I think you might be comparing your memories of Ampere's CPU power draw to either a full Epyc server's wall power draw or stated TDP. The 128 core EPYC 9754 in the chart linked above has a min of 10 W and a max draw of 397 W even though it outperforms the new 192 core variant AmpereOne A192-32X which had a min of 102 W and a max of 401 W. The min on the A192 does seem anonymously high though. That said, even the M128…
Hmmm. Weird because I was definitely out odd EPYC because of idle draw. Ok thanks, that’s back on the table now!!
I would be hard pressed to believe that another EPYC would be able to significantly reduce I/O die power consumption significantly, given that AMD hasn't really made many major changes to it over the generations.
Now, what percentage of companies could get away with sticking a pair of these (for redundancy) and run their entire operation off of it?
Earlier quoted context omitted.
I was a huge Sun fan for most of the 90's and had several Sun systems at home. By the early 2000's, Sun was no longer competitive. Between Intel and Linux, the writing was on the wall. I haven't seen a Sun system used in production since 2003.
Bit of a pity now that the most advanced process nodes would be available via TSMC. Solaris seemed to be much more solid than linux overall.
Solaris 10 was intended as a catch-up release but the package manager took years to mature. I remember getting racks of systems in the mid-2000s where simply running the updater on brand new servers rendered them unbootable. By then the writing was on the wall.
SPARC was similar: the hardware had some neat aspects but what they really needed was the equivalent of a first-class LLVM backend now. Statistically nobody was hand-tuning assembly code to try to get it to be competitive with x86, especially since that meant not only your own code but most other libraries. The reason ARM is doing so well now is that two decades where the most popular computing devices are phones means that you can just assume that anything popular will compile and run well on ARM.
Earlier quoted context omitted.
Hmmm. Weird because I was definitely out odd EPYC because of idle draw. Ok thanks, that’s back on the table now!!
I wasn't been able to get my 2nd gen EPYC 7642 idle under 100W. Most of that power goes to the I/O die. The cores themselves manage their power very well. While I have all memory slots as well as a number of PCIe lanes occupied (more than 24 available from the consumer chips, but probably less than 48...,) I routinely think about side-grading to something else just to reduce the idle power consumption. I would be har…
Maybe I should wait another 18 month cycle
I agree. It's too bad the MHz race ended though. Us personal PC users benefit from raw performance more.
Why not? We hit the single thread wall more than a decade ago. Why isn’t more software parallelized by now?