21–30 of 30 posts
Earlier quoted context omitted.
AMD chips have more cores than Intel chips, so pushing for a single powerful CPU means "Buy AMD, not Intel." Of course they'll like it even better if you bought two AMD chips instead of one, but they probably don't care as much whether you put those chips into one server or two.
Intel will have more cores shortly.
Earlier quoted context omitted.
AMD chips have more cores than Intel chips, so pushing for a single powerful CPU means "Buy AMD, not Intel." Of course they'll like it even better if you bought two AMD chips instead of one, but they probably don't care as much whether you put those chips into one server or two.
Intel will have more cores shortly.
The article was posted in 2023.
This article reads like an AMD advertisement for their EPYC processor line.
Are you one of the reasons why SEO spam sites are clicked on so often?
EPYC brings plenty of NUMA complexity in a single socket unfortunately. If you just want to solve system performance riddles then one socket is plenty. I seem to recall that Facebook publicly announced that they switched their web server systems to 1 socket more than 8 years ago. Since that time Netflix has written several times about how they carefully keep the sides of a 2S server from interfering with each other a…
They want a small box, because ISPs have limited space.
They want a single LACP group, because ISPs have limited ports, and to use only one IP address, because ISPs have limited addresses.
And they want to make it easy to plug in properly, so that they can reduce communication with the ISP.
These all add up to a dual socket node over two single socket nodes in one box. Although, as single socket capabilities increase, they may end up with a single socket node instead.
If you want to inference big LLMs on CPU, you really want those 2x 12 memory channels a Dual EPYC system offers you for decent speeds.
I had to check and I was amazed that there are companies selling workstations with dual EPYC processors, providing a whopping 256 CPU cores and over 2TB of DDR5. All in a desktop form factor. Amazing.
DRAM price per GB has been roughly flat for well over a decade - consumer prices hit $4/GB in 2011, and have fluctuated around there ever since - most of the drop in real cost since then has been due to declining value of that $4. Prices for large enterprise/hyper scalers are probably similar, as it’s a low-margin commodity market.
Two sockets gets you more memory channels and more DINNS, but as memory price causes the RAM/CPU ratio to drop, and single-channel bandwidth increases with DDR5, that becomes less important.
Of course that’s one of those things you can’t really say to customers, kind of like “you don’t really need 250hp in a passenger sedan”.
Not mentioned in this is the issue of memory scaling. DRAM price per GB has been roughly flat for well over a decade - consumer prices hit $4/GB in 2011, and have fluctuated around there ever since - most of the drop in real cost since then has been due to declining value of that $4. Prices for large enterprise/hyper scalers are probably similar, as it’s a low-margin commodity market. Two sockets gets you more memory…
If price didn't matter, what would be the best performing CPU available today? With lots of PCIe lanes and high single-thread performance?
If/when they make a v-cache version of this, that'll most likely be even better: Zen5 v-cache doesn't have the clock speed penalty that previous generations did (because the cache is underneath instead of on top) and 96MB of L3 per core would be monstrous.
Not mentioned in this is the issue of memory scaling. DRAM price per GB has been roughly flat for well over a decade - consumer prices hit $4/GB in 2011, and have fluctuated around there ever since - most of the drop in real cost since then has been due to declining value of that $4. Prices for large enterprise/hyper scalers are probably similar, as it’s a low-margin commodity market. Two sockets gets you more memory…
I thought that most of the reason that Apple's newer cpus are supposed to be so good for LLMs is that the integrated memory lets them have more channels than usual?
This article reads like an AMD advertisement for their EPYC processor line.
It was written by Robert Hormuth AMD’s Corporate Vice President, Architecture & Strategy – Data Center Solutions Group and published on amd.com. Are you one of the reasons why SEO spam sites are clicked on so often?
I don't think your poorly thought-through personal attack has any relevance to the topic. I clicked on the article because there was a submission in HN with the title "Myths and Urban Legends About Dual-Socket Servers". What leads you to believe SEO holds any relevance