Live data from Hacker News

Intel publishes misleading benchmarks against AMD

servethehome.com

21–30 of 209 posts

Re: Intel publishes misleading benchmarks against AMD

#22
post #5
post #3

tl;dr: using outdated benchmarking tools optimized for the latest Intel chips and not the latest AMD chips. GROMACS 2019.3 v. 2019.4, the latter of which is the latest but still came out over a month ago and addressed AMD Zen 2. Source is still a good read for explanations on why this is impactful. --- Disclosure: I'm long AMD

They used the Intel compiler. We know for a fact Intel’s compilers deliberately don’t optimize as well for non-Intel chips. That’s damning in and of itself.

That is a little disingenuous. The whole point of Intel’s compiler is to support Intel chips well. Results on other chips are what they are. No effort to make other chips perform eiher better or worse is expended. Keeping up with Intel chips is more than a full time job without other distractions.

The question to ask is whether or not they used the best complier/swithes available for the other chips.

Re: Intel publishes misleading benchmarks against AMD

#23
post #13

Earlier quoted context omitted.

All benchmarks are misleading.

Could you expand on that please

The fastest animal on earth is the fastest not because it has huge muscles, but because it falls. Is it fair compare top speed of falcon to cheetah? Yeah but... x y z.

Every benchmark can be set up in a way that will give edge to one part or another. Especially if there is a vested interest.

Re: Intel publishes misleading benchmarks against AMD

#25
post #16
post #4

I recall a few months ago they released a marketing pack benchmarking themselves against AMD with a small print disclaimer that they hadn't applied the spectre/meltdown fixes.

Many applications don't need Spectre or Meltdown mitigations, but they should at least put the test parameters up front and not in the fine print.

Many users won't know how to disable Spectre and Meltdown mitigations. They will be active by default if the user installs all the latest updates.

Re: Intel publishes misleading benchmarks against AMD

#29
post #5
post #3

tl;dr: using outdated benchmarking tools optimized for the latest Intel chips and not the latest AMD chips. GROMACS 2019.3 v. 2019.4, the latter of which is the latest but still came out over a month ago and addressed AMD Zen 2. Source is still a good read for explanations on why this is impactful. --- Disclosure: I'm long AMD

They used the Intel compiler. We know for a fact Intel’s compilers deliberately don’t optimize as well for non-Intel chips. That’s damning in and of itself.

I guess we're better off with Phoronix then, as they're more independent, and benchmark with a myriad of different compilers and OSes (I'm not aware of any software on my Linux AMD64 machine which was compiled with ICC).

Re: Intel publishes misleading benchmarks against AMD

#30
There's often a long lead time between writing up benchmarks/white papers and publication. At my last employer it could take well over a month to let everyone have their 2 cents and get through Legal for approval. This is a long enough interval to explain the old/new GROMACS usage.

As the saying goes, don't attribute to malice that which can be adequately explained by stupidity (including corporate bureaucracy).

Post reply on HN