The Fastest BigInt in the West

#1

Post by wilfredhughes » Mon, Oct 20, 2014, 6:49 AM UTC

The Fastest BigInt in the West
wilfred.me.uk

Re: The Fastest BigInt in the West

#2

Post by igouy » Tue, Oct 21, 2014, 4:19 PM UTC

>>"Unlike the Benchmarks Game, we aren’t requiring all the test programs for the same language to be identical. This is a controversial rule..."Benchmarks Game programs for the same language are not required to be identical. Wilfred Hughes has been asked to correct that misstatement.

>>"It’s also not clear how representative the test programs are of typical performance of that language."Without sampling programs "in the wild" how could anyone possibly claim that other programs were "representative"?

See http://research.microsoft.com/en-us/projects/jsmeter/

Re: The Fastest BigInt in the West

#3

Post by igouy » Thu, Oct 23, 2014, 9:45 PM UTC

igouy wrote: post #2

>>"Unlike the Benchmarks Game, we aren’t requiring all the test programs for the same language to be identical. This is a controversial rule..." Benchmarks Game programs for the same language are not required to be identical. Wilfred Hughes has been asked to correct that misstatement. >>"It’s also not clear how representative the test programs are of typical performance of that language." Without sampling programs "i…

As-for the reference to Alex Gaynor's blog post, see:

http://www.reddit.com/r/Julia/comments/2jr0xo/the_fastest_bi...

Re: The Fastest BigInt in the West

#4

Post by igouy » Thu, Oct 23, 2014, 11:40 PM UTC

Wilfred, please correct your statement that the benchmarks game requires "all the test programs for the same language to be identical".

It isn't true. It wasn't true 4 years ago.

For sure, my preference was to show PyPy programs that also worked with CPython -- that made clear that optimizing for PyPy could make performance worse with CPython and vice versa.