these pseudo benchmarks should be banned
New Computer Language Benchmarks Game metric: time + source code size
51–59 of 59 posts
Re: New Computer Language Benchmarks Game metric: time + source code size
#52Earlier quoted context omitted.
Note that these benchmarks include compilation time for Julia, while it does not include compilation time for C, Rust, etc.
Julia is presented like this — “Julia features optional typing, multiple dispatch, and good performance, achieved using type inference and just-in-time (JIT) compilation , implemented using LLVM.” Julia 1.7 Documentation, Introduction https://docs.julialang.org/en/v1/
Yes, because it's all set for prime time in the next release.
"Julia features optional typing, multiple dispatch, and good performance, achieved using type inference and just-in-time (JIT) compilation (and optional ahead-of-time compilation), implemented using LLVM."
https://docs.julialang.org/en/v1.9-dev/
So it'll be updated when v1.9 comes out? Anyways, it's a somewhat interesting thing that Julia still gets 3rd even though it's measuring compilation time.
Re: New Computer Language Benchmarks Game metric: time + source code size
#53Earlier quoted context omitted.
I can't find the documentation for it, but you can see here that they measure the size of the source file after gzip compression, which reduces advantage of code-golf solutions: https://salsa.debian.org/benchmarksgame-team/benchmarksgame/...
"How source code size is measured" https://benchmarksgame-team.pages.debian.net/benchmarksgame/...
Thanks Isaac. How do I reach that page? I expected it on one of the informational pages such as the home page or benchmark programs page, but had no luck.
Re: New Computer Language Benchmarks Game metric: time + source code size
#54I really wish they aggregated the metric of build time (+ whatever). That is a huge metric I care about. You can figure out it somewhat by clicking on each language benchmark but it is not aggregated. BTW as biased guy in the Java world I can tell you this is one area Java is actually mostly the winner even beating out many scripting languages apparently.
Do Java "build time" measurements include class loading and JIT compilation? :-)
Does C “build time” include the time it takes to load the binary from disk?
Re: New Computer Language Benchmarks Game metric: time + source code size
#55Earlier quoted context omitted.
"How source code size is measured" https://benchmarksgame-team.pages.debian.net/benchmarksgame/...
Thanks Isaac. How do I reach that page? I expected it on one of the informational pages such as the home page or benchmark programs page, but had no luck.
There's a "How programs are measured" link on these pages which show measurements:
https://benchmarksgame-team.pages.debian.net/benchmarksgame/...
:and these pages:
https://benchmarksgame-team.pages.debian.net/benchmarksgame/...
:and these pages:
https://benchmarksgame-team.pages.debian.net/benchmarksgame/...
Re: New Computer Language Benchmarks Game metric: time + source code size
#56Earlier quoted context omitted.
Julia is presented like this — “Julia features optional typing, multiple dispatch, and good performance, achieved using type inference and just-in-time (JIT) compilation , implemented using LLVM.” Julia 1.7 Documentation, Introduction https://docs.julialang.org/en/v1/
Yes, because it's all set for prime time in the next release. "Julia features optional typing, multiple dispatch, and good performance, achieved using type inference and just-in-time (JIT) compilation (and optional ahead-of-time compilation), implemented using LLVM." https://docs.julialang.org/en/v1.9-dev/ So it'll be updated when v1.9 comes out? Anyways, it's a somewhat interesting thing that Julia still gets 3rd ev…
Tell us when it becomes achieved using ahead-of-time compilation (and optional just-in-time (JIT) compilation).
Re: New Computer Language Benchmarks Game metric: time + source code size
#57Earlier quoted context omitted.
"simple" (2nd link on the homepage.) https://benchmarksgame-team.pages.debian.net/benchmarksgame/...
Is that only for the mandelbrot benchmark?
"… you choose which program differencies to explore … you choose which program measurements to compare."
"Are they similar-enough to be comparable for your purposes?"
n-body Chapel #3 program
https://benchmarksgame-team.pages.debian.net/benchmarksgame/...
n-body C clang program
https://benchmarksgame-team.pages.debian.net/benchmarksgame/...
n-body Java program
https://benchmarksgame-team.pages.debian.net/benchmarksgame/...
Re: New Computer Language Benchmarks Game metric: time + source code size
#58Earlier quoted context omitted.
"simple" (2nd link on the homepage.) https://benchmarksgame-team.pages.debian.net/benchmarksgame/...
>Java: 40 seconds >Python 3: 1h 09 minutes Well damn.
:-)
"Or even acknowledge — Anyone else a bit shocked by how well Javascript on V8 performs? I might need to rethink my assumptions…"
https://benchmarksgame-team.pages.debian.net/benchmarksgame/...
Re: New Computer Language Benchmarks Game metric: time + source code size
#59Earlier quoted context omitted.
All of the languages now have that trash in them. I'd like a "naive" benchmarks game where you write the code straight forwardly in a normal style for the language.
"simple" (2nd link on the homepage.) https://benchmarksgame-team.pages.debian.net/benchmarksgame/...
Kind of but less transliteration and more in the natural style of the target language.