Okay, Nim is really fast in these benchmarks on ec2 servers, impressive. Does anyone has experience with nim web stack? Is it ready for prime time? How much effort is required to create a simple CRUD json api? On a sidenote I am really looking forward to comparing rust and elixir results in the next round of benchmarks.
Techempower Web Framework Benchmarks Round 10
11–20 of 66 posts
Re: Techempower Web Framework Benchmarks Round 10
#12The chart says Play Framework didn't complete but looking at the output, the logs say it did. https://github.com/TechEmpower/TFB-Round-10/blob/master/peak... What am I missing?
It's not that they didn't complete, they never even started. Definitely configured incorrectly for the tests.
Re: Techempower Web Framework Benchmarks Round 10
#13Dart dominated the multiple queries test type.
That is quite surprising. Anyone have an idea why that is?
Actually, not really. We checked the code to ensure that there was no gaming the system and it definitely APPEARS to be making separate database queries as we require in our rules. In fact, we had this same question in round 9 and had a number of people audit it. We cannot explain it other than it might be pretty darn fast.
Re: Techempower Web Framework Benchmarks Round 10
#14I'd like to see the memory benchmarks as well.It's fine to have something fast but the more memory the more expensive the boxes are.
[deleted]
Re: Techempower Web Framework Benchmarks Round 10
#15I'd like to see the memory benchmarks as well.It's fine to have something fast but the more memory the more expensive the boxes are.
We HAVE the memory data, but we have not distilled it into a consumable form to use on our website. Here, for example, is the cpu/ram usage report for ULib's json test: https://github.com/TechEmpower/TFB-Round-10/blob/master/peak...
Re: Techempower Web Framework Benchmarks Round 10
#16Few notes:
* Impressive Dart
* JRuby > MRI (I'd like to see JRuby 9k)
* Padrino that offers basically everything that Rails does performs impressively well. [Shameless Plug]
Re: Techempower Web Framework Benchmarks Round 10
#17Okay, Nim is really fast in these benchmarks on ec2 servers, impressive. Does anyone has experience with nim web stack? Is it ready for prime time? How much effort is required to create a simple CRUD json api? On a sidenote I am really looking forward to comparing rust and elixir results in the next round of benchmarks.
Rust and Elixir SHOULD be included in Round 11 - we have already accepted a pull request for the Phoenix framework (Elixir) and have had a pull request for Rust when it was in alpha. Hopefully, we will see another Rust pull request soon.
Re: Techempower Web Framework Benchmarks Round 10
#18The chart says Play Framework didn't complete but looking at the output, the logs say it did. https://github.com/TechEmpower/TFB-Round-10/blob/master/peak... What am I missing?
It's not that they didn't complete, they never even started. Definitely configured incorrectly for the tests.
Agreed. Our logging has undergone some solid improvements in the last week or two, and so round 11 will, if not resolve this issue completely, make the logged output more useful for tracking down issues like this during the preview runs.
Re: Techempower Web Framework Benchmarks Round 10
#19Dart dominated the multiple queries test type.
That is quite surprising. Anyone have an idea why that is?
That's easy to answer, instead of using a relational database or even PostgreSQL's JSON data store, it's using MongoDB. I hate MongoDB but for tests like these where there's absolutely no writes what so ever, Mongo is going to fly. Hence, I read this as comparing MongoDB read performance to PostgreSQL, MySQL or SQL Server perf (or any of the other DB that are listed.)
That's why benchmarks like these have to be scrutinized. I like looking them over but in reality, they're not Apples to Apples.
Re: Techempower Web Framework Benchmarks Round 10
#20There's something I don't understand in these comments. Why is everyone interested in language comparisons instead of the huge difference between EC2 and bare metal?