It might be interesting to track average and peak server side memory usage during these tests. For example, if framework A is only 80% the "speed" of framework B, but uses 1/4 as much memory, for some users this might be a win for A.
Web Framework Benchmarks Round 2
41–50 of 241 posts
Re: Web Framework Benchmarks Round 2
#42Are C#/Mono web frameworks an option? Because I would love to see how http://servicestack.net fares: https://github.com/ServiceStack/ServiceStack/wiki/Real-world...
We've had a lot of requests Mono, and are actually very interested in trying this out. We've been hesitant to move forward only because we're unsure how stable the C# community believes Mono to be. We hope to have that test at some point though, but the fastest way to get a test included is to issue a pull request. So if anyone is interested in trying this out, let us know and we can help guide the process.
Re: Web Framework Benchmarks Round 2
#43It might be interesting to track average and peak server side memory usage during these tests. For example, if framework A is only 80% the "speed" of framework B, but uses 1/4 as much memory, for some users this might be a win for A.
Great suggestions, we've thought about capturing other system data as well, but memory seems like a great choice to start with.
Re: Web Framework Benchmarks Round 2
#44It might be interesting to track average and peak server side memory usage during these tests. For example, if framework A is only 80% the "speed" of framework B, but uses 1/4 as much memory, for some users this might be a win for A.
That would be an interesting metric indeed.
Re: Web Framework Benchmarks Round 2
#45It might be interesting to track average and peak server side memory usage during these tests. For example, if framework A is only 80% the "speed" of framework B, but uses 1/4 as much memory, for some users this might be a win for A.
This is definitely something we want to include in the tests, but it is difficult to manage a fair way of monitoring. Outside of the actual benchmarks, where we kept everything as fair as possible, we ran individual tests to make sure they worked prior to the benchmarking and would routinely have htop running at the same time to get an idea of what that sort of data looks like.
It IS very interesting and is definitely something we have discussed methods for measuring for the sake of these benchmarks. Other areas that we discussed were cpu utilization, disk utilization, and network saturation.
Re: Web Framework Benchmarks Round 2
#46As an amateur hacker and after 275 days of reading Hacker News I feel I can now navigate in the sea of client side Javascript frameworks. With the introduction of this data on web framework performance, I now have another set of choices that I am completely unqualified to comprehend.
My first impression is that this data shows about 3 levels of web frameworks. At the bottom (slowest) we have Django's and Rails and many other introductory app server frameworks. Lets say after I was able to build an initial product successfully, would I then consider re-building the product in a higher performance framework as Go, Node, etc?
The third level, netty and gemini and servlet etc, I am not familiar with. Googling "netty" I get --"Netty is an asynchronous event-driven network application framework"-- I thought that is what Node is (in js) and Go does with gophers.
What are the use cases for these faster frameworks and do they follow an evolution of performance options that an app might go through?
Re: Web Framework Benchmarks Round 2
#47Are C#/Mono web frameworks an option? Because I would love to see how http://servicestack.net fares: https://github.com/ServiceStack/ServiceStack/wiki/Real-world...
I agree, I would like to see C# Mono included as well. People might also want to see C# .NET, but I don't think that is applicable here because we are talking about 64-bit Linux (the dominate internet platform) here.
Re: Web Framework Benchmarks Round 2
#48I apologize if this question has been asked and answered, but why is netty missing from the database tests? No ORM?
Re: Web Framework Benchmarks Round 2
#49Are C#/Mono web frameworks an option? Because I would love to see how http://servicestack.net fares: https://github.com/ServiceStack/ServiceStack/wiki/Real-world...
We've had a lot of requests Mono, and are actually very interested in trying this out. We've been hesitant to move forward only because we're unsure how stable the C# community believes Mono to be. We hope to have that test at some point though, but the fastest way to get a test included is to issue a pull request. So if anyone is interested in trying this out, let us know and we can help guide the process.
Cool, a note on the stability side: http://www.servicestack.net and the live demos http://www.servicestack.net/#livedemos have always been hosted on Linux/Mono in all the years it's been in existence.
Is GitHub issues the best way to ask for guidance?
Re: Web Framework Benchmarks Round 2
#50What about Puma (http://puma.io), Goliath (http://goliath.io) or Unicorn (http://unicorn.bogomips.org/) instead of Passenger in the Ruby stack?