600K concurrent HTTP connections with Clojure and http-kit • Hacker News Board

Re: 600K concurrent HTTP connections with Clojure and http-kit

#11

Post by andrewvc » Mon, Apr 01, 2013, 6:27 PM UTC

zcam wrote: post #8

andrewvc wrote: post #5

Earlier quoted context omitted.

Its based on netty which surpassed c10k long ago. More generally modern socket concurrency is pretty high using epoll

It's not based on netty: > {:dependencies [[org.clojure/clojure "1.5.1"]]} netty is in the dev dependencies, but for benchmarking only I would guess. [edit] This project is one of the best thing that happened in the web area in clojure recently imho. Not only it is a game changer in performance/resource use, but it makes websocket and async in general trivial to use and actually production ready (same goes for its cl…

Ah, interesting, I should have looked deeper. Well they're both almost certainly based on java NIO then, which once again leads us to epoll and friends.

Re: 600K concurrent HTTP connections with Clojure and http-kit

#12

Post by rvirding » Mon, Apr 01, 2013, 6:33 PM UTC

So? Not really impressed. WhatsApp are getting over 2M concurrent HTTP connections with Erlang in a production system. And this was 1 year ago. http://blog.whatsapp.com/index.php/2012/01/1-million-is-so-2...

Re: 600K concurrent HTTP connections with Clojure and http-kit

#13

Post by wingo » Mon, Apr 01, 2013, 6:37 PM UTC

I'm pretty impressed, and especially by the apachebench test -- to serve a spike of 30K reqs/s while having 600K idle connections is quite good.

Re: 600K concurrent HTTP connections with Clojure and http-kit

#14

Post by gargoiler » Mon, Apr 01, 2013, 6:47 PM UTC

jsaxton86 wrote: post #4

Does anyone know how they managed to not only bypass the C10k limit, but bypass it by a factor of 60?

C10k was a relevant limit 10 years ago perhaps. It's only of historical interest now.

Re: 600K concurrent HTTP connections with Clojure and http-kit

#15

Post by obviouslygreen » Mon, Apr 01, 2013, 6:57 PM UTC

sixHundredKay wrote: post #10

Y'know... that little "K" abbreviation on the end is a pretty important detail. I skimmed the article about three times, thinking to myself: "600 users... Really? Big deal." It wouldn't hurt to actually emphasize "600,000" by explicitly expressing all of the zeroes.

"That little K abbreviation" is kind of a common thing... I'm not sure what your experience is, but in order to understand a lot of what gets discussed on the web in terms of performance, you'll need to improve your attention to detail.

Re: 600K concurrent HTTP connections with Clojure and http-kit

#16

Post by reddit_clone » Mon, Apr 01, 2013, 7:05 PM UTC

Are they using the same box to run server and clients? I can't figure that out from TFA.

Wouldn't it be better if clients are running on different machine(s)?

Re: 600K concurrent HTTP connections with Clojure and http-kit

#17

Post by hifier » Mon, Apr 01, 2013, 7:09 PM UTC

This does not measure 600k concurrent active connections because each client only sends a request once every 5-45s. To see how many concurrent active connections you can support you need to understand how much RAM each connection consumes and how much RAM is available to your application.

Re: 600K concurrent HTTP connections with Clojure and http-kit

#18

Post by ww520 » Mon, Apr 01, 2013, 7:23 PM UTC

Java NIO has amazing performance. I'm surprised not more JVM languages taking advantage of it.

Re: 600K concurrent HTTP connections with Clojure and http-kit

#19

Post by trailfox » Mon, Apr 01, 2013, 7:24 PM UTC

rvirding wrote: post #12

So? Not really impressed. WhatsApp are getting over 2M concurrent HTTP connections with Erlang in a production system. And this was 1 year ago. http://blog.whatsapp.com/index.php/2012/01/1-million-is-so-2...

The Whatsapp 2 million connection result was on a 24 core box with a ton of RAM. The Clojure benchmark was pulled off on a 4-core desktop. Also, Whatsapp connections are mostly idle, only a small fraction of users would be sending a message in any given second.

Edit: It looks like the test was run only on localhost, which also means that it artificially removes much of the processing and actual network I/O factors from the equation.

Re: 600K concurrent HTTP connections with Clojure and http-kit

#20

Post by trailfox » Mon, Apr 01, 2013, 7:31 PM UTC

ww520 wrote: post #18

Java NIO has amazing performance. I'm surprised not more JVM languages taking advantage of it.

Netty has become the standard library for NIO on the JVM and is used widely by programmers in various JVM languages. It's also refreshing to see high performance NIO systems written without using Netty for a change.