Glad to see this kind of stuff written with a strongly typed language instead of Python.
5M Bid request/s, 2ms max response time – The Road to Damascus
21–30 of 71 posts
Re: 5M Bid request/s, 2ms max response time – The Road to Damascus
#22TechEmpower's Plaintext scenario is currently limited at 7M RPS due to network limits, though it uses a 10Gb NIC. Knowing that the Plaintext scenario is a very simple HTTP request (standard headers) that returns "Hello World!", how close to network saturation are you with 5M in this case with only "2 Gigabit Ethernet cards"?
Re: 5M Bid request/s, 2ms max response time – The Road to Damascus
#23The Best Minds of My Generation Are Thinking About How To Make People Click Ads (or serve them efficently)
Take a look at finance / trading. Things are even worse over there, but they don’t blog about it.
Used to be a semi-professional poker player, which seems to have a high crossover with finance/trading types for obvious reasons. I enjoyed the debates, but sometimes it was a bit overwhelming how everyone had convinced themselves that they were magically providing a ton of value to the world and that's why they were filthy rich. Also the massive intelligence that seemed to only work when applied in one domain. Didn't mind taking their money, but never pretended I was providing society a useful function while doing so. :)
Re: 5M Bid request/s, 2ms max response time – The Road to Damascus
#24It’s kind of sad that all this engineering effort was spent to essentially make the internet a worse place for everyone and waste users’ time and attention. Imagine if a crime syndicate would brag about their efforts to make their worldwide criminal activities more efficient.
Do you legitimately think the world would be a better place if gmail, youtube, flickr, reddit, EVERY search engine, and basically every web content site disappeared? Because that's what happens if you don't have web advertising. Free things disappear without revenue. Or maybe you'd prefer to go back to the days of randomly-targeted or "PUNCH THE MONKEY" ads. Because THAT'S what happens without ad auctions and targeti…
Everything you describe could exist as a paid service, and I suspect would be much higher quality that way.
Re: 5M Bid request/s, 2ms max response time – The Road to Damascus
#25It’s kind of sad that all this engineering effort was spent to essentially make the internet a worse place for everyone and waste users’ time and attention. Imagine if a crime syndicate would brag about their efforts to make their worldwide criminal activities more efficient.
Do you legitimately think the world would be a better place if gmail, youtube, flickr, reddit, EVERY search engine, and basically every web content site disappeared? Because that's what happens if you don't have web advertising. Free things disappear without revenue. Or maybe you'd prefer to go back to the days of randomly-targeted or "PUNCH THE MONKEY" ads. Because THAT'S what happens without ad auctions and targeti…
Ultimately I ended up being convinced by Sam Harris' argument: that advertising convoluted our relationship with reality and we started expecting everything for free.
I run some services that are paid for by advertising and I see this myself: the second I start trying to charge money, I'm now the one service that people see as costing them money when all my competitors are "free." And the associated entitlement is toxic.
To answer your first question, imagine a world where advertising doesn't exist and we simply pay for those things.
I was reluctant to admit this since ads paid my way through university. But as ads make less and less money, it's harder and harder to ignore the truth. And while ads are viable, they impede the necessary cultural transformation we'll need to form a healthier relationship with the goods and services we want.
Re: 5M Bid request/s, 2ms max response time – The Road to Damascus
#26It’s kind of sad that all this engineering effort was spent to essentially make the internet a worse place for everyone and waste users’ time and attention. Imagine if a crime syndicate would brag about their efforts to make their worldwide criminal activities more efficient.
Do you legitimately think the world would be a better place if gmail, youtube, flickr, reddit, EVERY search engine, and basically every web content site disappeared? Because that's what happens if you don't have web advertising. Free things disappear without revenue. Or maybe you'd prefer to go back to the days of randomly-targeted or "PUNCH THE MONKEY" ads. Because THAT'S what happens without ad auctions and targeti…
[deleted]
Re: 5M Bid request/s, 2ms max response time – The Road to Damascus
#27Earlier quoted context omitted.
Do you legitimately think the world would be a better place if gmail, youtube, flickr, reddit, EVERY search engine, and basically every web content site disappeared? Because that's what happens if you don't have web advertising. Free things disappear without revenue. Or maybe you'd prefer to go back to the days of randomly-targeted or "PUNCH THE MONKEY" ads. Because THAT'S what happens without ad auctions and targeti…
Everything you describe could exist as a paid service, and I suspect would be much higher quality that way.
[deleted]
Re: 5M Bid request/s, 2ms max response time – The Road to Damascus
#28Is this complete note? You didn't mention what you end up using. Is it golang or pony or F$? CoreFX mention in the end confused me more.
I work with Wael. Development is still ongoing. One implementation uses Golang, the other uses F# with a library that wraps libuv for faster network performance. Pony was used to write the stress-testing client for both implementations.
I mentioned this elsewhere in the thread, but since you'll see the reply here; look into Vert.X if you haven't already.
It already does most of what you want and has support for native epoll transport.
I'm not sure what led Vert.X to be discarded, maybe not a Java shop? But we've used it extremely successfully for high performance REST and I know of several high profile tech companies that swear by it.
There's nothing I know of that compares with Vert.X in performance, stability, and popular adoption
Re: 5M Bid request/s, 2ms max response time – The Road to Damascus
#29It’s kind of sad that all this engineering effort was spent to essentially make the internet a worse place for everyone and waste users’ time and attention. Imagine if a crime syndicate would brag about their efforts to make their worldwide criminal activities more efficient.
Ads aren’t crime and ads aren’t universally net negative.
Re: 5M Bid request/s, 2ms max response time – The Road to Damascus
#30Is this complete note? You didn't mention what you end up using. Is it golang or pony or F$? CoreFX mention in the end confused me more.
F$???? Is that a typo?