5M Bid request/s, 2ms max response time – The Road to Damascus
1–10 of 71 posts
Re: 5M Bid request/s, 2ms max response time – The Road to Damascus
#2Is this complete note? You didn't mention what you end up using.
Is it golang or pony or F$? CoreFX mention in the end confused me more.
Re: 5M Bid request/s, 2ms max response time – The Road to Damascus
#3Is this complete note? You didn't mention what you end up using. Is it golang or pony or F$? CoreFX mention in the end confused me more.
> "I didn't want to rewrite everything from scratch, and definitely, I didn't want to handle all edge cases for epoll. My choice was to use libuv. The architecture I opt for: use 16 cores out of 40 for networking, having 16 'uv_loop' each running on its own thread. Callbacks will be passed from F# to each 'uv_loop' instance. The event loop will call them after parsing the bid request in C11."
Looks like libuv directly in C11? (not F# as before edit).
Re: 5M Bid request/s, 2ms max response time – The Road to Damascus
#4Is this complete note? You didn't mention what you end up using. Is it golang or pony or F$? CoreFX mention in the end confused me more.
I work with Wael. Development is still ongoing. One implementation uses Golang, the other uses F# with a library that wraps libuv for faster network performance. Pony was used to write the stress-testing client for both implementations.
Re: 5M Bid request/s, 2ms max response time – The Road to Damascus
#5It’s kind of sad that all this engineering effort was spent to essentially make the internet a worse place for everyone and waste users’ time and attention.
Imagine if a crime syndicate would brag about their efforts to make their worldwide criminal activities more efficient.
Re: 5M Bid request/s, 2ms max response time – The Road to Damascus
#6Did you consider Vert.X? it's built on Netty and has it's own Linux epoll driver, async, and fiber support. It's impossible to know if it would be faster, but likely comparable and way less work than rolling your own.
In techempower benchmarks it exceeds 2 million http requests/second and it's a full REST framework.
And if you use the fiber support through Quasar you can pretend most things are normal blocking code.
Have to tried it or is this a case of NIH?
Re: 5M Bid request/s, 2ms max response time – The Road to Damascus
#7The Best Minds of My Generation Are Thinking About How To Make People Click Ads (or serve them efficently)
Re: 5M Bid request/s, 2ms max response time – The Road to Damascus
#8It’s kind of sad that all this engineering effort was spent to essentially make the internet a worse place for everyone and waste users’ time and attention. Imagine if a crime syndicate would brag about their efforts to make their worldwide criminal activities more efficient.
Do you legitimately think the world would be a better place if gmail, youtube, flickr, reddit, EVERY search engine, and basically every web content site disappeared?
Because that's what happens if you don't have web advertising. Free things disappear without revenue.
Or maybe you'd prefer to go back to the days of randomly-targeted or "PUNCH THE MONKEY" ads. Because THAT'S what happens without ad auctions and targeting.
The reality is: advertisers and ad-supported sites WANT to show you a relevant ad that you're likely to click (modulo obvious bad actors). That's how they get paid. Anything else is, by definition, "[wasting] users' time and attention."
Re: 5M Bid request/s, 2ms max response time – The Road to Damascus
#9It’s kind of sad that all this engineering effort was spent to essentially make the internet a worse place for everyone and waste users’ time and attention. Imagine if a crime syndicate would brag about their efforts to make their worldwide criminal activities more efficient.
... So when it's Google or FB blogging about technology originally developed to serve ads, it's hype and cool... But when the authors are more honest about the motivation behind developing a certain piece of tech, it's "kind of sad"?
Re: 5M Bid request/s, 2ms max response time – The Road to Damascus
#10It’s kind of sad that all this engineering effort was spent to essentially make the internet a worse place for everyone and waste users’ time and attention. Imagine if a crime syndicate would brag about their efforts to make their worldwide criminal activities more efficient.
Do you legitimately think the world would be a better place if gmail, youtube, flickr, reddit, EVERY search engine, and basically every web content site disappeared? Because that's what happens if you don't have web advertising. Free things disappear without revenue. Or maybe you'd prefer to go back to the days of randomly-targeted or "PUNCH THE MONKEY" ads. Because THAT'S what happens without ad auctions and targeti…
I’d much rather go back to randomly targeted “punch the monkey” ads. Far better than the current crop of ads which are usually one of fraudulent, malware, or borderline pornographic.
Was I supposed to respond “oh no, current ads are so much better”?