Live data from Hacker News

Building a Billion User Load Balancer [video]

usenix.org

11–20 of 53 posts

Re: Building a Billion User Load Balancer [video]

#11
In case anyone else is looking for a transcript: I can't check right now if this talk is much different from the one he did in 2015, but just in case, here's a link to the Youtube video for the older one:

https://www.youtube.com/watch?v=MKgJeqF1DHw

That's the only way I found to get any sort of text.

Re: Building a Billion User Load Balancer [video]

#12
post #2

Map of Google data centers: http://imgur.com/l1dDdQe Map of Facebook data centers and PoP: http://imgur.com/dek8ESX

Both Google and Facebook both have datacenters/PoPs in Taiwan? I can't imagine the 24mm people there justify it, and both services are either largely unused or blocked in the nearby PRC... I'm more surprised that Google has no presence in Japan, though.

They do. The above map is wholly owned DCs, but there are many more PoPs, and an enormous number of edge cache locations: https://peering.google.com/#/infrastructure

Re: Building a Billion User Load Balancer [video]

#14
The "cartographer" doesn't use end user related information to select the best PoP? Or does "Sonar" measure the latency/throughput by looking at existing connections to users?

Ok I watched the presentation now, Sonar apparently does that indeed.

Re: Building a Billion User Load Balancer [video]

#15
post #2

Map of Google data centers: http://imgur.com/l1dDdQe Map of Facebook data centers and PoP: http://imgur.com/dek8ESX

Both Google and Facebook both have datacenters/PoPs in Taiwan? I can't imagine the 24mm people there justify it, and both services are either largely unused or blocked in the nearby PRC... I'm more surprised that Google has no presence in Japan, though.

There's a major Asia-Pacific undersea cable connected to Taiwan, so Taiwan is a useful Asia-Pacific gateway.

Re: Building a Billion User Load Balancer [video]

#16
Interesting that Linux kernel performance (ipvs) is acceptable at l4 vs something like dpdk. I guess you just overcome the limitation by increasing the number of l4 instances load balanced by ecmp.

Fun to see DSR in use.

Also interesting to see that all the inherent problems with geolocation via gslb (DNS client IP is not the same as the real client IP) don't wind up being a big problem apparently. This seems to be a growing concern in my experience: users aren't located where thier ISP DNS servers are located.

Re: Building a Billion User Load Balancer [video]

#18
post #2

Map of Google data centers: http://imgur.com/l1dDdQe Map of Facebook data centers and PoP: http://imgur.com/dek8ESX

I'm surprised that neither have any datacenters in India. Does anyone know why this might be?

My intuition tells me it's a combination of:

* They eventually will build one, but Indian consumers are (as of right now) less valuable to them (from an ad targeting perspective) than other geographies e.g. the economic/time/effort investment ROI is better elsewhere in the short term

* SE Asia (and their POPs there) have reasonable connectivity to India, so it might good enough for the time being

Re: Building a Billion User Load Balancer [video]

#19
post #18

Earlier quoted context omitted.

I'm surprised that neither have any datacenters in India. Does anyone know why this might be?

My intuition tells me it's a combination of: * They eventually will build one, but Indian consumers are (as of right now) less valuable to them (from an ad targeting perspective) than other geographies e.g. the economic/time/effort investment ROI is better elsewhere in the short term * SE Asia (and their POPs there) have reasonable connectivity to India, so it might good enough for the time being

That's not quite the answer he gave to this exact question in the video: geopolitics and cost were the major reasons, they want pops there.

Re: Building a Billion User Load Balancer [video]

#20
post #2

Map of Google data centers: http://imgur.com/l1dDdQe Map of Facebook data centers and PoP: http://imgur.com/dek8ESX

I wonder what the reasons behind their similar distribution are. One is surely the density of users, but maybe there are others related to the actual hosting, like cost, law or infrastructure.

Both companies have looked for optimal choices, taking into account all factor, it is logic that they ended up with the same answers.
Post reply on HN