Live data from Hacker News

Dropbox traffic infrastructure: Edge network

blogs.dropbox.com

71–80 of 91 posts

Re: Dropbox traffic infrastructure: Edge network

#71
post #22

TIL about https://github-debug.com/ and https://www.fastly-debug.com/ and https://dropbox-debug.com/ - neat pattern.

pretty cool. quick question, why not just make - https://github.debug or - https://debug.github.com

The main principle here is to reuse as less infra as possible: different dns provider, different hosting, different cert authority, etc. So, debug.github.com is probably worse, than github-debug.com (github.debug should be fine though, and even slightly better than github-debug.com)

Re: Dropbox traffic infrastructure: Edge network

#72

Earlier quoted context omitted.

pretty cool. quick question, why not just make - https://github.debug or - https://debug.github.com

The main principle here is to reuse as less infra as possible: different dns provider, different hosting, different cert authority, etc. So, debug.github.com is probably worse, than github-debug.com (github.debug should be fine though, and even slightly better than github-debug.com)

thank you! i understand now.

Re: Dropbox traffic infrastructure: Edge network

#73
post #6

Thanks for the post! Typo at gradient decent (descent) mention.

Ouch, that was embarrassing -- thanks for spotting =) Sorry about that -- ESL and stuff. Editors did a hell of a job fixing our English, but errors still slipped in. We'll be fixing grammar (and probably add link to the presentation PDF) later this week.

Re: Dropbox traffic infrastructure: Edge network

#74
How are TCP connections established while using anycast ?

I was reading https://serverfault.com/questions/279482/what-is-the-differe... to understand what exactly is unicast, anycast, etc. It seems like TCP works with unicast.

With GeoDNS users requests will be resolved to single IP address with which they can establish a TCP connection.

How, will connection establishment (TCP specifically) work with anycast ? Where request (packets ?) can be routed to different machines ? Is there some other network protocol to use with anycast ?

I was going through: https://serverfault.com/questions/616412/how-does-anycast-wo... , not sure it is the 2018 way of doing these things.

Sorry for dumb questions, network newbie here.

Re: Dropbox traffic infrastructure: Edge network

#75
post #70

Earlier quoted context omitted.

pretty cool. quick question, why not just make - https://github.debug or - https://debug.github.com

Why would that be better?

To isolate possible issues with gtld, dns + glue records, registrar, domain blocking (corporate firewalls, restricted/compromised user dns, malware) that affects .com (the github.debug that is, debug.github.com is not a good solution for the above reasons)

Re: Dropbox traffic infrastructure: Edge network

#76

How are TCP connections established while using anycast ? I was reading https://serverfault.com/questions/279482/what-is-the-differe... to understand what exactly is unicast, anycast, etc. It seems like TCP works with unicast. With GeoDNS users requests will be resolved to single IP address with which they can establish a TCP connection. How, will connection establishment (TCP specifically) work with anycast ? Where…

Read more on anycast. Anycast lets different computers advertise the same IP address from multiple places. When your computer tries to talk to that IP address (over whatever protocol you chose) the network sends that traffic to the “closest” computer advertising that IP address.

TCP builds a reliable stream on top of unreliable IP packets. Since which computer is “closest” rarely changes, your stream will keep being sent to the same server. When that server stops advertising the IP, then the data will get sent to a different server which will say “I don’t know what you are talking about, Reset your stream” and the tcp connection will close, basically.

Re: Dropbox traffic infrastructure: Edge network

#77

How are TCP connections established while using anycast ? I was reading https://serverfault.com/questions/279482/what-is-the-differe... to understand what exactly is unicast, anycast, etc. It seems like TCP works with unicast. With GeoDNS users requests will be resolved to single IP address with which they can establish a TCP connection. How, will connection establishment (TCP specifically) work with anycast ? Where…

Anycast route election is done by the connecting router (typically the clients ISP), and it works over bgp like normal route advertising - it's transparent to your applications and they only get directed to one endpoint destination (typically the one with the lowest latency, congestion, or cost). Once the router gets a request from a client for a destination, it does the same thing it usually does and checks the possible routes and chooses the "best" based on the rules defined by the owner of the router. The difference here is that not all of those proposed routes make it to the same physical destination. There is some stickyness to make sure you're arriving at the same destination for the duration of that connection.

Really it's like asking your favorite maps app where McDonalds is - it'll know to give you results close to you, since it knows there are many McDonalds. It would make sense for you to choose the closest, but it's not enforced by McDonalds. Similarly, if I do the same and we live in different cities, we'll get different results. The end result is that we both got to different physical places by specifying the same thing, and it's up to McDonalds to make sure the menu is the same :)

Re: Dropbox traffic infrastructure: Edge network

#78
post #37

Earlier quoted context omitted.

I'm also curious how torrents are used and why.

I would guess that they do something similar to Facebook. Ars covered what Facebook do about 6 years ago, and even then I think they'd been using it for a few years: https://arstechnica.com/information-technology/2012/04/exclu... I believe Twitter does something similar too.

Twitter dis use BitTorrent for deploying, in a project called murder: https://blog.twitter.com/engineering/en_us/a/2010/murder-fas...

Not sure they're still using this

Post reply on HN