Migrating From AWS to FB
instagram-engineering.tumblr.com
Migrating From AWS to FB
1–10 of 94 posts
Re: Migrating From AWS to FB
#2why not just create a vpn between the nodes with another private IP space and send your data through that?
Re: Migrating From AWS to FB
#3> The main blocker to this easy migration was that Facebook’s private IP space conflicts with that of EC2
IPv6 adoption could not happen soon enough.
Re: Migrating From AWS to FB
#4why not just create a vpn between the nodes with another private IP space and send your data through that?
Perhaps that would become a bottleneck at Instagram's scale?
Re: Migrating From AWS to FB
#5Is neti open-source?
Re: Migrating From AWS to FB
#6why not just create a vpn between the nodes with another private IP space and send your data through that?
"This task looked incredibly daunting on the face of it; we were running many thousands of instances in EC2, with new ones spinning up every day. In order to minimize downtime and operational complexity, it was essential that instances running in both EC2 and VPC seemed as if they were part of the same network. AWS does not provide a way of sharing security groups nor bridging private EC2 and VPC networks. The only way to communicate between the two private networks is to use the public address space."
That is essentially what Neti does, except instead of static mappings, its dynamic and software configurable (which is pretty much the only way to go when you're entire environment is virtual and the underlying network equipment is out of your control).
Re: Migrating From AWS to FB
#7why not just create a vpn between the nodes with another private IP space and send your data through that?
"This task looked incredibly daunting on the face of it; we were running many thousands of instances in EC2, with new ones spinning up every day. In order to minimize downtime and operational complexity, it was essential that instances running in both EC2 and VPC seemed as if they were part of the same network. AWS does not provide a way of sharing security groups nor bridging private EC2 and VPC networks. The only w…
Using a VPN would still be an option. Why write essentially your own VPN (neti) instead of using an existing VPN solution? VPC is not the only VPN you can use on EC2.
Re: Migrating From AWS to FB
#8> The main blocker to this easy migration was that Facebook’s private IP space conflicts with that of EC2 IPv6 adoption could not happen soon enough.
I think it has more to do with the fact that there are a standard series of private IP blocks.
Re: Migrating From AWS to FB
#9> The main blocker to this easy migration was that Facebook’s private IP space conflicts with that of EC2 IPv6 adoption could not happen soon enough.
I think it has more to do with the fact that there are a standard series of private IP blocks.
Right, but if everyone used IPv6 there would be no need to use non-routeable private IPs for anything, you could just use non-conflicting IPv6 addresses and not route them.
Re: Migrating From AWS to FB
#10> The main blocker to this easy migration was that Facebook’s private IP space conflicts with that of EC2 IPv6 adoption could not happen soon enough.
Facebook supports ipv6, but maybe it is external only? I know Google is ipv6 internally too. Although as EC2 has no ipv6 maybe that was the blocking issue.