Live data from Hacker News

Obama Campaign AWS Infrastructure In One Diagram

awsofa.info

31–40 of 106 posts

Re: Obama Campaign AWS Infrastructure In One Diagram

#31
It's interesting that apart from the DynamoDB and the SQL Warehouse (Redshaft?) there's a pretty large LevelDB instance serving the sites/services.

I also wonder if in reality there were only one or two instances in each zone for each site behind the ELBs and the others were added to show how scalable the infrastructure is; or if their number actually did correspond to the avg. number of instances they ended up having to spin up.

Re: Obama Campaign AWS Infrastructure In One Diagram

#32

Earlier quoted context omitted.

Amazon hosted all these servers for free?

All of you should know that this was paid with campaign dollars, not government funds. To pretend otherwise is an incredible indictment of our education system and an example of the assault on k-12 civics courses.

We have K-12 civics courses?

Re: Obama Campaign AWS Infrastructure In One Diagram

#33
Wish this had a legend. Obviously the box sizes and positioning mean something.

What I can see makes me a bit curious.

- Frontend Web boxes are "big", where the (some) of the backend App boxes are small. I'd have though it would be the reverse -- frontend horizontally scaled first, backend vertically scaled first.

- Sometimes they use Zones ABC, sometimes AB. This is cool, but a lot of the "front" infrastructure is AB (including www), so not sure what advantage having ABC on backend pieces are. These are obviously super-critical for some special reason? I guess they also might be pieces that are-not/only-partially replicated to the secondary site.

- The failover US-West site is using Asgard along with Puppet, but the primary US-East one isn't. I guess this is for managing failure scenarios?

- Prodigious use of a lot of AWS services. Including internal ELBs all over the place. SQL Server and PostgreSQL sneak in a few places.

- Couldn't find the CDN!

- Looks like staging and testing are a complete replica (hard to tell, the resolution isn't quite there). They're big though. This is fine, but raises the question why the secondary site is just a part replica? If you provision the lot to stage, you'd figure you'd run the secondary the same way?

- The Data Warehouse runs on the secondary site, but it only accessed from the primary. Interesting. Wonder why they just didn't put it on the primary?

Re: Obama Campaign AWS Infrastructure In One Diagram

#35
post #32

Earlier quoted context omitted.

All of you should know that this was paid with campaign dollars, not government funds. To pretend otherwise is an incredible indictment of our education system and an example of the assault on k-12 civics courses.

We have K-12 civics courses?

I attended school in USA grades 7 - 11 and I did not have a civics class. Is civics part of the standard curriculum?

Re: Obama Campaign AWS Infrastructure In One Diagram

#37
The most surprising thing about this is that test and staging are 1:1 duplicates of production. At the companies I've worked at dealing in scale, that has never been the case.

"Oh, you run 10 servers and 2 load balancers across these 2 sub-systems? Here's 2 servers and a toy whistle for staging."

But then again, I suppose that's what you get when you can dump hundreds of millions of dollars on a problem over a couple years.

Re: Obama Campaign AWS Infrastructure In One Diagram

#38
post #2

Where did this lovely map come from and how can I generate my own?

I tried to figure out what software this was from, but I gave up. I did find that Wikipedia has a nice list of network diagram software here http://en.wikipedia.org/wiki/Comparison_of_network_diagram_s...

I'd love to describe a network in (something like) graphviz dot notation and get a diagram that looks like this out the other end. Usually I wind up just using Visio and doing it by hand because work pays for it anyway, and it's actually very nice.

Re: Obama Campaign AWS Infrastructure In One Diagram

#39
post #32

Earlier quoted context omitted.

We have K-12 civics courses?

I attended school in USA grades 7 - 11 and I did not have a civics class. Is civics part of the standard curriculum?

Texas public school, we studied government in the 12th year.

Re: Obama Campaign AWS Infrastructure In One Diagram

#40
post #21

Harper Reed and Scott VanDenPlas did a talk / Q&A at the Chicago AWS meetup group a few months ago. My hazy recollection of the salient points of the talk: 1) This represents a heterogenous set of services where the engineers in charge of each service were more-or-less free to use whatever technology stack they were most comfortable with. 2) Use puppet for provisioning everything. (There is some subtlety Scott went i…

Kinda odd saying that it has an expiration date. Aren't the same systems required for the next election?
Post reply on HN