Netflix is Down • Hacker News Board

Re: Netflix is Down

#11

Post by yoda_sl » Tue, Dec 25, 2012, 2:25 AM UTC

bavidar wrote: post #4

you would think they would have learned to build redundancy into these types of systems.

Usually Netflix do well when AWS has an outage... At least in the past that was the case, so it really pick my curiosity on what is the difference with this outage vs the others. In addition it will be interesting to know if the timing of it -aka just before XMas- did affect the responsiveness of the engineers/team for both Amazon and Netflix.

Re: Netflix is Down

#12

Post by zrail » Tue, Dec 25, 2012, 2:25 AM UTC

criswell wrote: post #8

Someone's Christmas Eve just went south. Godspeed.

Seriously. Instead of getting angry at Amazon I'm going to wish them a happy Christmas Eve and hope their collective pagers go quiet soon.

Re: Netflix is Down

#13

Post by chuhnk » Tue, Dec 25, 2012, 2:26 AM UTC

http://status.aws.amazon.com/

Amazon CloudSearch (N. Virginia) - CloudSearch issues

"6:00 PM PST We are continuing to investigate the issue. Domain creation and indexing operations continue to be unavailable. Changes to existing domains may have severe delays in being processed."

Amazon Elastic Compute Cloud (N. Virginia) - Elastic Load Balancer issues

"5:49 PM PST We continue to work on resolving issues with the Elastic Load Balancing Service in the US-EAST-1 region. Traffic for some ELBs are currently experiencing significant levels of traffic loss."

Re: Netflix is Down

#14

Post by zrail » Tue, Dec 25, 2012, 2:30 AM UTC

yoda_sl wrote: post #11

bavidar wrote: post #4

you would think they would have learned to build redundancy into these types of systems.

Usually Netflix do well when AWS has an outage... At least in the past that was the case, so it really pick my curiosity on what is the difference with this outage vs the others. In addition it will be interesting to know if the timing of it -aka just before XMas- did affect the responsiveness of the engineers/team for both Amazon and Netflix.

The difference is that elastic load balancers are the things that actually implement the redundancy in AWS, and if one goes down and another can't be immediately started in it's place, no traffic will be getting to the instances that sit behind it.

I believe AWS has been working on a solution to this, but thus far haven't released anything.

Re: Netflix is Down

#15

Post by jongold » Tue, Dec 25, 2012, 2:32 AM UTC

I hope y'all have Home Alone on DVD…

Re: Netflix is Down

#16

Post by alxndr » Tue, Dec 25, 2012, 2:32 AM UTC

pbiggar wrote: post #7

zrail wrote: post #6

Earlier quoted context omitted.

Heroku did not ride this one out. I have an app right now behind a failed ELB. https://status.heroku.com/incidents/479 Edit: Make that two apps.

Oh right. I just checked Heroku.com.

heroku.com is up for me (near NYC) as are the Heroku-hosted sites we have at work.

Re: Netflix is Down

#17

Post by zrail » Tue, Dec 25, 2012, 2:34 AM UTC

alxndr wrote: post #16

pbiggar wrote: post #7

Earlier quoted context omitted.

Oh right. I just checked Heroku.com.

heroku.com is up for me (near NYC) as are the Heroku-hosted sites we have at work.

It's not every app for me either. It appears to be a subset of apps that use the ssl:endpoint add-on to implement HTTPS.

Re: Netflix is Down

#18

Post by antidoh » Tue, Dec 25, 2012, 2:35 AM UTC

Amazon movie rental over Roku is cutting in and out, and I can't watch Netflix (over Roku) at all. Colorado.

Re: Netflix is Down

#19

Post by jpdevereaux » Tue, Dec 25, 2012, 2:37 AM UTC

How is anyone supposed to enjoy the holidays with their families if they aren't consuming media?

Re: Netflix is Down

#20

Post by smoyer » Tue, Dec 25, 2012, 2:38 AM UTC

Soon it will be news when the N. Virginia services are actually up! I don't want to be too hard on Amazon because what they've built is pretty amazing, but I really have to wonder what's different about the N. Virginia site ... And why they're not having similar failures at the other sites.