Netflix is Down

#1

Post by bavidar » Tue, Dec 25, 2012, 1:55 AM UTC

Re: Netflix is Down

#2

Post by yoda_sl » Tue, Dec 25, 2012, 2:04 AM UTC

The net says it is mostly on the East coast but I am in California just a few miles from Netflix HQ and it is down for me on my iPad. I should try on the Apple TV since they mentioned that it is working on other devices. I will be curious to hear the post mortem of the outage from both AWS and Netflix. The timing I am sure doesn't help with Christmas Eve around the corner and probably many engineers not reachable quickly.

Re: Netflix is Down

#3

Post by yoda_sl » Tue, Dec 25, 2012, 2:05 AM UTC

yoda_sl wrote: post #2

The net says it is mostly on the East coast but I am in California just a few miles from Netflix HQ and it is down for me on my iPad. I should try on the Apple TV since they mentioned that it is working on other devices. I will be curious to hear the post mortem of the outage from both AWS and Netflix. The timing I am sure doesn't help with Christmas Eve around the corner and probably many engineers not reachable qui…

Interesting to see that the outage is in fact all over the place as the comments below are showing: http://www.isitdownrightnow.com/netflix.com.html

Re: Netflix is Down

#4

Post by bavidar » Tue, Dec 25, 2012, 2:15 AM UTC

you would think they would have learned to build redundancy into these types of systems.

Re: Netflix is Down

#5

Post by pbiggar » Tue, Dec 25, 2012, 2:15 AM UTC

Interesting that Heroku rode this one out. Any Heroku engineers want to tell us your LB setup? Do you use ELB?

Re: Netflix is Down

#6

Post by zrail » Tue, Dec 25, 2012, 2:19 AM UTC

pbiggar wrote: post #5

Interesting that Heroku rode this one out. Any Heroku engineers want to tell us your LB setup? Do you use ELB?

Heroku did not ride this one out. I have an app right now behind a failed ELB.

https://status.heroku.com/incidents/479

Edit: Make that two apps.

Re: Netflix is Down

#7

Post by pbiggar » Tue, Dec 25, 2012, 2:23 AM UTC

zrail wrote: post #6

pbiggar wrote: post #5

Interesting that Heroku rode this one out. Any Heroku engineers want to tell us your LB setup? Do you use ELB?

Heroku did not ride this one out. I have an app right now behind a failed ELB. https://status.heroku.com/incidents/479 Edit: Make that two apps.

Oh right. I just checked Heroku.com.

Re: Netflix is Down

#8

Post by criswell » Tue, Dec 25, 2012, 2:24 AM UTC

Someone's Christmas Eve just went south. Godspeed.

Re: Netflix is Down

#9

Post by protomyth » Tue, Dec 25, 2012, 2:25 AM UTC

yoda_sl wrote: post #2

The net says it is mostly on the East coast but I am in California just a few miles from Netflix HQ and it is down for me on my iPad. I should try on the Apple TV since they mentioned that it is working on other devices. I will be curious to hear the post mortem of the outage from both AWS and Netflix. The timing I am sure doesn't help with Christmas Eve around the corner and probably many engineers not reachable qui…

Apple TV in St. Paul, MN failed so I don't think the east coast thing is true. Parents are not happy campers. I get the feeling all iOS devices are include.

Re: Netflix is Down

#10

Post by pixie_ » Tue, Dec 25, 2012, 2:25 AM UTC

bavidar wrote: post #4

you would think they would have learned to build redundancy into these types of systems.

They have been working hard on this very issue..

http://techblog.netflix.com/2012/07/chaos-monkey-released-in...

It'll be interesting to see what failed when they put out a statement.