Microsoft Azure Outage • Hacker News Board

Re: Microsoft Azure Outage

#31

Post by photorized » Wed, Nov 19, 2014, 4:43 AM UTC

photorized wrote: post #26

I feel like an idiot. MS featured my Azure startup today, quoting me about overall stability etc (which has been the case for us, until today). They then proceeded to go down, taking all our production systems with them. (yes we do have AWS, too) Sigh.

Microsoft, you've got to be kidding me. Just tried opening a billing ticket, completed the forms in detail, attached screenshots, clicked Submit...

'Unable to Submit Request We are unable to complete the incident submission process at this time. Please refer to this page for phone numbers to call for Azure support.'

Re: Microsoft Azure Outage

#32

Post by Encosia » Wed, Nov 19, 2014, 4:49 AM UTC

photorized wrote: post #31

photorized wrote: post #26

I feel like an idiot. MS featured my Azure startup today, quoting me about overall stability etc (which has been the case for us, until today). They then proceeded to go down, taking all our production systems with them. (yes we do have AWS, too) Sigh.

Microsoft, you've got to be kidding me. Just tried opening a billing ticket, completed the forms in detail, attached screenshots, clicked Submit... 'Unable to Submit Request We are unable to complete the incident submission process at this time. Please refer to this page for phone numbers to call for Azure support.'

For what it's worth, I've been watching several Azure-hosted sites that I control and they've been coming back online sequentially (and are all back online now). Whatever they're fixing, it seems to be taking some time, but is progressing steadily at a good pace in the last hour.

Re: Microsoft Azure Outage

#33

Post by inglor » Wed, Nov 19, 2014, 4:54 AM UTC

Our sites have been down for more than 3 hours now.

EDIT2: Now the databases are down, this is costing us a lot of money. EDIT: Just went up again.

It would be great if anyone knows how to mitigate these in the future - what can I do to protect myself against this in the future? (Except leave Azure)

Re: Microsoft Azure Outage

#34

Post by ZoF » Wed, Nov 19, 2014, 4:57 AM UTC

craigvn wrote: post #25

jedgrant wrote: post #22

Regretting the decision to go with Azure. Talk about terrible timing. We have media outlets interested in our site, we send info and the site is dead. Talk about a crap first impression.

It is totally frustrating, but at the end of the day similar outages happen with all cloud providers.

Can you point to an example of this happening on AWS in multiple regions simultaneously?

Re: Microsoft Azure Outage

#35

Post by ballstothewalls » Wed, Nov 19, 2014, 4:58 AM UTC

unclesaamm wrote: post #24

zaroth wrote: post #21

That status table with all the randomly located green checks is painful to look at... I guess a green check in the 'Global' column implies a green check in all location specific columns? But what about all the rows which have no Global green check, but most columns are still empty? Are those regions where the service is not deployed? Can we gray out those boxes or something if they are 'N/A'? Also, funny if you try t…

Running Chrome 38.0.2125.111 m, zoomed out row headers look fine

Are you confusing row headers and column headers? I have the same version as you and the row headers got funky when zoomed out.

Re: Microsoft Azure Outage

#36

Post by photorized » Wed, Nov 19, 2014, 5:00 AM UTC

Encosia wrote: post #32

photorized wrote: post #31

Earlier quoted context omitted.

Microsoft, you've got to be kidding me. Just tried opening a billing ticket, completed the forms in detail, attached screenshots, clicked Submit... 'Unable to Submit Request We are unable to complete the incident submission process at this time. Please refer to this page for phone numbers to call for Azure support.'

For what it's worth, I've been watching several Azure-hosted sites that I control and they've been coming back online sequentially (and are all back online now). Whatever they're fixing, it seems to be taking some time, but is progressing steadily at a good pace in the last hour.

Mine have been gradually coming back, too.

Timing couldn't have been any better for me. Some Alanis material there:

https://twitter.com/bizspark/status/534858596748906496

Now I'll have to distribute between AWS and Azure, too.

Re: Microsoft Azure Outage

#37

Post by scoj » Wed, Nov 19, 2014, 5:00 AM UTC

There really isn't anything I can do either. My VM isn't back up yet. I'd go to sleep and just expect it to be online in the morning (when it really matters), but I'm afraid a drive won't reattach or something like that. Meanwhile, twiddling thumbs...hit F5...twiddle thumbs...)

Re: Microsoft Azure Outage

#38

Post by BeeDunc » Wed, Nov 19, 2014, 5:01 AM UTC

This outage exposes the clowns that actually chose Azure as their cloud provider. If you use AMZN and it goes down, at least you're in good company, with the likes of Netflix, Twitter, Instagram, and so on. It's like yeah, I'm big like they are. So what, it went down, so is Netflix.

What does your client/customer think of you being on Azure? That you chose the crappy solution because your low-tech infrastructure still uses windows, which does not carry a lot of tech cred.

Re: Microsoft Azure Outage

#39

Post by barkingllama » Wed, Nov 19, 2014, 5:10 AM UTC

inglor wrote: post #33

Our sites have been down for more than 3 hours now. EDIT2: Now the databases are down, this is costing us a lot of money. EDIT: Just went up again. It would be great if anyone knows how to mitigate these in the future - what can I do to protect myself against this in the future? (Except leave Azure)

On site disaster recovery? Off site disaster recovery? Split your hosting between multiple providers?

It really depends on how much risk you're willing to accept, and how much that is worth to you. It can be quantified via revenue lost, but reputation is much harder to put a number on.

Re: Microsoft Azure Outage

#40

Post by photorized » Wed, Nov 19, 2014, 5:10 AM UTC

inglor wrote: post #33

Our sites have been down for more than 3 hours now. EDIT2: Now the databases are down, this is costing us a lot of money. EDIT: Just went up again. It would be great if anyone knows how to mitigate these in the future - what can I do to protect myself against this in the future? (Except leave Azure)

Azure + AWS