MS Azure down: An emerging issue is being investigated • Hacker News Board

Re: MS Azure down: An emerging issue is being investigated

#31

Post by reasonabl_human » Thu, Apr 01, 2021, 10:51 PM UTC

mnordhoff wrote: post #29

king_magic wrote: post #3

bing.com, status.azure.com, status2.azure.com - all down. Can't sign into portal.azure.com, can't hit Azure File Shares, etc. The last outage a few days ago was enough for my company to up and move most of our stuff to AWS. This new outage is enough for us to fully migrate away from Azure. What a cluster.

Instead of going from relying on a single provider to relying on a single provider, you could use both AWS and Azure.

This is the right answer from a proper dev ops and opsec POV

Re: MS Azure down: An emerging issue is being investigated

#32

Post by Scene_Cast2 » Thu, Apr 01, 2021, 10:52 PM UTC

I found out about this because I almost lost a password with bitwarden just now. Their "add new password" prompt is failing silently.

Re: MS Azure down: An emerging issue is being investigated

#33

Post by Elgolfin » Thu, Apr 01, 2021, 10:53 PM UTC

king_magic wrote: post #3

bing.com, status.azure.com, status2.azure.com - all down. Can't sign into portal.azure.com, can't hit Azure File Shares, etc. The last outage a few days ago was enough for my company to up and move most of our stuff to AWS. This new outage is enough for us to fully migrate away from Azure. What a cluster.

Speaking of this. There is always this kind of conclusion every time there is a major outage on a cloud provider. I am not sure one is better than the others. Though, I would prefer to rely on facts and numbers instead of feelings. So, is there a website that monitors and keeps track of this kind of major outages for all the 3 big Cloud providers (AWS, Azure, GCP)? So that we can compare their resilience?

Re: MS Azure down: An emerging issue is being investigated

#34

Post by smitop » Thu, Apr 01, 2021, 10:55 PM UTC

Looks like this took down the national emergency alert system in Canada. I'm registered as an alert LMD (last mile distributor), and Pelmorex (corporation running the system) just emailed me to say "Please note that currently there is an unexpected significant outage on Microsoft Azure that is affecting the availability of the NAADS system and other clients globally. The NAAD System feeds are currently not accessible. We are following up on this and we will update you as soon as the issue is resolved.".

I sure hope there aren't any emergencies in Canada until this is resolved...

Re: MS Azure down: An emerging issue is being investigated

#35

Post by Elgolfin » Thu, Apr 01, 2021, 10:58 PM UTC

reasonabl_human wrote: post #31

mnordhoff wrote: post #29

Earlier quoted context omitted.

Instead of going from relying on a single provider to relying on a single provider, you could use both AWS and Azure.

This is the right answer from a proper dev ops and opsec POV

The solution may have a serious cost depending on your architecture. You will have to make sure it is worth the investment. Replicating and keeping a whole infrastructure stand-by is not an easy job for an one-hour outage. Sometimes, it is not the right solution either. It really depends on the business you are in.

Re: MS Azure down: An emerging issue is being investigated

#36

Post by lima » Thu, Apr 01, 2021, 10:58 PM UTC

ceejayoz wrote: post #23

feyman_r wrote: post #19

Earlier quoted context omitted.

AWS: https://downdetector.com/status/aws-amazon-web-services/ Cloudflare: https://downdetector.com/status/cloudflare/

DownDetector is worthless. There’s no reason to put any stock in it. Look at the comments on any entry and it’s clear people do stuff like report “outages” for Google because a random website won’t work in Chrome.

The data is still useful in aggregate.

Re: MS Azure down: An emerging issue is being investigated

#37

Post by basilgohar » Thu, Apr 01, 2021, 10:58 PM UTC

ceejayoz wrote: post #14

sufyanadam wrote: post #8

Teams is down too

I can’t play Flight Simulator, even, as apparently setting up offline mode requires being online.

This demonstrates one of my least favorite dark patterns of recent software.

Re: MS Azure down: An emerging issue is being investigated

#38

Post by PretzelPirate » Thu, Apr 01, 2021, 11:03 PM UTC

smitop wrote: post #34

Looks like this took down the national emergency alert system in Canada. I'm registered as an alert LMD (last mile distributor), and Pelmorex (corporation running the system) just emailed me to say "Please note that currently there is an unexpected significant outage on Microsoft Azure that is affecting the availability of the NAADS system and other clients globally. The NAAD System feeds are currently not accessible…

Why would Canada deploy this to a single provider? A national alert system should have a better DR plan than that.

Re: MS Azure down: An emerging issue is being investigated

#39

Post by qbasic_forever » Thu, Apr 01, 2021, 11:03 PM UTC

Scene_Cast2 wrote: post #32

I found out about this because I almost lost a password with bitwarden just now. Their "add new password" prompt is failing silently.

Yikes! That's not a good failure mode at all.

Re: MS Azure down: An emerging issue is being investigated

#40

Post by ceejayoz » Thu, Apr 01, 2021, 11:03 PM UTC

lima wrote: post #36

ceejayoz wrote: post #23

Earlier quoted context omitted.

DownDetector is worthless. There’s no reason to put any stock in it. Look at the comments on any entry and it’s clear people do stuff like report “outages” for Google because a random website won’t work in Chrome.

The data is still useful in aggregate.

Marginally, if anything. Non-technical users misattribute and misunderstand causes of outages.

There’s a comment on the AWS page complaining that iTunes gift cards are being slow to arrive. The Google page has people who think the comments are the place to talk to Google support.

A major outage will make itself known in far clearer ways.