Microsoft Azure suffers outage after cooling issue • Hacker News Board

Re: Microsoft Azure suffers outage after cooling issue

#11

Post by p2t2p » Tue, Sep 04, 2018, 9:59 PM UTC

And I was wondering why my App.Gateways are not deploying last night

Re: Microsoft Azure suffers outage after cooling issue

#12

Post by Someone1234 » Tue, Sep 04, 2018, 10:01 PM UTC

karmicthreat wrote: post #5

So AWS has had some big outages, as has Azure. Has GCP had any big outages yet?

AWS and Azure have had "big" outages people because actually use them. Rackspace and IBM are almost neck and neck with Google's best efforts (3% markshare Vs. 30%/40% for Azure/AWS)[0].

[0] https://www.skyhighnetworks.com/cloud-security-blog/microsof...

Re: Microsoft Azure suffers outage after cooling issue

#13

Post by lozaning » Tue, Sep 04, 2018, 10:12 PM UTC

haroldp wrote: post #7

GFischer wrote: post #2

We're affected by this issue. And we had our alerts system in Azure as well, so we didn't get alerts about the outage (welp).

You made the same mistake as Microsoft, who seemed to have put their Azure status page on Azure: https://www.reddit.com/r/AZURE/comments/9cvgn2/is_there_a_st... Their status page is back up now, but my stuff's still broken. :\

And Amazon. I recall that during their most recent s3 outage Amazon's status page was green across the board, because somehow all the assets that were supposed to be displayed when things went wrong were themselves hosted on the thing that was down.

Re: Microsoft Azure suffers outage after cooling issue

#14

Post by Memosyne » Tue, Sep 04, 2018, 10:16 PM UTC

The Visual Studio Marketplace is also down https://marketplace.visualstudio.com/.

Re: Microsoft Azure suffers outage after cooling issue

#15

Post by partiallypro » Tue, Sep 04, 2018, 10:22 PM UTC

You can use a VPN to view the status page if it's erroring out for you, I'd also suggest trying to clear your local DNS cache.

Re: Microsoft Azure suffers outage after cooling issue

#16

Post by ZainRiz » Tue, Sep 04, 2018, 10:28 PM UTC

GFischer wrote: post #2

We're affected by this issue. And we had our alerts system in Azure as well, so we didn't get alerts about the outage (welp).

That's why T-Mobile's on-call engineers carry around AT&T phones.

(source: friend who's an engineer at T-Mobile)

Re: Microsoft Azure suffers outage after cooling issue

#17

Post by king_magic » Tue, Sep 04, 2018, 10:31 PM UTC

Edit: out my rant.

It's been a long day because of this. Just going to leave it at that.

Re: Microsoft Azure suffers outage after cooling issue

#18

Post by frigate » Tue, Sep 04, 2018, 10:32 PM UTC

Someone1234 wrote: post #9

Visual Studio Online has been offline all day. They say it is due to the same Azure outage. This has had a productivity impact. If Microsoft didn't own GitHub, this may have prompted a move, but since they do it seems a little redundant given that Github will likely be on Azure too before long. https://blogs.msdn.microsoft.com/vsoservice/?p=17405

VSTS being down all day has had a non-negligible impact for us. We have most of our deployment pipelines there, and they've been inaccessible all day.

Re: Microsoft Azure suffers outage after cooling issue

#19

Post by iamgopal » Tue, Sep 04, 2018, 10:52 PM UTC

karmicthreat wrote: post #5

So AWS has had some big outages, as has Azure. Has GCP had any big outages yet?

Outage is part of life, but Google's is most resilient in my experience.

Re: Microsoft Azure suffers outage after cooling issue

#20

Post by Theodores » Tue, Sep 04, 2018, 11:08 PM UTC

ZainRiz wrote: post #16

GFischer wrote: post #2

We're affected by this issue. And we had our alerts system in Azure as well, so we didn't get alerts about the outage (welp).

That's why T-Mobile's on-call engineers carry around AT&T phones. (source: friend who's an engineer at T-Mobile)

That is a top 'did you know' factoid that I am sure I will tell others.

But do AT+T engineers carry T-Mobile phones?

If yes then they should put themselves together a deal so that none of the on-call engineers have to worry about running up big bills using their phones. When there are freak weather events they are all in it together.