Live data from Hacker News

Azure was having DNS issues

status.azure.com

41–50 of 50 posts

Re: Azure was having DNS issues

#41

https://azure.microsoft.com/en-us/updates/azuredns100sla/?cd... > Azure DNS is now being offered at a 100% availability SLA that's backed by our diverse, geo-redundant DNS infrastructure. > With this update, Azure DNS guarantees that valid DNS requests will receive a response from at least one name server 100% of the time. For details, see the SLA definition. This hasn't aged well

If I understand this correctly, everything unavailable is eligible for a 25% credit, and if the downtime exceeds ~4 hours then it's a free month. Neat!

free month of azure DNS or free month of everything that you can't reach because DNS is down? ;)

Re: Azure was having DNS issues

#43
post #18
post #8

Alternate status page, of course showing all green across the board in typical Azure fashion. https://status2.azure.com/

Does this have to be posted every time some cloud service has issues? We, as in people in this forum, know that status pages are worthless. They’re tools with the explicit purpose of reducing the burden on tier one customer support. That’s it. They are not a public monitoring platform.

As an alternate example, Github tends to have a pretty good status page in my experience. It'll usually be up-to-date within minutes of people chatting about issues on work Slack and gets updated at a regular cadence with details.

AWS on the other hand... We usually just reach out to our TAMs and say "Hey, our application monitoring is showing tons of errors interacting with service X--can you check your super secret internal dashboards and see what the deal is?" It's nice to at least have a "Yeah the service is completely hosed and in a bad place" or a "Yeah, some changes went wrong and are being rolled back". The former usually requires some sort of mitigation while the latter can largely be ignored

Re: Azure was having DNS issues

#44

Github is also having problems. https://www.githubstatus.com/ Coincidence, or have they gotten around to moving some of their infrastructure to Azure since the MS acquisition?

Afaik Actions (maybe Packages, too?) was always built on Azure. I think Github core is on bare-metal

I'm guessing they probably get the elasticity of cloud while paying the wholesale or at-cost of the infrastructure (surely they get some discounts over the advertised price, at least)

Re: Azure was having DNS issues

#45

Earlier quoted context omitted.

If I understand this correctly, everything unavailable is eligible for a 25% credit, and if the downtime exceeds ~4 hours then it's a free month. Neat!

free month of azure DNS or free month of everything that you can't reach because DNS is down? ;)

Whichever they prefer

Re: Azure was having DNS issues

#46

There have been some internal debates about setting up a secondary DNS in case Route53 somehow went down. My reasoning has thusfar been that if Route53 is down, there are probably other AWS services that we depend on that would also be down. What do you guys think? Is secondary DNS in this case worth it?

We're moving towards dual DNS providers. We've been bit by DNS hosting failures too many times, and they're always painful because everything, including monitoring and control systems, end up dead or inaccessible. Not to mention the entire network being down is absurdly expensive if you're paying SLAs.

Re: Azure was having DNS issues

#47
post #38
post #18

Earlier quoted context omitted.

Does this have to be posted every time some cloud service has issues? We, as in people in this forum, know that status pages are worthless. They’re tools with the explicit purpose of reducing the burden on tier one customer support. That’s it. They are not a public monitoring platform.

Having a fully up to date status page is what prevents useless repetitive cases during degradation or an outage. If I'm having issues but you show all green, I'm submitting a case.

For large incumbents, publishing a complete and accurate status page might not only be a recipe for bad press, but also lawsuits. There's significant downside and not much upside to telling the whole truth. It's entirely unsurprising that cloud providers like AWS or Azure would play definitional games w/ what constitutes an outage. Rolling 5m, 1% outage across your entire customer base? That's just a hiccup! If your staff has to field more confused questions and complaints, it's a relatively small price to pay.

Re: Azure was having DNS issues

#50
These problems are actually good in that more organizations - especially big ones - realize that reliability is not something that you can outsource to a single provider and the problem magically disappears. Literally any service you depend on, from DNS to email, should be using redundancy so that when your basket gets squashed, you still have some eggs. Neither Amazon nor Microsoft will tell you that because vendor lock-in is in their best interest. You need to take care of it yourself otherwise you are completely at their mercy.
Post reply on HN