Live data from Hacker News

Tell HN: Azure outage

news.ycombinator.com

451–460 of 841 posts

Re: Tell HN: Azure outage

#451

Wasn't the saying "It's always DNS" floating around somewhere? Be interesting to understand cause here. Pretty big impact on services we use

Could be DNS, I'm seeing SERVFAIL trying to resolve what look to be MS servers when I'm hitting (just one example) mygoodtogo.com (trying to pay a road toll bill, and failing).

Re: Tell HN: Azure outage

#453
post #87

I noticed that Starbucks mobile ordering was down and thought “welp, I guess I’ll order a bagel and coffee on Grubhub”, then GrubHub was down. My next stop was HN to find the common denominator, and y’all did not disappoint.

My inner Nelson-from-the-Simpsons wishes I was on your team today, able to flaunt my flask of tea and homemade packed sandwiches. I would tease you by saying 'ha ha!' as your efforts to order coffee with IP packets failed.

I always go everywhere adequately prepared for beverages and food. Thanks to your comment, I have a new reason to do so. Take out coffees are actually far from guaranteed. Payment systems could go down, my bank account could be hacked or maybe the coffee shop could be randomly closed. Heck, I might even have an accident crossing the road. Anything could happen. Hence, my humble flask might not have the top beverage in it but at least it works.

We all design systems with redundancy, backups and whatnot, but few of us apply this thinking to our food and drink. Maybe get a kettle for the office and a backup kettle, in case the first one fails?

Re: Tell HN: Azure outage

#454
post #375

We’re 100% on Azure but so far there’s no impact for us. Luckily, we moved off Azure Front Door about a year ago. We’d had three major incidents tied to Front Door and stopped treating it as a reliable CDN. They weren’t global outages, more like issues triggered by new deployments. In one case, our homepage suddenly showed a huge Microsoft banner about a “post-quantum encryption algorithm” or something along those li…

Outages are one thing, but having your content polluted seems like a more serious problem? Unless you subscribed to microsoft banners somehow.

Re: Tell HN: Azure outage

#455
post #375

We’re 100% on Azure but so far there’s no impact for us. Luckily, we moved off Azure Front Door about a year ago. We’d had three major incidents tied to Front Door and stopped treating it as a reliable CDN. They weren’t global outages, more like issues triggered by new deployments. In one case, our homepage suddenly showed a huge Microsoft banner about a “post-quantum encryption algorithm” or something along those li…

Outages are one thing, but having your content polluted seems like a more serious problem? Unless you subscribed to microsoft banners somehow.

And it was HUGE, the microsoft logo was like 50% of the screen.

Re: Tell HN: Azure outage

#456
post #246

So that's why I can't check in for my Alaska Airlines flight... https://news.microsoft.com/source/features/digital-transform...

Pretty much every single Microsoft domain I've tried to access loads for a looooong time before giving me some bare html. I wonder if someone can explain why that's happening.

Re: Tell HN: Azure outage

#457
post #87

I noticed that Starbucks mobile ordering was down and thought “welp, I guess I’ll order a bagel and coffee on Grubhub”, then GrubHub was down. My next stop was HN to find the common denominator, and y’all did not disappoint.

Wow I just left a Starbucks drivethru line because it was just not moving. I guess it was because of this.

You'd think that Starbucks execs would be held accountable for the fragile system they have put in place.

But they won't be.

Re: Tell HN: Azure outage

#459
post #407

Earlier quoted context omitted.

The only reason you'd notice MS was down was if Github was down....

GitHub doesn't use Azure yet, but has just published their migration path to azure a few days ago. I would link to that article, but that one does seem down ;)

https://www.githubstatus.com/incidents/4jxdz4m769gy

> They're stating they're working with the Azure teams, so I suspect this is related.

Re: Tell HN: Azure outage

#460
post #327
post #149

Earlier quoted context omitted.

Good thing HN is hosted on a couple servers in a basement. Much more reliable than cloud, it seems!

Just don't use genetically identical hardware: https://news.ycombinator.com/item?id=32031639 https://news.ycombinator.com/item?id=32032235 Edit: wow, I can't believe we hadn't put https://news.ycombinator.com/item?id=32031243 in https://news.ycombinator.com/highlights . Fixed now.

I got burnt by this bug on freakin' Christmas Eve 2020 ( https://forum.hddguru.com/viewtopic.php?f=10&t=40766 ). There was some data loss and a lot of lessons learned.
Post reply on HN