Vibe coded internet keeps getting better
You just paste the outage error codes back to the LLM and pray it's still working and can fix whatever went wrong!
Tell HN: Azure outage
241–250 of 841 posts
Re: Tell HN: Azure outage
#242Earlier quoted context omitted.
It's pretty unlikely. AWS published a public 'RCA' https://aws.amazon.com/message/101925/ . A race condition in a DNS 'record allocator' causing all DNS records for DDB to be wiped out. I'm simplifying a bit, but I don't think it's likely that Azure has a similar race condition wiping out DNS records on _one_ system than then propagates to all others. The similarity might just end at "it was DNS".
That RCA was fun. A distributed system with members that don't know about each other, don't bother with leader elections, and basically all stomp all over each other updating the records. It "worked fine" until one of the members had slightly increased latency and everything cascade-failed down from there. I'm sure there was missing (internal) context but it did not sound like a well-architected system at all.
Re: Tell HN: Azure outage
#243Earlier quoted context omitted.
AFD is down quite often regionally in Europe for our services. In 50%+ the cases they just don‘t report it anywhere, even if its for 2h+.
Spam those Azure tickets. If you have a CSAM, build them a nice powerpoint telling the story of all your AFD issues (that's what they are there for). > In 50%+ the cases they just don‘t report it anywhere, even if its for 2h+. I assume you mean publicly. Are you getting the service health alerts?
Re: Tell HN: Azure outage
#244Yesterday Amazon, today Microsoft. Are Google's cloud services going down tomorrow?
This is because Azure just copies everything AWS does. Google is a bit more innovative, they will have something else unexpected happen.
Re: Tell HN: Azure outage
#245Just another day with microsoft. Honestly pretty tiring as something is always generally broken.
Re: Tell HN: Azure outage
#246Re: Tell HN: Azure outage
#247Re: Tell HN: Azure outage
#248Update 16:57 UTC: Azure Portal Access Issues Starting at approximately 16:00 UTC, we began experiencing Azure Front Door issues resulting in a loss of availability of some services. In addition. customers may experience issues accessing the Azure Portal. Customers can attempt to use programmatic methods (PowerShell, CLI, etc.) to access/utilize resources if they are unable to access the portal directly. We have faile…
Yet another reason to move away from Front Door. We already had to do it for large files served from Blob Storage since they would cap out at 2MB/s when not in cache of the nearest PoP. If you’ve ever experienced slow Windows Store or Xbox downloads it’s probably the same problem. I had a support ticket open for months about this and in the end the agent said “this is to be expected and we don’t plan on doing anythin…
Re: Tell HN: Azure outage
#249Meanwhile the layoffs continue https://www.entrepreneur.com/business-news/microsoft-ceo-exp...
> [Satya Nadella] said that the company’s future opportunity was to bring AI to all eight billion people on the planet. But what if I don't want AI brought to me?
Re: Tell HN: Azure outage
#250Doesn't seem to be too bad of an outage unless you were relying on Azure Front Door.