Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Azure DevOps is down globally

news.ycombinator.com

Post reply on HN
Print view View original

41–50 of 55 posts

Re: Azure DevOps is down globally

#41

Post by BandButcher »

MuffinFlavored wrote: post #27

What could possibly cause this kind of outage? Loss of a datacenter? Physical problem? How can a "DNS" problem (or something similar) be this widescale?

I remember something with facebook? where their internal DNS was misconfigured.

edit:

"This change caused a complete disconnection of our server connections between our data centers and the internet. And that total loss of connection caused a second issue that made things worse. "

https://engineering.fb.com/2021/10/05/networking-traffic/out...

https://blog.cloudflare.com/october-2021-facebook-outage/

https://www.thousandeyes.com/blog/facebook-outage-analysis

Not sure if MS is going through the same issue but DNS could be a reason why

Re: Azure DevOps is down globally

#42

Post by cr125rider »

emunday_bbc wrote: post #35
candiddevmike wrote: post #12

GitHub Actions is also degraded, coincidence? https://www.githubstatus.com/ For me, pipelines are queuing and not even scheduling jobs on self hosted runners.

Feel free to use this free time to take a peek at Bitbucket Pipeline, now running up-to 8x faster ;) https://bitbucket.org/blog/announcing-our-new-ci-cd-runtime-... Come check out some of our cool new features while you're at it: - https://bitbucket.org/blog/introducing-dynamic-pipelines-a-n... - https://bitbucket.org/blog/custom-merge-checks-are-now-gener...

Great to see you guys engaging the community. Bitbucket may be 10 years behind GitHub, but the simplicity of pipelines is nice.

Re: Azure DevOps is down globally

#43

Post by hnburnsy »

Frontier Airlines is dead in the water...

>Our systems are currently impacted by a Microsoft outage, which is also affecting other companies. During this time booking, check-in, access to your boarding pass, and some flights may be impacted. We appreciate your patience.

Re: Azure DevOps is down globally

#45

Post by RajT88 »

MrLeap wrote: post #30
blondin wrote: post #26

Earlier quoted context omitted.

very surprised by all the infrastructure hosted in us central. the page claims codespaces is functional but it clearly is not. it fails at loading vscode after bootstrapping the environment.

Is it surprising? Dallas, STL, KC, Chicago all count as central. More or less equidistant for east/west coast markets. Seems like natural edge node coordinates along the scale ladder.

"Central US" in this case, means the Des Moines, IA set of data centers.

https://datacenters.microsoft.com/globe/explore/

Re: Azure DevOps is down globally

#49

Post by barkingcat »

MuffinFlavored wrote: post #27

What could possibly cause this kind of outage? Loss of a datacenter? Physical problem? How can a "DNS" problem (or something similar) be this widescale?

DNS is definitely capable of widescale disruption.

A dns error can take down the entire internet.

Re: Azure DevOps is down globally

#50

Post by raxxorraxor »

lukeschlather wrote: post #18

It seems like Azure DevOps migrated to some new login mechanism recently which is visibly slower than the old one, and I was seeing random failures prior to today.

I believe that was a change to auth from a few weeks ago and is affecting every MS service. Not sure though and it does work, but it doesn't work gracefully.
Post reply on HN