Live data from Hacker News

GitHub is once again down

githubstatus.com

81–90 of 214 posts

Re: GitHub is once again down

#81
post #71

It's starting to really look like the AI effect. It might be coincidence but I've noticed a lot more downtime and bad software lately. The last Nvidia drivers gave me a blue screen (last week or so), and speaking about Windows, I froze updates last year because it was clear they were introducing a bunch of issues with every update (not to mention unwanted features). I like AI but actually not for coding because code…

[dead]

Re: GitHub is once again down

#82
post #59

The worst part of all this is that GitHub's CTO and VP of Engineering sent out the usual "here's what we'll do to fix things" letter to their larger customers and, without exaggeration, it boiled down to: 1) "Here's a bunch of stuff we already did!" which... clearly isn't working, and 2) "We're continuing our Azure migration." also clearly not working. So needless to say, if you depend on GitHub for critical business…

I could sorta see a situation where the reality is "we're in the middle of a miserable transition and it'll clean up when we're done" but I don't think anyone has confidence that's all it is at this point.

Even that doesn’t really make sense to me, unless they’ve done it in a way where everything has to move at once.

Everywhere I’ve worked, if a migration is causing this much downtime then you kill the migration or slow it down. If every change has a 10% chance of bringing the site down, you only do a change every week or two until you can work out the kinks.

Re: GitHub is once again down

#85
post #60

Anyone else notice other Microsoft cloud services ( for instance inside azure ) with bad performance also? I can’t be specific but we are constantly complaining.

The Azure management UI, yes, so slowww. But the services (VMs etc) have been good.

Re: GitHub is once again down

#86
post #42

Took a full 8 years for a Microsoft acquisition to go to shit, which is probably a record. Kudos to the Github team for holding out this long.

I’m still baffled that Minecraft is doing so well, despite the whole Bedrock thing. At this point I think Microsoft just forgot that they bought Mojang.

Re: GitHub is once again down

#88
post #42

Took a full 8 years for a Microsoft acquisition to go to shit, which is probably a record. Kudos to the Github team for holding out this long.

GitHub has always been incredibly outage riddled no? This is not a MSFT thing

I don't remember that happening so much (if ever) in, say, 2016. But the frequency of noticeable incidents seemingly has been rising steadily since around 2023. The Azure migration apparently only exacerbated it.

Re: GitHub is once again down

#90
post #76

Earlier quoted context omitted.

I once worked at a place with more micro services than engineers. We joked about "we have as many 8s of uptime as you need!"

> I once worked at a place with more micro services than engineers. Currently consulting somwhere with 30 services per engineer. I cannot convince them this is hell. Maybe that makes it my personal hell.

Oooof that's rough.

One strategy to convince is to get someone less technical than you to sit by you while you try and trace everything from one error'd HTTP request from start to finish to diagnose the problem. If they see it takes half a day to check every call to every internal endpoint to 100% satisfy a particular request sometimes that can help.

Also sometimes they just think "this is a bunch of nerd stuff, why are you involving me?!" So it's not foolproof.

Post reply on HN