Live data from Hacker News

GitHub Actions and Pages are experiencing degraded availability

githubstatus.com

201–210 of 449 posts

Re: GitHub Actions and Pages are experiencing degraded availability

#201

The most likely explanation for the degraded reliability: Someone at GitHub saw the Three Body Problem last year and started shifting their infra over to Minecraft servers with "physical" memory and redstone logic gates.

Turns out those seams _were_ load bearing.

Re: GitHub Actions and Pages are experiencing degraded availability

#202

I don't think this portents anything great for software in general. We're a good year+ into the use LLMs for all major bits of software that we all rely upon and GitHub here is down to one 9 of uptime. I've been using GitHub for a _long_ time, my first commits there go back to August 2009!, and I honestly don't recall GitHub going down as much as it has in the last year. I'm sure there's other things happening in the…

It is definitely and absolutely caused by LLMs. I must do 20x more GitHub operations now, and since the agents know GitHub far better than me, I'm using more advanced features. Multiply this times all of us.

Re: GitHub Actions and Pages are experiencing degraded availability

#203

Can't wait for the Graphite/Cursor alternative (Origin) to become available. Actions being down for an hour in the middle of the US East workday is crazy. It's super frustrating to be an enterprise customer of Github, seems like we don't get any dedicated resources or additional stability. At this point our only option is self-host github enterprise or move away.

Would you move hosting/CI before Origin is available, or are you basically stuck on GitHub until then?

I feel stuck on Github until the next generation of forges (I assume Linear is working on one too, and the Pierre guys, and there's probably more) are ready. When it works, I'm actually a huge fan of Github. It just doesn't work reliably and it's a huge operational risk to not be able to freaking deploy. We'll most likely switch to self-hosted GHE in the near-term while continuing to evaluate alternative forges — Forgejo, Gitlab, Gitea, Sourcehut, aren't appealing enough to switch.

Re: GitHub Actions and Pages are experiencing degraded availability

#204

I don't think this portents anything great for software in general. We're a good year+ into the use LLMs for all major bits of software that we all rely upon and GitHub here is down to one 9 of uptime. I've been using GitHub for a _long_ time, my first commits there go back to August 2009!, and I honestly don't recall GitHub going down as much as it has in the last year. I'm sure there's other things happening in the…

Are these outages caused by introduced bugs, though, or by load issues? As someone who has spent many years working in high load environments, this is not an uncommon pattern. You design a system and it works great. It can handle failures, load spikes, it is horizontally scalable, things are great. You think you figured it out. And then load keeps increasing and you suddenly hit a tipping point where everything keeps…

There was a great article awhile back that shed some light on just how dysfunctional azure is as a platform: https://news.ycombinator.com/item?id=47616242

If I had to guess it's because Github is sitting on top on infrastructure held up by toothpicks and duct tape

Re: GitHub Actions and Pages are experiencing degraded availability

#205

Earlier quoted context omitted.

I believe Pages uses Actions under the hood for publishing, so in my head it sort of makes sense for these things to be affected in the same outage

You are right, didn’t know that. Seems like the only reliable way to run GHA jobs is to not use their runners. Hope they at least didn’t break self-hosted runners operations

[deleted]

Re: GitHub Actions and Pages are experiencing degraded availability

#206

I don't think this portents anything great for software in general. We're a good year+ into the use LLMs for all major bits of software that we all rely upon and GitHub here is down to one 9 of uptime. I've been using GitHub for a _long_ time, my first commits there go back to August 2009!, and I honestly don't recall GitHub going down as much as it has in the last year. I'm sure there's other things happening in the…

The funny thing is that if companies wanted they could probably use AI to instead increase uptime. Keep existing QA teams (instead of replacing them) and then use AI for better and more timely monitoring (and messaging even) and as an additional Always-Testing™ layer of QA

Re: GitHub Actions and Pages are experiencing degraded availability

#208

5 hours going now and the entire thing is still completely down. This level of incompetence and their total disrespect for their customers is unbelievable.

Yeah, I think this one might be the straw that broke the camel's back and our team will look to migrate to something non-microsoft to be away from this nonsense.

What are the alternatives?

Re: GitHub Actions and Pages are experiencing degraded availability

#210

Given the recent history of outages, I wonder how many are seriously considering moving off GitHub for anything other than code hosting. I mean actions / workflows.

I seriously want to. I'm just waiting for the day where I have enough extra energy to simply bite the bullet and do it.

Never mind. It's happening now! Migrating to self hosted Gitea for work. Super excited!
Post reply on HN