Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GitHub Actions Down / Degraded

githubstatus.com

Post reply on HN
Print view View original

21–30 of 48 posts

Re: GitHub Actions Down / Degraded

#21

Post by rvz »

Again? Last time an incident like that happened was Packages which was less than 24 hours ago. [0] Before that weeks ago [1] At this point, it is clear that GitHub is essentially falling apart and is becoming extremely unreliable.

It's not too late to join the serious projects like Blender, ReactOS, RedoxOS, etc who are happily self hosting and are not going all in on GitHub.

I posit that they even have better uptime by just self hosting for one year vs GitHub's uptime record since they got acquired by Microsoft. Looks like 'centralising everything' to GitHub did not age well at all, as I have warned years ago. [2]

[0] https://news.ycombinator.com/item?id=34982456

[1] https://news.ycombinator.com/item?id=34843847

[2] https://news.ycombinator.com/item?id=22867803

Re: GitHub Actions Down / Degraded

#22

Post by echelon »

rvz wrote: post #21

Again? Last time an incident like that happened was Packages which was less than 24 hours ago. [0] Before that weeks ago [1] At this point, it is clear that GitHub is essentially falling apart and is becoming extremely unreliable. It's not too late to join the serious projects like Blender, ReactOS, RedoxOS, etc who are happily self hosting and are not going all in on GitHub. I posit that they even have better uptime…

> happily self hosting

That can also be a nightmare.

Do you want git hosting, CI/CD, etc. to be among your core competencies? Because that's what this entails. You need a full team to staff it and be on call.

I guarantee you that those who self host will have just as many breakdowns. Five nines is hard, especially when it's not your main job.

Re: GitHub Actions Down / Degraded

#23

Post by kaveet »

We subscribe to GitHub’s RSS feed in one of our vendor notifications channels, and it’s been super noisy in the last few months:

https://www.githubstatus.com/history

On one hand GitHub seems a little more proactive than most when it comes to raising incidents and updating status pages, but we’re getting a little too used to pausing our deploys in the middle of the day.

Re: GitHub Actions Down / Degraded

#24

Post by mos_6502 »

bob1029 wrote: post #13

I keep threatening to move us to enterprise but the temperature never quite gets high enough to push me over the actual threshold. I would be curious if anyone else on HN is responsible for running a GH Enterprise instance and whether or not the extra liability is worth it.

It happens my company partners with GitHub to deliver with this kind of thing. Drop us a line over at [1] and we can give you a breakdown of the different migration/deployment models.

[1] https://xpirit.com/contact/#usa

Re: GitHub Actions Down / Degraded

#26

Post by rvz »

kneebonian wrote: post #8
siavosh wrote: post #5

I just started using Actions ... is this rare or is it one of their more fragile services?

I kind of predicted this ever since MS bought them out. Seen how often Azure has problems? That's the future now.

There you go and OpenAI is likely going to get the same share of outages - Like GitHub.

Just don't 'centralize everything to GitHub' like someone else said before since we now know that with this foresight made years ago [0], it is a very bad idea in the long term.

[0] https://news.ycombinator.com/item?id=22867803

Re: GitHub Actions Down / Degraded

#27

Post by zamalek »

sashk wrote: post #15

I've been using hosted runners for GitHub actions, so I understand they are down... What if I self-host runners -- will they work?

Dozens of HTTP 500s and so forth each week. I have built us quite a large library of actions with transient retry due to this. I'm out of options for the remaining daily failures, so the "automatic retry failed actions" sledgehammer is up next.

Keep the f$!# away from it. I have suggested moving away from GH entirely, but my peers aren't too keen on migrating to a different CI system yet again.

Consider self-hosting everything.

Re: GitHub Actions Down / Degraded

#30

Post by brightball »

clintonb wrote: post #20
brightball wrote: post #12

Gitlab Runners on my laptop ftw

That's not a terrible idea. Ironically, my plan this evening was to investigate slowness in some actions for one of my projects.

You got extra computing power sitting around, extra runners make good sense.
Post reply on HN