Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GitHub appears to be struggling with measly three nines availability

theregister.com

Post reply on HN
Print view View original

151–160 of 255 posts

Re: GitHub appears to be struggling with measly three nines availability

#151

Post by lucideer »

ARandomerDude wrote: post #134
lucideer wrote: post #117

Earlier quoted context omitted.

You're right that labelling any outage as "Github is down" is an overgeneralisation, & we should focus on bottlenecks that impact teams in a time sensitive matter, but that isn't the case here. Their most stable service (API) has only two 9s (99.69%). They're not even struggling to get their average to three 9s, they're struggling to get ANY service to three 9s. They're struggling to get many services to two 9s. Copi…

I love multiple 9s as much as the next guy but that's only 27 hours per year of downtime. For a mostly free (for me) service, I'm thankful.

Honestly, you're right - 2̶7̵ 87+ (correction from sibling) hours per year is absolutely fine & normal for me & anything I want to run. I personally think it should be fine for everybody.

On the other hand the baseline minimal Github Enterprise plan with no features (no Copilot, GHAS, etc.) runs a medium sized company $1m+ per annum, not including pay-per-use extras like CI minutes. As an individual I'm not the target audience for that invoice, but I can envisage whomever is wanting a couple of 9s to go with it. As a treat.

Re: GitHub appears to be struggling with measly three nines availability

#152

Post by b00ty4breakfast »

righthand wrote: post #116
rtaylorgarlock wrote: post #114

Earlier quoted context omitted.

My preferred tool to solve these issues is called 'gitlab'

CircleCI TravisCI Jenkins scripts dir Etc

yeah, github's business model is not really a git repository but a bunch of other (admittedly useful) stuff that traps people in their ecosystem.

Re: GitHub appears to be struggling with measly three nines availability

#153

Post by lucideer »

calvinmorrison wrote: post #119
lucideer wrote: post #117

Earlier quoted context omitted.

You're right that labelling any outage as "Github is down" is an overgeneralisation, & we should focus on bottlenecks that impact teams in a time sensitive matter, but that isn't the case here. Their most stable service (API) has only two 9s (99.69%). They're not even struggling to get their average to three 9s, they're struggling to get ANY service to three 9s. They're struggling to get many services to two 9s. Copi…

ONLY TWO NINES! Meanwhile vital government services here have a whopping 25% availability.

Two things can be bad.

Re: GitHub appears to be struggling with measly three nines availability

#154

Post by ecshafer »

raincole wrote: post #86
Alifatisk wrote: post #45

Have anyone checked out the status page? It's actually way worse than I thought, I believe this is the first time I am actually witnessing a status page with truly horrible results. https://mrshu.github.io/github-statuses

It looks this bad because that includes 'degraded performance,' not just outrage.

Degraded Performance is unavailable as far as I am concerned. If Github has "degraded performance" where it takes 5 minutes to load a PR then that is not good.

Re: GitHub appears to be struggling with measly three nines availability

#155

Post by anon7000 »

mikeve wrote: post #27

Just to add a little bit of nuance to this not because I'm trying to defend GitHub, they definitely need to up their reliability, but the 90% uptime figure represents every single service that GitHub offers being online 90% of the time. You don't need every single service to be online in order to use GitHub. For example, I don't use Copilot myself and it's seen a 96.47% uptime, the worst of the services which are tra…

There have been multiple outages in the past year where they didn’t even fully report it very quickly. I’m talking the types of outages that brings down normal enterprise usage: we hook delivery for CI/CD, git operations for everyone, PRs for code review. And that’s not even including GitHub actions or copilot which lots of people also rely on.

Re: GitHub appears to be struggling with measly three nines availability

#156

Post by unhidden »

The 37 minutes of downtime last week cost us a deploy window during market hours. What's underappreciated: it's not just the raw downtime, it's that every CI/CD pipeline, every webhook, every deployment gate has GitHub as a single point of failure now. The centralization risk is real.

Re: GitHub appears to be struggling with measly three nines availability

#157

Post by jjgreen »

tasuki wrote: post #95
cedws wrote: post #18

While GitHub obsess over shoving AI into everything, the rest of the platform is genuinely crumbling and its security flaws are being abused to cause massive damage. Last week Aqua Security was breached and a few repositories it owns were infected. The threat actors abused widespread use of mutable references in GitHub Actions, which the community has been screaming about for years, to infect potentially thousands of…

> GHA can’t even be called Swiss cheese anymore, it’s so much worse than that. That's a high bar though. Few things are better than Swiss cheese.

Salers (if you can find it)

Re: GitHub appears to be struggling with measly three nines availability

#160

Post by windward »

dijksterhuis wrote: post #135
827a wrote: post #113

I don't want to give too much credit to Github, because their uptime is truly horrendous and they need to fix it. But: I've felt like its a little unfair to judge the uptime of company platforms like this; by saying "if any feature at all is down, its all down" and then translating that into 9s for the platform. I never use Github Copilot; it does go down a lot, if their status page is to be believed; I don't really…

> I've felt like its a little unfair to judge the uptime of company platforms like this; by saying "if any feature at all is down, its all down" and then translating that into 9s for the platform. This is definitely true. At the same time, none of the individual services has hit 3x9 uptime in the last 90 days [0], which is their Enterprise SLA [1] ... > "Uptime" is the percentage of total possible minutes the applica…

So what happens for those enterprise customers now? Is there a meaningful fallout when these services fail to meet their SLAs?
Post reply on HN