Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Incident with Github.com [resolved]

githubstatus.com

Post reply on HN
Print view View original

351–360 of 1001 posts

Re: Incident with Github.com [resolved]

#351

Post by CSMastermind »

icepush wrote: post #268
Arubis wrote: post #99

This is starting to feel like Twitter. For a variety of reasons, we had a centralized place where everyone of a particular set of persuasions could connect, and this had outsize benefits for the community as a whole. That place is becoming untenable, and with the loss of goodwill and stability, the community’s started to dissipate. But there isn’t one obvious transition candidate, so the diaspora is finding itself sp…

I think that, exactly how 95% of the people that left Twitter eventually returned, we will see a similar outflux of people from Github and the vast majority of them will quietly be back in a few months.

There was nothing wrong with twitter, it was a social fad to performatively leave.

Github is actually down and I can't push code right now, it's blocking my business which is unacceptable. It's a broken tool.

Re: Incident with Github.com [resolved]

#352

Post by ethagnawl »

AlexandrB wrote: post #167
askonomm wrote: post #139

Earlier quoted context omitted.

That's an overly optimistic view of things. For a lot of us GitHub is critical infrastructure, which if it goes down loses us and our customers money.

Boomer opinion but trusting third parties to be critical infrastructure, especially with no SLA in sight, will always end in tears. "The cloud" is very convenient, but its providers will never care about your infrastructure or your customers as much as you will.

You're right.

However, I'm also of the boomer opinion that you should get what you pay for. "Ranting online" about a service (you pay for) being unavailable is a reasonable reaction. It's not like they have a call center you can dial into for support ...

Re: Incident with Github.com [resolved]

#353

Post by jillesvangurp »

bhouston wrote: post #55

It is not working at all, I can not load any repo pages. Github.com's promise is that it can be the central broker of open source code because it is reliable. That promise hasn't been kept recently. That said, Github is hard to displace and it is similar to the era of the Twitter Fail Whales. It was a sign of growth that couldn't be properly managed but there was not viable alternative.

> Github is hard to displace and it is similar to the era of the Twitter Fail Whales

Hard but not impossible. Being unreliable might nudge a few people. Also, Twitter had their fail whale in their early phase (mostly), not twenty years or so into their existence.

The issue with replacing Github is that it takes more than version control and issue tracking to replace the network that is Github. It's effectively the largest social network for software developers on this planet.

Tangled (tangled.org) is built on the at protocol (bluesky) and seems like an interesting take on this. Most other solutions seem to just move the problem to another much smaller silo (gitlab, codeberg, etc) or throw out the baby with the bathwater by focusing on self hosting without attempt at networking with other instances.

A federated approach seems like it is directionally right. Tangled is far from feature complete but I like the direction and it probably is a bit more resilient against global outages like this. I'm not a user yet but I'm keeping an eye on it.

Re: Incident with Github.com [resolved]

#354

Post by sarjann »

john_strinlai wrote: post #192
sarjann wrote: post #170

Earlier quoted context omitted.

This has to be rage bait, this is a critical piece of infrastructure for many people. Stuff going down can lead to deployments failing and as you mentioned in many cases emergency hotfix's. The idea that we should be fine with this unreliability is just amazing. It's not a mental health issue to have problems when important infra fails.

> The idea that we should be fine with this unreliability is just amazing. the comment doesnt say you should be "fine" with the unreliability. they are saying people shouldnt get so emotionally worked up over it. which, while i wouldn't phrase it in the way the parent did, i agree with the direction of their point.

Except he tries justifying it.

"Github’s servers are constantly on fire as their usage increased something like 50x due to LLM sloppers pushing large amounts of trash code"

"Unless you have a emergency hotfix (you don’t), go hit the gym or walk outside." with assumptions like above.

If it was, "hey they f*ed up but there's no point having an overly emotional reaction" that would be fine. But he seems to be justifying this. Especially with Github's record up to now of unreliability I think it's completely fair to be annoyed.

Re: Incident with Github.com [resolved]

#355

Post by brahma-dev »

khvn26 wrote: post #29

I had a lot of goodwill for GitHub but I think today is the tipping point. Looking at a unicorn page, I feel this lingering hope that it's transient (like it usually was in the old days) but my mind reassures me it's probably going to be a long full outage again. The hope is dead.

Atleast you're getting the unicorn. I am getting 404 on valid links. For a moment I thought the repo is gone.

https://imgur.com/b0Xj3Z6

Re: Incident with Github.com [resolved]

#356

Post by dewey »

MoreQARespect wrote: post #250
noosphr wrote: post #134

Earlier quoted context omitted.

Luckily we already have a distributed version control system that can take over github: https://fossil-scm.org/home/doc/trunk/www/index.wiki I suppose people can use git too if they ever figure out how to send emails from a dedicated client.

There are plenty of alternatives for git hosting. The last thing which needs to be migrated before we get an exodus off this vibe coded monstrosity is reputation (i.e. github stars) which are inherently sticky.

I don't think GitHub stars are what makes GitHub sticky. Having a single UI / account and being able to jump between work projects, private projects and random open source projects where I want to open a quick issue or submit a PR is much more sticky.

Re: Incident with Github.com [resolved]

#357

Post by icepush »

xnorswap wrote: post #285
icepush wrote: post #268

Earlier quoted context omitted.

I think that, exactly how 95% of the people that left Twitter eventually returned, we will see a similar outflux of people from Github and the vast majority of them will quietly be back in a few months.

That was a political decision, this is an operational one. A lot of companies have become dependent on a working github and effectively have to down tools when it is down.

Being down for a few hours 2-3 times a month is obviously garbage from a reliability standpoint, but I think they will keep it going at just the level necessary to barely hold on to these customers.

Re: Incident with Github.com [resolved]

#358

Post by http-teapot »

nerdypepper wrote: post #51
beardedetim wrote: post #15

We're starting to have the conversation of "do we need to replace GitHub as our CI/CD pipeline?" No idea if/when we decide to pull that bandaid but I think once we can't merge a hot fix into main because of GH being down, it'll be a big org push to replace it. What's everyone else using? Self hosted Gitlab? Gitea?

> What's everyone else using? Self hosted Gitlab? Gitea? tangled.org!

What's your experience with tangled? Would love to hear the experience from other users as well

Re: Incident with Github.com [resolved]

#359

Post by cyansmoker »

iamcoder18 wrote: post #218
eddieroger wrote: post #132

Earlier quoted context omitted.

For the amount of money enterprises are paying to GitHub, there is a reasonable (and contractual) expectation of uptime. I don't think my boss would find it to fun if I bailed work to hit the gym just because GitHub was down.

Yes, but GitHub enterprise has different uptime ( https://us.githubstatus.com/posts/dashboard ) and actually does have an SLA. Edit: it seems GHE is also affected by the outage and isn't much better.

As an enterprise user I can tell you that:

- we are getting no benefit beyond getting excuses replies to our emails - right or wrong, but we depend heavily on GitHub actions so this has a very real impact on us

Re: Incident with Github.com [resolved]

#360

Post by ethagnawl »

s_dev wrote: post #155
ieie3366 wrote: post #100

To everyone who is angry: calm down. Github’s servers are constantly on fire as their usage increased something like 50x due to LLM sloppers pushing large amounts of trash code Unless you have a emergency hotfix (you don’t), go hit the gym or walk outside. If a work tool going down triggers you enough mentally to start angrily ranting online, it’s a sign you need to chill out and focus more on your health

What if we're not angry and just perplexed? Do we calm down further or can we still ask questions?

No questions. Only bench press.
Post reply on HN