Live data from Hacker News

Incident with Github.com [resolved]

githubstatus.com

881–890 of 1001 posts

Re: Incident with Github.com [resolved]

#881
I think this is the curse of scale, but also of pseudo-leaders who think leadership is "pushing engineering to rapid-fire features for number go up."

You tell engineers and engineering leaders to "just add this one feature, it's really important, what's the ETA? No, that's too late, the market will have moved on, this is existential, you're a bottleneck," fire, hire, fire, hire. Meanwhile the CEO feels great, because they're delivering. The reports look nice, the posts get written, the lectures get given on X and LinkedIn about what steering a ship really means.

Then the issues that required your system to actually be robust, the ones that required engineers to have spent the time engineering, show up. And it's way too late. You cannot move faster, no matter how much money you throw at it.

It gets bad enough that everyone is now telling the CEO 70% of the platform needs refactoring, and even that is like solving the three-body problem, because every domain boundary is broken. Claude can't reason about any component of the system but is very confident it understands it, and ten seconds later tells you "You're right! And I won't sugarcoat it, I completely misrepresented this concept, let me go fix that by rewriting this other module."

You can't rebuild GitHub. You can't rebuild components of it in reasonable time over live data and migrate over without very public incidents. So now the CEO feels very, very dumb, and can't admit it.

Meanwhile a new company capitalizes on your lack of leadership and launches a competitor...and the cycle starts anew.

Re: Incident with Github.com [resolved]

#882

Almost 3 hours in and still "We are still working to identify the root cause" Can't even view diffs in the web interface! I'm out! I am willing to pay ~$5-10/mo for a reliable host I can swap as painlessly as possible. Mostly just building little static sites and little PWAs, no more than 500mb a repo and 10gb total. Need a repo with PRs and issues, where people can register free account and contribute or raise issue…

Problem with Gitlab is that they will never stop adding features.

Re: Incident with Github.com [resolved]

#884

Almost 3 hours in and still "We are still working to identify the root cause" Can't even view diffs in the web interface! I'm out! I am willing to pay ~$5-10/mo for a reliable host I can swap as painlessly as possible. Mostly just building little static sites and little PWAs, no more than 500mb a repo and 10gb total. Need a repo with PRs and issues, where people can register free account and contribute or raise issue…

This, in a nutshell, is why Github is the way it is and there's a lack of good alternatives. I'm not knocking you in particular because we're all pretty much in the same boat here.

"I am willing to pay ~$5-10/mo for a reliable host... Need a repo with PRs and issues, where people can register free account and contribute or raise issues, GH actions CI, and pages host to deploy static sites."

Who wants to build something to acquire that $5-10/mo business? A VPS powerful enough to host a small repository costs more than that these days. There's no opportunity here for someone to build a Github alternative and make any money. The best parts of Github that make it worth using in the first place all come down to the size of the network and that would be extremely difficult to replicate.

It comes down to wanting to develop a SCM hosting service and hitting a $5-10/mo price point. To put that in perspective, people pay more than $5 for a latte and COGS on that is about $1.50 or less. A good customer will come in weekly or more often. I'd rather sell coffee than SaaS SCM.

Re: Incident with Github.com [resolved]

#885

Earlier quoted context omitted.

Being the _the_ place for open source is what let them dominate the enterprise. Now that they dominate the enterprise, it'd make financial sense to put hard limits on the free tier. It's cynical but it would be foolish to lose that cash machine. It'd open them up for a competitor to slowly build up good will in open source then take them on in enterprise, but right now they are risking losing it all.

Big enterprises are on a different github deployment, so I doubt they are affected by this

[deleted]

Re: Incident with Github.com [resolved]

#886

There is no single product Microsoft hasn't touched and ruined. People should leave all Microsoft products en masse. I'm glad I'm no longer on Github. What I find a bit weird is why so many people rely on it. Today we have tons of VPS providers where anyone can host their on git repo and CI/CD pipeline. What is preventing so many people to effectively have a custom setup?

*People should leave all Microsoft, Google, Meta products en masse

Re: Incident with Github.com [resolved]

#887
post #673

Almost 3 hours in and still "We are still working to identify the root cause" Can't even view diffs in the web interface! I'm out! I am willing to pay ~$5-10/mo for a reliable host I can swap as painlessly as possible. Mostly just building little static sites and little PWAs, no more than 500mb a repo and 10gb total. Need a repo with PRs and issues, where people can register free account and contribute or raise issue…

No idea about some of that stuff, as I have more basic needs; nearlyfreespeech.net is cheap and stays out of my way.

wow nice

Re: Incident with Github.com [resolved]

#888
post #737

Earlier quoted context omitted.

It is though. Maybe you think they should be doing a better job but 12-24xing scale when you were already handling billions of commits is definitely understandable to me. It just does feel like they should have some way of ensuring customers, paying ones, don’t have to suffer so much.

Yes. It seems that at the very least repositories owned by paying customers should be processed on priority threads. And perhaps throttle commits/pushes to repos where there are a lot of pushes from the same person all the time. This can be effectively throttled at the push level.

If I hadn't already switched to GitLab long ago, I'd certainly do so when my pushes to GitHub are throttled.

Re: Incident with Github.com [resolved]

#889
post #852

Earlier quoted context omitted.

Being the _the_ place for open source is what let them dominate the enterprise. Now that they dominate the enterprise, it'd make financial sense to put hard limits on the free tier. It's cynical but it would be foolish to lose that cash machine. It'd open them up for a competitor to slowly build up good will in open source then take them on in enterprise, but right now they are risking losing it all.

Increasing prices are a sure way to enshittification. It will push people away from github. Many such previous examples

[deleted]

Re: Incident with Github.com [resolved]

#890
post #884

Almost 3 hours in and still "We are still working to identify the root cause" Can't even view diffs in the web interface! I'm out! I am willing to pay ~$5-10/mo for a reliable host I can swap as painlessly as possible. Mostly just building little static sites and little PWAs, no more than 500mb a repo and 10gb total. Need a repo with PRs and issues, where people can register free account and contribute or raise issue…

This, in a nutshell, is why Github is the way it is and there's a lack of good alternatives. I'm not knocking you in particular because we're all pretty much in the same boat here. "I am willing to pay ~$5-10/mo for a reliable host... Need a repo with PRs and issues, where people can register free account and contribute or raise issues, GH actions CI, and pages host to deploy static sites." Who wants to build somethi…

You can get decent ones for $6 from Contabo VPS https://contabo.com/en-us/vps/
Post reply on HN