Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Incident with Github.com [resolved]

githubstatus.com

Post reply on HN
Print view View original

871–880 of 1001 posts

Re: Incident with Github.com [resolved]

#871

Post by rtpg »

dbmikus wrote: post #829
stusmall wrote: post #804

Earlier quoted context omitted.

Being the _the_ place for open source is what let them dominate the enterprise. Now that they dominate the enterprise, it'd make financial sense to put hard limits on the free tier. It's cynical but it would be foolish to lose that cash machine. It'd open them up for a competitor to slowly build up good will in open source then take them on in enterprise, but right now they are risking losing it all.

Big enterprises are on a different github deployment, so I doubt they are affected by this

I don't know how true that is nowadays, I think if you sign up to Enterprise Cloud you're in the same spot as everyone else

(maybe F500 people have their colocated box, but I have the impression that those are the "first class" seats (very expensive but _very few_) whereas enterprise cloud is the "business class" (loooooots of seats making a lot of money)

Re: Incident with Github.com [resolved]

#872

Post by adamtaylor_13 »

liendolucas wrote: post #870

There is no single product Microsoft hasn't touched and ruined. People should leave all Microsoft products en masse. I'm glad I'm no longer on Github. What I find a bit weird is why so many people rely on it. Today we have tons of VPS providers where anyone can host their on git repo and CI/CD pipeline. What is preventing so many people to effectively have a custom setup?

Momentum + path of least resistance.

My company is still on GitHub... for now. But incidents like this are becoming more common and I'm becoming less tolerant of it. I suspect many feel the same, but it takes time to persuade the masses.

Re: Incident with Github.com [resolved]

#873

Post by athoneycutt »

I'm at the point of having my own stuff on GitLab and mirrored to my own Forgejo or on Codeberg and mirrored to my own Forgejo. I really like GitLabs CI better than GitHub/Forgejo tho.

I only really use GitHub if a project that I want to contribute to is already on there at this point.

Re: Incident with Github.com [resolved]

#874

Post by dragon-hn »

rfgplk wrote: post #826
mooreds wrote: post #664

Earlier quoted context omitted.

Found this reddit thread from a month ago that talks about the scale: Commit volume went from 1 billion total in all of 2025 to 275 million per week by early 2026. https://www.reddit.com/r/softwaredevelopment/comments/1uv5s7...

Tracks with some of my internal metrics. There are certain projects I'm tracking (solo dev or a small team of a few people) doing 500k LoC changes _per week_. There's one project that caught my attention in particular because they had something like 800k commits and around 7 million lines of code... and they created the repo in _July_. Also, yes I checked, the repo gradually grew over time they didn't just splat it i…

Bonkers. Almost a million commits in less than 2 months.

Re: Incident with Github.com [resolved]

#875

Post by lowercased »

pigbearpig wrote: post #862
jubilanti wrote: post #637

Almost 3 hours in and still "We are still working to identify the root cause" Can't even view diffs in the web interface! I'm out! I am willing to pay ~$5-10/mo for a reliable host I can swap as painlessly as possible. Mostly just building little static sites and little PWAs, no more than 500mb a repo and 10gb total. Need a repo with PRs and issues, where people can register free account and contribute or raise issue…

Are you paying for GitHub? Are you complaining about an outage from a product you aren't even paying for? You know the whole point of git is you don't _need_ a central server. I don't understand the entitlement in your post here.

Not OP, but I pay. And it was an annoyance today for several hours that did impact some work.

I don't need one, but I do have that because it's doing a bit more work than just git hosting (administratable access for others on the team, build actions, etc) and yes... I'm paying for it.

Re: Incident with Github.com [resolved]

#876

Post by chasd00 »

adamddev1 wrote: post #771
ALLTaken wrote: post #753

Earlier quoted context omitted.

Great setup, two questions, do you have 2 VPNs now or all on one Hetzner VPS? And how do you setup security? Just recommend swapping vercel/netlify with something else, we had quite a few issues and high costs with them. Not opiniated here, currently using Cloudflare and BunnyCDN (which is great)

I just SSH into the servers when I need to. I don't have any VPNs with these servers. I just try to follow normal server security setup practices, disabling password authentication etc.

That’s what I do. Sensible firewall rules with ufw, turn off services I don’t use, follow the docs for the services I do. For a handful of servers the maintenance overhead is fine.

Re: Incident with Github.com [resolved]

#877

Post by sellmesoap »

pigbearpig wrote: post #862
jubilanti wrote: post #637

Almost 3 hours in and still "We are still working to identify the root cause" Can't even view diffs in the web interface! I'm out! I am willing to pay ~$5-10/mo for a reliable host I can swap as painlessly as possible. Mostly just building little static sites and little PWAs, no more than 500mb a repo and 10gb total. Need a repo with PRs and issues, where people can register free account and contribute or raise issue…

Are you paying for GitHub? Are you complaining about an outage from a product you aren't even paying for? You know the whole point of git is you don't _need_ a central server. I don't understand the entitlement in your post here.

Are you the user or the product? You can be both with GitHub! GitHub provide a compelling product, enough to become the defacto forge for many. But their reputation has taken a lot of hits, as a grey beard I'm salty since the Microsoft takeover, the downtime is just the leaky diaper icing.

To diagnose at a distance it feels like they need a stronger QA process, it's a product that scales horizontally, but somehow they find a way to break it for everyone on the regular! They need less hub and more node!

Re: Incident with Github.com [resolved]

#878

Post by bargainbin »

sippeangelo wrote: post #859
tom1337 wrote: post #677

Earlier quoted context omitted.

Update 16:36 UTC - We identified the problematic component and have taken corrective actions. There are strong signs of recovery but we are still working to completely restore service, with error rates still remaining slightly elevated. We will post further updates as recovery continues. just shy of 3 hours to find the issue

"Strong signs of recovery" is a crazy way to describe the status of a computer system. Wow.

It’s all just ones and zeroes, and maybe a two. You never can tell with these computers!

Re: Incident with Github.com [resolved]

#879

Post by jubilanti »

pigbearpig wrote: post #862
jubilanti wrote: post #637

Almost 3 hours in and still "We are still working to identify the root cause" Can't even view diffs in the web interface! I'm out! I am willing to pay ~$5-10/mo for a reliable host I can swap as painlessly as possible. Mostly just building little static sites and little PWAs, no more than 500mb a repo and 10gb total. Need a repo with PRs and issues, where people can register free account and contribute or raise issue…

Are you paying for GitHub? Are you complaining about an outage from a product you aren't even paying for? You know the whole point of git is you don't _need_ a central server. I don't understand the entitlement in your post here.

> I don't understand the entitlement in your post here.

Excuse me, I'm literally asking where I can pay to get the specific cloud/web-based features I listed. I'm trying hard to NOT rely on a free tier because I want to pay to have the entitlement to complain when I don't get what I paid for. You know, the way that commerce has existed for millennia. [0]

I don't know where this aggression is coming from. You seem to want me to stay on the free tier and shut up or go all locally-hosted. Great if either of those work for you, buddy.

[0] https://en.wikipedia.org/wiki/Complaint_tablet_to_Ea-n%C4%81...

Re: Incident with Github.com [resolved]

#880

Post by ThrowawayR2 »

noahbp wrote: post #211
leishman wrote: post #171

I don't understand why Github hasn't solved this problem with pricing updates. My understanding is they are getting hammered with LLM generated code growing their traffic by over an order of magnitude. So why not rate limit non-paying users and charge for whatever scarce resource is being consumed that is causing them to constantly fall-over? This seems like a basic economics problem.

Because any price at all will immediately cause users to shift to another platform, and GitHub's value is that it is _the_ place to put your code on the internet.

They'll shift to another platform and then that platform will:

- Phase 1: Implode even harder than GitHub under the onslaught of LLM generated code

- Phase 2: ???

- Phase 3: Profit!

Nobody wants users they can't monetize and hosting LLM output for free isn't monetizable. It's not even valuable as training data.

Post reply on HN