Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Incident with Actions and Pages

githubstatus.com

Post reply on HN
Print view View original

251–260 of 407 posts

Re: Incident with Actions and Pages

#251

Post by baby_souffle »

logifail wrote: post #219
jaapz wrote: post #62

Earlier quoted context omitted.

All these monitoring rules are of the format "when 500 errors > baseline for x minutes". Otherwise you'd have monitoring alerts every second. So it is normal for users to already see errors before github officially counts it as an outage.

> All these monitoring rules are of the format "when 500 errors > baseline for x minutes". Otherwise you'd have monitoring alerts every second. So it is normal for users to already see errors before github officially counts it as an outage. Is it true that official service status pages are updated automatically ?

> it true that official service status pages are updated automatically?

Depends. Typically no because there’s an art to crafting the actual message around impact… but sometimes yes it is automated

Re: Incident with Actions and Pages

#252

Post by datsci_est_2015 »

gilrain wrote: post #106
datsci_est_2015 wrote: post #60

Earlier quoted context omitted.

Devil’s advocate, Pareto heuristic would let us speculate that 80% of LLM traffic would be aimed directly at the largest provider, i.e. GitHub.

Your speculation is that their competitors would naturally not see a commensurate increase in instability while “only” handling 20% of the same crisis? I don’t buy the excuse. I want to hitch my wagon to those “mysteriously lucky” competitors. (And have. And haven’t had similar issues to Github, since.)

Competitors would be long tail, so a different mode of traffic entirely. Maybe they get spikes that are more easily whack-a-moled than the constant hammering that GitHub receives.

Tough to say as this is all speculative, though.

Re: Incident with Actions and Pages

#253

Post by porridgeraisin »

gilrain wrote: post #106
datsci_est_2015 wrote: post #60

Earlier quoted context omitted.

Devil’s advocate, Pareto heuristic would let us speculate that 80% of LLM traffic would be aimed directly at the largest provider, i.e. GitHub.

Your speculation is that their competitors would naturally not see a commensurate increase in instability while “only” handling 20% of the same crisis? I don’t buy the excuse. I want to hitch my wagon to those “mysteriously lucky” competitors. (And have. And haven’t had similar issues to Github, since.)

It's probably a threshold thing isn't it? You wouldn't get 20% of the effect at 20% of the traffic. There's a step function in there somewhere.

Re: Incident with Actions and Pages

#254

Post by rossant »

cebert wrote: post #30
altern8 wrote: post #16

Why do they go down so often? Is it true that the reason is that they've incorporated too much AI without human review?

GitHub had a blog post about this recently. They reported a significant uptick in volume (repos created, PRs, etc.), which they attribute to AI usage and tooling.

https://github.blog/news-insights/company-news/an-update-on-...

Re: Incident with Actions and Pages

#255

Post by neya »

a10c wrote: post #19

My action failed with "Unexpected error fetching GitHub release for tag refs/heads/master: HttpError: Sorry. Your account was suspended" Which certainly made me shit myself, briefly.

It's an eye opener. Think about it - today, it was a mistake. But, what if it really happened? What if you really lost access to all your years of hard work? It's a wake up call. A blessing in disguise to store what matters to you the most locally, backed up offline. Never trust any single provider. Be it MS or Google or Apple. RAID is the way.

Re: Incident with Actions and Pages

#257

Post by surdu »

discordianfish wrote: post #247
Onplana wrote: post #243

Is it about funds? Why Github is not catching up with the traffic? I know there's a mass rush on Github recently specially due to Claude Code leading users to use Github. sometimes even persuasive.

Because scaling complex systems is not trivial

It was pretty easy before October 2018, when Microsoft bought them:

https://www.githubstatus.com/uptime?page=31

Re: Incident with Actions and Pages

#259

Post by nickstinemates »

The main operating model with git is going to go back to decentralized. Setting up and managing something like https://forgejo.org/ is a way better experience than constant interruptions by a faulty service that can't meet demand.

The open source contribution model as we once knew it is dead; you're not going to accept patches from random agents. The risk is way too high. And you can see that increasingly "AI Slop" makes it difficult to be a maintainer of any semblance of a popular repo.

So what's the value? A durable place to store work? hah.

Discovery? That part of Github has always been shitty.

So that leaves.. Github Actions? The thing that is down every other day and has been the subject of a few ~rug pulls~/attempted price hikes that are almost surely coming back?

Re: Incident with Actions and Pages

#260

Post by miki123211 »

This is your periodic reminder that Github is growing at ~14x (1400%!) annually. This would be incredible growth for a young, unprofitable, VC-funded startup, even Uber never achieved more than ~3x AFAIK. For a widely-established company that was already very well known and a market leader in its niche for many years? Absolutely unprecedented.

This is a conservative estimate assuming linear growth, the actual number is likely going to be higher. Much higher.

It's not too hard to grow 14X YoY if you start from a hundred customers. If you have hundreds of millions? Yeah, not so easy.

[1] https://x.com/kdaigle/status/2040164759836778878

Post reply on HN