Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Incident with Issues and Webhooks – Resolved

githubstatus.com

Post reply on HN
Print view View original

111–120 of 275 posts

Re: Incident with Issues and Webhooks – Resolved

#111

Post by njovin »

petcat wrote: post #21
indianhippie wrote: post #8

This is reaching an unacceptable level of performance. There isn't a week that work isn't interrupted by GH.

AI agents have changed the scalability properties of basically the entire internet. It used to be that GitHub could rely on a finite number of people interacting with their platform in real human ways in real observable patterns. So I'm assuming that they scale for those patterns, and optimize for the UI and UX hotspots. But now everyone's got a moltbot running 24/7, sometimes many, and it's completely overloading a…

Microsoft buys github.

Microsoft forces AI usage down everyone's throats.

AI bot usage takes down github.

I have to assume that there are some serious fights going on between the poor SRE teams wanting to throttle bots, and MS not wanting to do anything to dissuade AI usage.

Re: Incident with Issues and Webhooks – Resolved

#112

Post by tardedmeme »

cenal wrote: post #90
lbourdages wrote: post #12

Earlier quoted context omitted.

It's been unacceptable for months, but now it's at the level of "we should actively look for alternatives".

Any centralized solution like GitHub is going to suffer the same fate as vibe coding chokes these services. The only option to have high uptime is to self host and most organizations can't do that easily. Time will tell if GitHub can scale up enough to meet demand.

It's a nice thought but I think the revealed preference from the history of the internet is that people actually only want centralised services, no matter what they say they want.

People love to clown on the fediverse because of having to choose a server. Which is no different from email. I guess the difference is that their ISP used to give them email.

Re: Incident with Issues and Webhooks – Resolved

#113

Post by tantalor »

tardedmeme wrote: post #102
pluc wrote: post #83

Earlier quoted context omitted.

It isn't. Lots of unacceptable things going on these days and everyone seems to be accepting them just fine.

We should make an alternative git site, but how to acquire users?

What do you need users for?

GH is not a social network

Re: Incident with Issues and Webhooks – Resolved

#114

Post by go_elmo »

tardedmeme wrote: post #102
pluc wrote: post #83

Earlier quoted context omitted.

It isn't. Lots of unacceptable things going on these days and everyone seems to be accepting them just fine.

We should make an alternative git site, but how to acquire users?

Make it nerdy enough to scare of agentic coders only. Also, blackjack and hookers are said to be helpful in such circumstances.

Re: Incident with Issues and Webhooks – Resolved

#115

Post by dijksterhuis »

sh3rl0ck wrote: post #98
AlexB138 wrote: post #15

Github has published some incredible usage rate increase numbers, which they ascribe to the rise of agentic coding. At some point, they are going to have to change rate limits, cut free-tier usage, or find some other path to reducing load. It's clear that their infrastructure can't keep up with this significant increase, and it's unlikely that they're going to just absorb the increased costs themselves. Very curious…

I've been a strong proponent of reallocating all LinkedIn server capacity to GitHub.

this is an idea that i’d happily get behind.

Re: Incident with Issues and Webhooks – Resolved

#116

Post by philistine »

the_sleaze_ wrote: post #68
amluto wrote: post #52

Earlier quoted context omitted.

For literally decades, I’ve observed that there are systems that make each operation cheap and systems that work hard to scale out. The former frequently seems to wildly outperform the latter. GitHub, for example, seems to implement the main repository /pulls page as a search query, which is hinted at by the prefilled search bar and was mostly confirmed last week when the search backend failed and pull requests didn’…

I think you need to broaden your focus here - I can't really remember any significant downtime before the Microsoft acquisition and the data supports my memories. Microsoft bought Github and migrated to Azure, which is explains the findings. The query performance was fine before they started serving from Azure. I mean honestly, as though there isn't one single person competent enough to read some logs and horizontall…

I mean, are any of the other forges, which I presume are also seeing logarithmic increase in commits, also failing as hard as Github?

Re: Incident with Issues and Webhooks – Resolved

#117

Post by tardedmeme »

baq wrote: post #69
elevation wrote: post #23

Earlier quoted context omitted.

"Three 8s of availability"

I literally laughed out then shed a tear, because I'd actually take three 8s today.

Three eights is more than a month of downtime every year. Today is the three eights.

Re: Incident with Issues and Webhooks – Resolved

#118

Post by crote »

AlexB138 wrote: post #15

Github has published some incredible usage rate increase numbers, which they ascribe to the rise of agentic coding. At some point, they are going to have to change rate limits, cut free-tier usage, or find some other path to reducing load. It's clear that their infrastructure can't keep up with this significant increase, and it's unlikely that they're going to just absorb the increased costs themselves. Very curious…

It's a bit hard to blindly trust their numbers when they are trying very hard to sell Copilot to everyone.

Sure, AI will undoubtedly have increased their workload, but how much of the shown figures is real, and how much is the PR department trying to make it look like Copilot & friends is a massive success?

Post reply on HN