Live data from Hacker News

Incident with Issues and Webhooks – Resolved

githubstatus.com

61–70 of 275 posts

Re: Incident with Issues and Webhooks – Resolved

#61

Github has published some incredible usage rate increase numbers, which they ascribe to the rise of agentic coding. At some point, they are going to have to change rate limits, cut free-tier usage, or find some other path to reducing load. It's clear that their infrastructure can't keep up with this significant increase, and it's unlikely that they're going to just absorb the increased costs themselves. Very curious…

IMO, they're reaching the point of no return. I don't think they can horizontally-scale their way out of the hole they dug themselves unless they separate their free and paid infra maybe... which doesn't seem likely considering how their other infra changes are going. In the same way you need to be 10x better for someone to consider switching to your product, if you get 10x worse your competitors get a free 10x by ju…

I think there's a very good chance you're right. Their reputation is obviously severely harmed, and high profile projects like Ghostty leaving may be a canary in the coalmine.

Something creative like separating their free and paid tiers may help them. I suspect the fact that all of this is happening to them along with their migration to Azure is probably complicating their ability to adapt their infrastructure.

Re: Incident with Issues and Webhooks – Resolved

#64

I have been writing lots of code lately And I still only have local git repository. I do not like why git doesn't have a built in bug or issue tracker and a kanban board or something. I wished Git and Fossil hybrid should have won. I thought about using fossil many times but it seems codex and claude have deeper integration with git. I don't like installing software which keeps growing into infinite feature Monster.…

[deleted]

Re: Incident with Issues and Webhooks – Resolved

#66
post #43

Earlier quoted context omitted.

Isn't the data that flows through Github so valuable that they (Microsoft) are happy to eat the cost? I don't have a clear idea how that value can be captured, since it's going to be 90% AI generated code that anyone can scrape (public projects) or can't be used (private projects), so perhaps you're right.

> 90% AI generated code And it isn't even clear yet if the AI generated code is even particularly valuable since it's legally ambiguous as to whether or not any human ownership can be attributed to it. The USPTO has declined copyrightability for genai artwork, it's only a matter of time before the same question comes up about code.

Your claim is incorrect. Something purely AI generated may not be covered by copyright in the US. That would make it more valuable to MS as you can reuse it as you like.

However, works with significant human input are covered by copyright, and most code does have such input. Human review, and correction is very common. There is a lot of AI generated code out there, and there are no cases challenging the copyright on it.

You also need to look beyond US law. Software is a global business and most software businesses do not want to write software they can only sell in certain countries.

Re: Incident with Issues and Webhooks – Resolved

#67
post #47

It feels weird (sad?) that I'm starting to get a sixth sense for when Github is going to a service disruption. About an hour ago, clicking "Resolve Conversation" in a Pull Request failed a few times with an error message that appeared lower on the page (outside the viewport), and which I did not see the first few times. I had to reload the page after every few actions to get the server to register new ones. I told a…

[dead]

Re: Incident with Issues and Webhooks – Resolved

#68
post #52

Github has published some incredible usage rate increase numbers, which they ascribe to the rise of agentic coding. At some point, they are going to have to change rate limits, cut free-tier usage, or find some other path to reducing load. It's clear that their infrastructure can't keep up with this significant increase, and it's unlikely that they're going to just absorb the increased costs themselves. Very curious…

For literally decades, I’ve observed that there are systems that make each operation cheap and systems that work hard to scale out. The former frequently seems to wildly outperform the latter. GitHub, for example, seems to implement the main repository /pulls page as a search query, which is hinted at by the prefilled search bar and was mostly confirmed last week when the search backend failed and pull requests didn’…

I think you need to broaden your focus here - I can't really remember any significant downtime before the Microsoft acquisition and the data supports my memories.

Microsoft bought Github and migrated to Azure, which is explains the findings. The query performance was fine before they started serving from Azure.

I mean honestly, as though there isn't one single person competent enough to read some logs and horizontally scale a few read only dbs to meet demand? That's not it

Re: Incident with Issues and Webhooks – Resolved

#70
The best time for GH to increase prices was 6 months ago, or so. No service is going to weather the storm of agentic code overload unscathed. But at least they could become an expensive-but-working solution instead of the sad comedy they're now, and thus keep their most lucrative customers.
Post reply on HN