Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GitHub Git Operations Are Down

githubstatus.com

Post reply on HN
Print view View original

151–160 of 271 posts

Re: GitHub Git Operations Are Down

#151

Post by Over2Chars »

bastardoperator wrote: post #83
crest wrote: post #13

It's almost as if only Git is distributed, but people sold out to Github for convenience. Too bad Git lacks a distributed bug tracker and wiki system like Fossil. Guess Github has to fail a lot more for things to change.

It's this type of negativity ruining the internet. Nothing thoughtful to say, nothing to add, and hoping for failure. I hope everything is okay over there...

You're quite a Mary Poppins for someone with the heavy handle of @bastardoperator.

AFAICT the internet was built on negativity.

Here's the 2nd post from a random USENET group I found:

https://www.usenetarchives.com/view.php?id=comp&mid=PDQ5ajZp...

Re: GitHub Git Operations Are Down

#152

Post by deathanatos »

manfre wrote: post #94
freewizard wrote: post #62

It was down for ~2 hours. The status website claims "degraded performance", but in reality we get git@github.com: Permission denied (publickey). Either GitHub didn't know how to communicate, or they were not sure about the real impact. This is bad.

Status pages are rarely honest. The company will lie to salvage their SLA. "Degraded performance" or "some customers are experiencing an elevated error rate" should be interpreted as "service unavailable / outage"

They used to be. Github's is a prime example of how "useful info" has turned into "PR mouthpiece" — it used to display graphs of a few choice Github system metrics, and those spiking could often usefully indicate "yeah, they're having a problem" well before a human could update the page.

But yeah, also status pages seem to be under the domain of non-engineers who are too concerned with how things look, vs. conveying useful information in a timely manner, and ultimately, fail at both.

Re: GitHub Git Operations Are Down

#153

Post by hamandcheese »

dangoldin wrote: post #139
macintux wrote: post #118

Earlier quoted context omitted.

The nice thing about git, from my perspective, is that if your entire hosted service vanishes, you can still reconstruct what you need from your users’ working directories. All of the important branches should be there. Somewhere. And any important integration branches that aren’t cached can be reconstructed. Of all the many dependencies on cloud services, git is by far the last I’d worry overly much about.

Problem is that often you also end up relying on GitHub for CI/CD so not as easy of a change. Imagine GH being down and you need to deploy a hotfix. How do you handle that? Especially, if you followed best practices and set up a system where all PRs need to go through code review.

Systems like these should have an escape hatch of some sort. The key part is that it needs to be auditable.

Anything you do in CI should be possible outside of CI, at least by some subset of users.

Re: GitHub Git Operations Are Down

#154

Post by parpfish »

Over2Chars wrote: post #143
parpfish wrote: post #100

Earlier quoted context omitted.

but if you self host, how do you anticipate power outages and natural disasters? you shift it from a problem of software reliability to a problem of physical infrastructure. at some point in the chain somebody has to do that, but i'd prefer the person doing that was somebody with DEEP experience in it that could give you some nice confident assurances.

You're just using your own data center instead of Jeff's bit barn. I mean seriously people, a "cloud" is just someone elses' data center . Am I missing something?

Yes, but if it’s somebody else’s data center it’s on them to figure out how to earthquake proof or whatever. The cloud isnt just renting a computer, it’s renting a computer with a guarantee of uptime that somebody else can be financially liable for

Re: GitHub Git Operations Are Down

#156

Post by Over2Chars »

adamtaylor_13 wrote: post #53
crest wrote: post #13

It's almost as if only Git is distributed, but people sold out to Github for convenience. Too bad Git lacks a distributed bug tracker and wiki system like Fossil. Guess Github has to fail a lot more for things to change.

I don’t know anyone beyond hobbyist hackers who want to set up and maintain this stuff for themselves. As a professional software developer, I want tools that just work that I can rely on. GitHub 99.99% uptime is something I can rely on.

four 9's uptime https://uptime.is/99.99

Daily: 8.6s

Weekly: 1m 0.48s

Monthly: 4m 21s

Quarterly: 13m 2.4s

Yearly: 52m 9.8s

If you assume that "uptime" means all tools are available

https://statusgator.com/services/github

this appears to be 45 minutes in just one day

Incident with Git Operations 30m Jan 14, 2025 9:01 AM Down

Incident with Git Operations 10m Jan 14, 2025 8:51 AM Down

Incident with Git Operations 5m Jan 14, 2025 8:46 AM Down

Not much margin to hit four 9's left for the rest of the year.

Re: GitHub Git Operations Are Down

#157

Post by thfuran »

arrowsmith wrote: post #122
__MatrixMan__ wrote: post #119

Earlier quoted context omitted.

I was imagining something a bit more disastrous than that. A big enough solar flare could take parts of the planet offline for months. Years if they can't source enough replacement transformers. There are also political reasons that countries go offline. Then it'll be up to the nerds who manage to cobble together their own distributed version of everything--even if it's a significantly reduced definition of everythin…

If large parts of the planet lose their digital infrastructure for months, I really don’t think that “finding a good platform to host my code” is going to be one of my biggest problems.

Especially if the problem was due to a lack of electric grid as they're suggesting.

Re: GitHub Git Operations Are Down

#158

Post by Over2Chars »

gerdesj wrote: post #89
adamtaylor_13 wrote: post #53

Earlier quoted context omitted.

I don’t know anyone beyond hobbyist hackers who want to set up and maintain this stuff for themselves. As a professional software developer, I want tools that just work that I can rely on. GitHub 99.99% uptime is something I can rely on.

A bloke called Linus Thorvalds created git for Linux development when the commercial service used for that ceased to be useful, for one non technical reason or another. github basically shoves a webby frontend and workflows on top of someone else's work. That's all fine and good but github is not git. As a professional IT consultant, I want tools, I use lots of other's and I also create my own and I also generally in…

I believe he found the open source tools being used (CVS?) weren't good enough, and he started using a commercial closed source tool called "bitkeeper", which rankled the ire of the FOSS community who wanted to eat their own dogfood.

So Torvald's opted to "clone" the features of bitkeeper into an open source version he named 'git'.

That's the story I heard, no idea if it's true.

Re: GitHub Git Operations Are Down

#159

Post by vikramkr »

__MatrixMan__ wrote: post #119
School-Cotton wrote: post #111

Earlier quoted context omitted.

No, they'll continue to feel like that even after that. GitHub being down once in a blue moon is more acceptable to the vast majority of users than having to cobble together your own nerdy distributed version of everything.

I was imagining something a bit more disastrous than that. A big enough solar flare could take parts of the planet offline for months. Years if they can't source enough replacement transformers. There are also political reasons that countries go offline. Then it'll be up to the nerds who manage to cobble together their own distributed version of everything--even if it's a significantly reduced definition of everythin…

At that point the enormously powerful central players like big tech and militaries and tax collectors will be more than incentivezed to use every remaining resource they have to bring everything back online and re-centralize power. And if they can't - society and power wasn't exactly more distributed in the distant past lol. Your local warlord/military dictator/whatever will probably not be supportive of nerds acting independently.
Post reply on HN