Live data from Hacker News

GitHub Git Operations Are Down

githubstatus.com

91–100 of 271 posts

Re: GitHub Git Operations Are Down

#93
post #36
post #19

Earlier quoted context omitted.

people could not be more clear that their preference is for reliable and easy-to-use centralized services maintained by professionals, and not decentralized systems that require a great deal of user expertise

Ironically github is sort of the exception that proves the rule: decentralized in the one way that really matters (decoupled development on individual systems), but centralized for easy interaction in the way the market demands.

But it demands both. The ability to develop in a parallel, decentralized way, and the ability to integrate things at a central point, an authoritative source and a blessed official destination.

It's similar to how databases allow to begin parallel, concurrent, even contradictory transactions, and also guarantee serialized, consistent database state, and rejection of invalid updates, at commit time. Both aspects are utterly important.

Re: GitHub Git Operations Are Down

#94

It was down for ~2 hours. The status website claims "degraded performance", but in reality we get git@github.com: Permission denied (publickey). Either GitHub didn't know how to communicate, or they were not sure about the real impact. This is bad.

Status pages are rarely honest. The company will lie to salvage their SLA. "Degraded performance" or "some customers are experiencing an elevated error rate" should be interpreted as "service unavailable / outage"

Re: GitHub Git Operations Are Down

#95
post #89

Earlier quoted context omitted.

I don’t know anyone beyond hobbyist hackers who want to set up and maintain this stuff for themselves. As a professional software developer, I want tools that just work that I can rely on. GitHub 99.99% uptime is something I can rely on.

A bloke called Linus Thorvalds created git for Linux development when the commercial service used for that ceased to be useful, for one non technical reason or another. github basically shoves a webby frontend and workflows on top of someone else's work. That's all fine and good but github is not git. As a professional IT consultant, I want tools, I use lots of other's and I also create my own and I also generally in…

Linux development is also centralized. Instead of Github they use an email list that has patches sent to it. If that goes down, your change isn't going into Linux today.

Re: GitHub Git Operations Are Down

#96
post #13

It's almost as if only Git is distributed, but people sold out to Github for convenience. Too bad Git lacks a distributed bug tracker and wiki system like Fossil. Guess Github has to fail a lot more for things to change.

The GitHub wikis are actually git repos.

I forgot about that, I wonder if they were broken too.

Re: GitHub Git Operations Are Down

#97

Ha so that's why my git pull were so slow. I should have checked HN faster.

it'd be great if they set up their CLI tools such that

if there's an error/timeout, they'll do a check of their status page so you don't get the standard 'error' but rather a 'dont worry, youre not doing anything wrong. its borked, our bad' message.

Re: GitHub Git Operations Are Down

#98
post #88

Tangential at best but I work in a regulated industry and we're starting to get some heavy scrutiny from external auditors and regulators on the way we plan to address extended outages and forced exits from third party vendors. This goes beyond basic DR/BCP and plans are reviewed with at least a high level scenario exercise. https://www.federalregister.gov/documents/2023/06/09/2023-12... On the surface a product like…

That's a lot of overhead. Do you know how they are calculating the possible risk of these events? It feels like there are a million rabbit holes like this you could go down when modern infrastructure is so cloud connected.

Is the risk of your git repos higher than a chip shortage causing you to lose access to the infrastructure you need? So many factors to consider. A chip shortage doesn't seem that unlikely with geopolitics.

The list of scenarios you mitigate for seem like they could very easily be an arbitrary list of the of scenarios a single person came up with.

Re: GitHub Git Operations Are Down

#99
post #88

Tangential at best but I work in a regulated industry and we're starting to get some heavy scrutiny from external auditors and regulators on the way we plan to address extended outages and forced exits from third party vendors. This goes beyond basic DR/BCP and plans are reviewed with at least a high level scenario exercise. https://www.federalregister.gov/documents/2023/06/09/2023-12... On the surface a product like…

And the ultimate problem that you don't need a solution for, until you _need_ it. Which often leads to "yeah we have backups" but without regular testing, can you trust them?

Re: GitHub Git Operations Are Down

#100
post #88

Tangential at best but I work in a regulated industry and we're starting to get some heavy scrutiny from external auditors and regulators on the way we plan to address extended outages and forced exits from third party vendors. This goes beyond basic DR/BCP and plans are reviewed with at least a high level scenario exercise. https://www.federalregister.gov/documents/2023/06/09/2023-12... On the surface a product like…

but if you self host, how do you anticipate power outages and natural disasters?

you shift it from a problem of software reliability to a problem of physical infrastructure. at some point in the chain somebody has to do that, but i'd prefer the person doing that was somebody with DEEP experience in it that could give you some nice confident assurances.

Post reply on HN