Live data from Hacker News

GitHub Outage

github.com

191–200 of 297 posts

Re: GitHub Outage

#191

I wish they say more than > We're investigating a significant network disruption affecting all github.com services.

I would prefer that they focus on getting back up and publish a post-mortem after the fact.

The best approach to this was shown recently by Slack, where they had a huge team of people on social media while their engineers figured out the outage.

Re: GitHub Outage

#192

Developers: "I can't get any work done because GitHub is down!" Linus Torvalds: [ facepalm ]

I honestly can't get much work done now, I've been looking for RabbitMQ auth plugin sample code and every link I'm clicking now shows me a unicorn.

Re: GitHub Outage

#193
post #171

Earlier quoted context omitted.

why only bower-dependent?

I'm guessing the parent doesn't mean only bower, but bower uses github as the source of packages/code (I don't use bower, so I'm only going from memory). On a build that downloads everything 'fresh' it's not going to be able to get sources that are only on github. Bower certainly isn't the only thing that does it. It's a trend that's becoming more and more common.

I was in a go tutorial a couple of years ago where the presenter was including directly from github.

And sitting in a ruby talk when the rubygems compromise happened just after everyone had been told to go upgrade a gem because of flaws in a specific gem.

It's not unique, but it is terrible.

Re: GitHub Outage

#194
Fiddling around with several deployment and configuration management options I just came to the conclusion that there is too much code between me and the systems.

I would like to have one bash script that I could start in such worst case scenarios that tests everything and tells me exactly what the problem is.

Just imagine everything is down and you can not trust your dashboards.

What would you put into such a script? What would you test for?

Re: GitHub Outage

#195
post #90

Earlier quoted context omitted.

What would that look like? Can you describe it? It's not very useful to say stuff without providing some sort of useful idea. You can't just say "someone should write some sort of stupid content tracker, and give it some random three-letter combination that is pronounceable," or whatever.

Completely agree. But whoever makes it, they should make it free and open source and designed to handle everything from small to very large projects with speed and efficiency. Additionally, it should be easy to learn and have a tiny footprint with lightning fast performance. It should outclass SCM tools like Subversion, CVS, Perforce, and ClearCase with features like cheap local branching, convenient staging areas, a…

> it should be easy to learn

That would be a significant upgrade.

Re: GitHub Outage

#196

Every time this happens people make clever remarks about how Git is distributed but we're all depending on GitHub for so much that we defeat the purpose. But once GitHub comes back up, everyone just gets back to work, trusting and relying on it as much as ever. Eventually it goes down again, and we come back to complain. Convenience is the only thing that we seem to value. (I'm no different, which makes my comment co…

The bigger problem here is the number of build packs only relying on Github as a source of truth. We need to find an abstraction to distribute storage so that there is no single point of failure.

Re: GitHub Outage

#197
> January 28, 2016

> 00:00 EST The status is still red at the beginning of the day

They seem to have some time issues as well since it's not yet January 28th in EST.

Re: GitHub Outage

#198

Every time this happens people make clever remarks about how Git is distributed but we're all depending on GitHub for so much that we defeat the purpose. But once GitHub comes back up, everyone just gets back to work, trusting and relying on it as much as ever. Eventually it goes down again, and we come back to complain. Convenience is the only thing that we seem to value. (I'm no different, which makes my comment co…

> clever remarks about how Git is distributed but we're all depending on GitHub for so much that we defeat the purpose

Yeah, but they'd be wrong about that purpose.

Distributed systems used by people (eg. email, BitTorrent) always have their major hubs (Gmail, The Pirate Bay). That's understandable: no product reaches critical mass without a main stream. The strength of a distributed system isn't that it has no points of failure: it's that, in the event of a significant failure in an established node (eg. TPB's downtime at the end of 2014), the community can retarget around a new solution (eg. KickassTorrents) at the point in which the inconvenience of the downtime outweighs the inconvenience of switching habits, without a significant dip in service associated with the switch.

In contrast, a truly centralized system like BitKeeper would just outright block progress if the central node were to deny access (which was, of course, the purpose that led to devs like Linus Torvalds changing their focus for a few months, so they they could scale back to full kernel production as they constructed a workable alternative, in Git).

Post reply on HN