Live data from Hacker News

Github major service outage

status.github.com

41–50 of 82 posts

Re: Github major service outage

#41
post #31
post #14

Least reliable service that I pay for by a long shot.

Have you tried Bitbucket? While it lacks a lot of the social integration, it has the benefit of giving you 5 free private repositories.

That is false, BitBucket gives you unlimited amount of private repositories with maximum of 5 collaborators.

Re: Github major service outage

#42

Earlier quoted context omitted.

Must not pay for very many services? https://status.github.com/graphs/past_month

To be fair 99.77% uptime isn't very good.

That isn't fair at all.

It's 99.770% for a single month, immediately following a major event. If you sampled yesterday (or tomorrow, assuming no further issues) it would be higher. If you just look at today, it's at the much lower at 95.871%. If you assume no availability issues for the last 12 months (not true, but the point remains) then it's 99.981%. During an actual outage, availability was at the unacceptable 0%.

Unfortunately they don't provide 12mo stats, which is what you typically want if you're going to start calculating nines of availability.

Re: Github major service outage

#43
post #21

I find it somewhat odd that, given git's emphasis on distributed version control, we see so many git users have centralized themselves quite heavily on GitHub. Whenever GitHub runs into problems like this, it reminds me of when a team's CVS or Subversion servers used to go down. It could be a pretty disruptive occurrence, if it wasn't resolved quickly. While git can theoretically handle this better, in practice the u…

You can also add multiple urls to your remotes. When you push, it'll go to all of them. I do this at home with a tiny server on a mini-atx box and github. Set it and forget it. There's no reason you can't do the same thing with a small box in the office and get the best of both worlds.

Is it that simple? Just pony up another $9.95 for a VPS and you've got git access to your repos whenever GitHub is down.

Re: Github major service outage

#44

I find it somewhat odd that, given git's emphasis on distributed version control, we see so many git users have centralized themselves quite heavily on GitHub. Whenever GitHub runs into problems like this, it reminds me of when a team's CVS or Subversion servers used to go down. It could be a pretty disruptive occurrence, if it wasn't resolved quickly. While git can theoretically handle this better, in practice the u…

What?

    git remote add my_other_server_that_is_not_github git://my.oth.er/server/that/is/not/github.git

Re: Github major service outage

#45

I find it somewhat odd that, given git's emphasis on distributed version control, we see so many git users have centralized themselves quite heavily on GitHub. Whenever GitHub runs into problems like this, it reminds me of when a team's CVS or Subversion servers used to go down. It could be a pretty disruptive occurrence, if it wasn't resolved quickly. While git can theoretically handle this better, in practice the u…

How is it at all odd? Github offers a convenient platform for using git. People use it. If Github were to explode forever tomorrow, active projects would just take their locally cloned repositories, and put them online somewhere else and carry on committing (albeit sans github's awesome social tools). That's the real power git offers us. It's just a fact of reality that most projects centrally organize through a few…

Yes, there is nothing wrong with using Github, but with using only Github as your git remote. Git (in theory) makes it easy to use multiple servers. Add some scripts/utilities and you get Github with all their "social" stuff, wikis and issue trackers plus higher availability if Github goes down; just use your other remotes.

Is there a git tool to share your remotes in a repository?

One could use a distributed issue tracker like "Bugs Everywhere"[1] or git-issues[2]. Are there ways to "sync" them with Github's issues?

[1]: http://bugseverywhere.org/ [2]: https://github.com/jwiegley/git-issues

Re: Github major service outage

#47

I find it somewhat odd that, given git's emphasis on distributed version control, we see so many git users have centralized themselves quite heavily on GitHub. Whenever GitHub runs into problems like this, it reminds me of when a team's CVS or Subversion servers used to go down. It could be a pretty disruptive occurrence, if it wasn't resolved quickly. While git can theoretically handle this better, in practice the u…

Even worse is other tools that rely on Github, like Homebrew (Mac OS X package manager) which breaks in various silly ways when Github is down. Anyone happen to know a way around this specifically? Trying to install some stuff and brew just bails after getting 5xx from github.com.

Clone the homebrew repo. Use a cronjob or Jenkins or some such to periodically fetch updates to a server under your control. Modify homebrew and its setup script to use your repo (it's been a while since I did this but the Github URL for the homebrew repo used to be hard coded in one of homebrew's ruby scripts). Whenever setting up a new machine, use the modified setup script.

Periodically you can merge upstream into your clone to get updated recipes. (e.g., the aforementioned cronjob can mirror master from github to remotes/upstream/master in your repo, then separately you merge that into your master).

Your servers are now immune to github outages[1] and you can review recipe updates before your servers update to those recipes.

[1] unless of course the recipes you're using are hosted on github. But you could recursively mirror those sources too and modify the recipes as needed.

edit: I'm on a mobile device but I can provide further details the next time I'm in front of a keyboard in case this wasn't clear.

Re: Github major service outage

#48
post #42

Earlier quoted context omitted.

To be fair 99.77% uptime isn't very good.

That isn't fair at all. It's 99.770% for a single month, immediately following a major event. If you sampled yesterday (or tomorrow, assuming no further issues) it would be higher. If you just look at today, it's at the much lower at 95.871%. If you assume no availability issues for the last 12 months (not true, but the point remains) then it's 99.981%. During an actual outage, availability was at the unacceptable 0%…

Hey, are you seriously defending 3 9's of uptime? That's abysmal.

Github, if they're honest about their 12 month uptime levels would be lucky to be a single 9 service. Their uptime is Terrible with a capital T. But you know what? Until there's something better everyone is going to keep using them, right?

Great services with values that are hard to find become damn near irreplaceable even with terrible uptime. This is an obvious place to compete; if you made a github clone that simply stayed online you could win market share during every downtime. However cloning github would not be trivial.

And therein lies the problem and the answer to why we accept their terrible uptime levels. They give us something we can't get elsewhere: social coding and easy centralization.

Re: Github major service outage

#49

Earlier quoted context omitted.

They have a typical master/slave setup with memcached on the front. http://www.slideshare.net/err/inside-github

Since they're using MySQL, is there a technical reason (as opposed to historical/lack of time reason) they're not using Galera Cluster? I'm in the process of migrating an existing datastore to MariaDB+Galera, and so far it seems like everything I could hope for in a clustered RDBMS.

Last I investigated Galera it lacked support for query caching. Over 50% of our queries are cache hits, so it made it hard to justify using Galera over a normal master+slave setup. However I could see it being useful for setups where a single server can't handle the load (we average 300 queries/sec on a single server with lots of room to spare.)
Post reply on HN