Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Backup your public GitHub repositories with GitHub-backup

github.com

Post reply on HN
Print view View original

11–20 of 21 posts

Re: Show HN: Backup your public GitHub repositories with GitHub-backup

#12

Post by w0rd-driven »

Where a tool like this seems to really make sense is not in the git repository. Most of us know or should know how to back this up properly.

The real power comes in dumping the issues, wiki, PRs, and any other information that is not completely contained in git. Having something that would dump the git+ so that even if a site like GitHub were to shutdown you at least had data, in hopefully human readable format like JSON, that can be parsed at a later time if you so choose.

This would also open the door for interop between things like GitLab, GitHub, and Bitbucket which all seem to have their own version of what the term "git+" should be. If this could be a pathway to lead to standardizing that API on top of git so that all these different players can talk with one another would be kinda huge as well. It's hard to see Github and Bitbucket wanting to work together for something like this when they have mouths to feed but something tells me "if we build it, they will come."

Re: Show HN: Backup your public GitHub repositories with GitHub-backup

#13

Post by josegonzalez »

w0rd-driven wrote: post #12

Where a tool like this seems to really make sense is not in the git repository. Most of us know or should know how to back this up properly. The real power comes in dumping the issues, wiki, PRs, and any other information that is not completely contained in git. Having something that would dump the git+ so that even if a site like GitHub were to shutdown you at least had data, in hopefully human readable format like…

I wrote a tool like that for Github almost a year ago, finally got around to packaging it. It copies issues, issue events, watched/starred/private/public repos, wikis, etc. All configured via arguments. It's written in python with no external dependencies, so should work fine in most versions:

- https://pypi.python.org/pypi/github-backup

I built it as our company github org is getting quite big, and I wanted to backup my own repositories (at the time I had something like ~300 repos, which I've since slimmed down). Worked well enough for me.

Re: Show HN: Backup your public GitHub repositories with GitHub-backup

#14

Post by aaronbasssett »

w0rd-driven wrote: post #12

Where a tool like this seems to really make sense is not in the git repository. Most of us know or should know how to back this up properly. The real power comes in dumping the issues, wiki, PRs, and any other information that is not completely contained in git. Having something that would dump the git+ so that even if a site like GitHub were to shutdown you at least had data, in hopefully human readable format like…

I'm not sure about issues or PRs but you can clone the Wiki like any other repo. Just add ".wiki" before the .git at the end of the clone url.

    git clone git@github.com:jquery/jquery.wiki.git

Re: Show HN: Backup your public GitHub repositories with GitHub-backup

#15

Post by ericlathrop »

josegonzalez wrote: post #13
w0rd-driven wrote: post #12

Where a tool like this seems to really make sense is not in the git repository. Most of us know or should know how to back this up properly. The real power comes in dumping the issues, wiki, PRs, and any other information that is not completely contained in git. Having something that would dump the git+ so that even if a site like GitHub were to shutdown you at least had data, in hopefully human readable format like…

I wrote a tool like that for Github almost a year ago, finally got around to packaging it. It copies issues, issue events, watched/starred/private/public repos, wikis, etc. All configured via arguments. It's written in python with no external dependencies, so should work fine in most versions: - https://pypi.python.org/pypi/github-backup I built it as our company github org is getting quite big, and I wanted to backu…

That looks very nice. Much more comprehensive than my tool. If all my tool accomplished was to prompt you to release your better tool, then I'm a happy camper. Yay open source!

Re: Show HN: Backup your public GitHub repositories with GitHub-backup

#16

Post by tomswartz07 »

ericlathrop wrote: post #9
deanclatworthy wrote: post #8

Earlier quoted context omitted.

Or you could mirror to multiple repositories with one push. I write about how to use Github & Bitbucket simultaneously here: http://deanclatworthy.com/2013/01/how-to-avoid-relying-on-gi...

Wow, that's a pretty neat approach! How well does that work with multiple people?

I can't imagine it would be that difficult with multiple people.

Even if they pulled from one or the other, so long as someone merges the changes from the missing repo, everyone will be good to go.

This is a pretty unique approach to multiple git servers.

Re: Show HN: Backup your public GitHub repositories with GitHub-backup

#19

Post by w0rd-driven »

aaronbasssett wrote: post #14
w0rd-driven wrote: post #12

Where a tool like this seems to really make sense is not in the git repository. Most of us know or should know how to back this up properly. The real power comes in dumping the issues, wiki, PRs, and any other information that is not completely contained in git. Having something that would dump the git+ so that even if a site like GitHub were to shutdown you at least had data, in hopefully human readable format like…

I'm not sure about issues or PRs but you can clone the Wiki like any other repo. Just add ".wiki" before the .git at the end of the clone url. git clone git@github.com:jquery/jquery.wiki.git

I seem to remember this being implemented but overlooked it. Thanks for bringing it up. Ideally, that would be the preferred way to "backup" Github repos. Just replace .wiki with .issues or .pullrequests [insert naming convention here].

It would require remembering the specific repositories for each entity but that's a minor inconvenience if they follow this suggested pattern.

The thought of standardizing the data makes sense when these formats change over time, and I expect they will as features or workflow is added. If I backup my private repo today, I would prefer to have the ability to import it 3 years from now if I so choose and not have to "get lucky" with migrating the data format. It likely wouldn't be hard to figure out if the Github backend APIs are as documented as I believe, but this is a pretty big caveat to using any of these backup approaches.

Post reply on HN