Show HN: Tesoro – Personal internet archive

Post by falcolas » Tue, Jun 27, 2017, 2:59 PM UTC

unicornporn wrote: post #20

In what way could this considered to be “your own internet archive”? I see no way to register a user and save pages to a collection. If you really want to create your own archive, set up a Live Archiving HTTP Proxy[1], run SquidMan [2] or check out WWWOFFLE[3]. If you want something simpler, have a look at Webrecorder[4] or a paid Pinboard account with the “Bookmark Archive”[5]. [1] http://netpreserve.org/projects/li…

Post by thallesr » Tue, Jun 27, 2017, 3:06 PM UTC

dsacco wrote: post #12

agamble wrote: post #3

Earlier quoted context omitted.

OP here. The internet archive is great, but it's not so awesome if there's some ephemeral content you need to save right away, like Tweets or social media posts. Being able to trigger an archive immediately let's you save temporary content such as that which is more prone to deletion. I'm going to build a Chrome extension to click and make cloud copy of the page you're on, hopefully that will make it seem more person…

This might sound insane, but if you modified this into a browser extension that runs locally (with options for one-off or continuous saving for entire browsing sessions) I would probably download it. Personally, I have well over 100TB of personal hard drive space in my home, and I would love to just download entire portions of my browsing history locally for archival reasons (and to truly defeat link rot). As it is n…

Post by rahiel » Tue, Jun 27, 2017, 3:17 PM UTC

chongli wrote: post #46

dsacco wrote: post #12

Earlier quoted context omitted.

This might sound insane, but if you modified this into a browser extension that runs locally (with options for one-off or continuous saving for entire browsing sessions) I would probably download it. Personally, I have well over 100TB of personal hard drive space in my home, and I would love to just download entire portions of my browsing history locally for archival reasons (and to truly defeat link rot). As it is n…

modified this into a browser extension I was just thinking about this last night while I was explaining my use of the Firefox tab groups extension to a friend. I use bookmarks and tabs to keep track of information. Neither is fully convenient and the whole system fails whenever a page changes or a link rots. I would love a system that archives a page I bookmark so that the bookmark will always work to give me that in…

Post by amrrs » Tue, Jun 27, 2017, 3:29 PM UTC

motdiem wrote: post #39

JackC wrote: post #30

For personal web archiving, I highly recommend http://webrecorder.io . The site lets you download archives in standard WARC format and play them back in an offline (Electron) player. It's also open source and has a quick local setup via Docker - https://github.com/webrecorder/webrecorder . Webrecorder is by a former Internet Archive engineer, Ilya Kreymer, who now captures online performance art for an art museum. Wh…

Seconding Webrecorder (and the newly updated WAIL) - I had the chance of meeting Ilya Kremer at a conference a few weeks ago, and I can confirm what he's doing is top notch - I'm hoping to see more work around WARC viewing and sharing in the future. (Disclaimer: I also do personal archiving stuff with getkumbu)

Post by kchr » Tue, Jun 27, 2017, 3:31 PM UTC

pbhjpbhj wrote: post #17

smoyer wrote: post #13

It's not mine unless it's running on my own servers or computer - I created a really rough version of this several years ago that is saved to my computer (and from there into box).

I adapted a bash script someone posted here, it uses Firefox bookmarks (pages.sqlite). Cron runs the script and downloads every page I've bookmarked that month (after some filtering). I don't use it often but sometimes I'll awk-grep it; I'm a hoarder in real life too!