Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Tesoro – Personal internet archive

tesoro.io

Post reply on HN
Print view View original

101–105 of 105 posts

Re: Show HN: Tesoro – Personal internet archive

#101

Post by johnaberlin »

motdiem wrote: post #39
JackC wrote: post #30

For personal web archiving, I highly recommend http://webrecorder.io . The site lets you download archives in standard WARC format and play them back in an offline (Electron) player. It's also open source and has a quick local setup via Docker - https://github.com/webrecorder/webrecorder . Webrecorder is by a former Internet Archive engineer, Ilya Kreymer, who now captures online performance art for an art museum. Wh…

Seconding Webrecorder (and the newly updated WAIL) - I had the chance of meeting Ilya Kremer at a conference a few weeks ago, and I can confirm what he's doing is top notch - I'm hoping to see more work around WARC viewing and sharing in the future. (Disclaimer: I also do personal archiving stuff with getkumbu)

Hi motdiem,

Thank you for seconding the newly updated WAIL. I am the maintainer/creator of the newly update WAIL (the Electron version) https://github.com/N0taN3rd/wail

I was unable to attend IIPC Web Archiving Conference (WAC) but the original creator of WAIL(Python) Mat Kelly did attend (we both are apart of the same research group WSDL).

If you or anyone else have any questions about WAIL I am more than happy to answer them.

Re: Show HN: Tesoro – Personal internet archive

#102

Post by johnaberlin »

jpalomaki wrote: post #27

This might be a good use case for distributed storage (IPFS?). Instead of hosting this directly on my computer, it would be interesting to have a setup where the archiving is done via the service and I would just provide somewhere a storage space where the content would end up being mirrored (just to guarantee that my valuable things are saved at least somewhere, should the the other nodes decide to remove the conten…

Hi jpalomaki,

Have you heard of InterPlanetary Wayback (ipwb)? https://github.com/oduwsdl/ipwb

InterPlanetary Wayback (ipwb) facilitates permanence and collaboration in web archives by disseminating the contents of WARC files into the IPFS network.

Re: Show HN: Tesoro – Personal internet archive

#104

Post by fiatjaf »

aethertron wrote: post #66
bfirsh wrote: post #60

What's the best way to automatically archive all of the data I produce on websites? Facebook, Twitter, Instagram, blogs, and so on. At some point these services will disappear, and I want to preserve them. I know a lot of these sites have archiving features, but want something centralised and automatic.

The hypothetical system that makes most sense to me for this: a process that runs 24/7 on a server, watching your feeds on those services. Grabbing and saving everything via APIs or screen-scraping.

Is that creepy resource-eater bug-prone service what makes most sense to you?

Re: Show HN: Tesoro – Personal internet archive

#105

Post by aethertron »

fiatjaf wrote: post #104
aethertron wrote: post #66

Earlier quoted context omitted.

The hypothetical system that makes most sense to me for this: a process that runs 24/7 on a server, watching your feeds on those services. Grabbing and saving everything via APIs or screen-scraping.

Is that creepy resource-eater bug-prone service what makes most sense to you?

Yes. Why do you call it 'creepy'? It's supposed to be a personal service, owned and controlled by the user who wants to archive stuff.

And all computations consume resources, and may have bugs. So what? They can be optimised. Bugs can get fixed. The process would, ideally, auto-update.

Post reply on HN