Live data from Hacker News

Show HN: Tesoro – Personal internet archive

tesoro.io

61–70 of 105 posts

Re: Show HN: Tesoro – Personal internet archive

#63
post #60

What's the best way to automatically archive all of the data I produce on websites? Facebook, Twitter, Instagram, blogs, and so on. At some point these services will disappear, and I want to preserve them. I know a lot of these sites have archiving features, but want something centralised and automatic.

The IndieWeb(.org) group recommends 'Publish (on your) Own Site, Syndicate Elsewhere' (https://indieweb.org/POSSE) that you might find interesting.

Re: Show HN: Tesoro – Personal internet archive

#64
post #55
post #46

Earlier quoted context omitted.

modified this into a browser extension I was just thinking about this last night while I was explaining my use of the Firefox tab groups extension to a friend. I use bookmarks and tabs to keep track of information. Neither is fully convenient and the whole system fails whenever a page changes or a link rots. I would love a system that archives a page I bookmark so that the bookmark will always work to give me that in…

I made a browser extension [1] that automatically archives bookmarks to archive.is or (currently Chromium only) locally as MHTML files. [1]: https://github.com/rahiel/archiveror

Cool, Rahiel! Thanks for doing this.

Here is a related idea I proposed a couple years ago to a Knight News Challenge on Libraries: https://web.archive.org/web/20161104175911/https://www.newsc... "Create a browser addon so when people post to the web they can send a copy for storage and hosting by a network of local libraries. ... While the Internet Archive is backing up some of the internet, it is another single point of failure. We propose developing data standards, software applications, coordination protocols. and hardware specifications so every local library in the world can participate in backing up part of the internet. ..."

Sad that the Knight News Foundation has changed their software and so all the old Knight News contributions are no longer available. It's an example of the very thing that contribution was about -- the need for distributed backups. Glad that info is still findable in archive.org -- until perhaps the Knight News Foundation puts up a broad robots.txt and makes it all inaccessible.

Thanks again for creating a great plugin!

Re: Show HN: Tesoro – Personal internet archive

#65
post #3

That's just as much "my own" as The Internet Archive: a website Out There somewhere. Worse, it's much more likely to rot and disappear than archive.org. Now, if I could run this locally ... (Yes, yes, `wget --convert-links`, I know. Not quite as convenient, though.)

OP here. The internet archive is great, but it's not so awesome if there's some ephemeral content you need to save right away, like Tweets or social media posts. Being able to trigger an archive immediately let's you save temporary content such as that which is more prone to deletion. I'm going to build a Chrome extension to click and make cloud copy of the page you're on, hopefully that will make it seem more person…

This exists for (& from) the Internet Archive!

Firefox: https://addons.mozilla.org/en-US/firefox/addon/wayback-machi...

Chrome: https://chrome.google.com/webstore/detail/wayback-machine/fp...

Safari: https://safari-extensions.apple.com/details/?id=archive.org....

Android: https://play.google.com/store/apps/details?id=com.archive.wa...

iOS: https://itunes.apple.com/us/app/wayback-machine/id1201888313

Re: Show HN: Tesoro – Personal internet archive

#66
post #60

What's the best way to automatically archive all of the data I produce on websites? Facebook, Twitter, Instagram, blogs, and so on. At some point these services will disappear, and I want to preserve them. I know a lot of these sites have archiving features, but want something centralised and automatic.

The hypothetical system that makes most sense to me for this: a process that runs 24/7 on a server, watching your feeds on those services. Grabbing and saving everything via APIs or screen-scraping.

Re: Show HN: Tesoro – Personal internet archive

#67
Cool tool, but by using it, you depend on it staying alive for longer than any page you archive on it.

This got me thinking about how a decentralized p2p internet archive could solve the trust problem that exists in centralized internet archives. Such solution could also increase the capacity of archived pages and the frequency at which archived pages are updated.

It is true that keeping the entire history of the internet on your local drive is likely impossible, but a solution similar to what Sia is doing could solve this problem: split each page to 20 pieces and distribute each piece to 10 peers such that every y pieces can recover the original page. So, you only have to trust that 10 peers out of 20 that store a page are still alive to get the complete page.

The main problem I can see right now would be lack of motivation to contribute to the system -- why would people run nodes? Just because it would feature a yet another cryptocurrency? Sure, this could hold now, but when the cryptocurrency craze quiets down and people stop buying random cryptocurrencies just for the sake of trading them, what then? Who would run the nodes and why?

Re: Show HN: Tesoro – Personal internet archive

#68
post #13

It's not mine unless it's running on my own servers or computer - I created a really rough version of this several years ago that is saved to my computer (and from there into box).

I wrote a similar tool which uses Electron to create PDFs of webpages and bookmark them in a SQLite database.

https://github.com/marvelm/erised

Re: Show HN: Tesoro – Personal internet archive

#69
The discussion 3 months ago on bookmarks mentioned several options for archiving pages (some locally): Ask HN: Do you still use browser bookmarks? | https://news.ycombinator.com/item?id=14064096

extensions: Firefox "Print Edit" Addon / Firefox Scrapbook X / Chrome Falcon / Firefox Recoll

open source: Zotero / WorldBrain / Wallabag

commercial: Pinboard / InstaPaper / Pocket / Evernote / Mochimarks / Diigo / PageDash / URL Manager Pro / Save to Google / OneNote / Stash / Fetching

public: http://web.archive.org / https://archive.is/

Re: Show HN: Tesoro – Personal internet archive

#70

Cool tool, but by using it, you depend on it staying alive for longer than any page you archive on it. This got me thinking about how a decentralized p2p internet archive could solve the trust problem that exists in centralized internet archives. Such solution could also increase the capacity of archived pages and the frequency at which archived pages are updated. It is true that keeping the entire history of the int…

IPFS [0] and it's sibling Filecoin [1] are dealing in a very similar space as your wonderings

[0]: https://ipfs.io/ [1]: https://filecoin.io/

Post reply on HN