Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Tesoro – Personal internet archive

tesoro.io

Post reply on HN
Print view View original

1–10 of 105 posts

Re: Show HN: Tesoro – Personal internet archive

#3

Post by agamble »

Piskvorrr wrote: post #2

That's just as much "my own" as The Internet Archive: a website Out There somewhere. Worse, it's much more likely to rot and disappear than archive.org. Now, if I could run this locally ... (Yes, yes, `wget --convert-links`, I know. Not quite as convenient, though.)

OP here. The internet archive is great, but it's not so awesome if there's some ephemeral content you need to save right away, like Tweets or social media posts. Being able to trigger an archive immediately let's you save temporary content such as that which is more prone to deletion. I'm going to build a Chrome extension to click and make cloud copy of the page you're on, hopefully that will make it seem more personally controllable.

Do you think being able to download the archive locally would be useful?

Re: Show HN: Tesoro – Personal internet archive

#5

Post by detaro »

agamble wrote: post #3
Piskvorrr wrote: post #2

That's just as much "my own" as The Internet Archive: a website Out There somewhere. Worse, it's much more likely to rot and disappear than archive.org. Now, if I could run this locally ... (Yes, yes, `wget --convert-links`, I know. Not quite as convenient, though.)

OP here. The internet archive is great, but it's not so awesome if there's some ephemeral content you need to save right away, like Tweets or social media posts. Being able to trigger an archive immediately let's you save temporary content such as that which is more prone to deletion. I'm going to build a Chrome extension to click and make cloud copy of the page you're on, hopefully that will make it seem more person…

You can trigger the Internet Archive manually as well.

Re: Show HN: Tesoro – Personal internet archive

#6

Post by agamble »

detaro wrote: post #5
agamble wrote: post #3

Earlier quoted context omitted.

OP here. The internet archive is great, but it's not so awesome if there's some ephemeral content you need to save right away, like Tweets or social media posts. Being able to trigger an archive immediately let's you save temporary content such as that which is more prone to deletion. I'm going to build a Chrome extension to click and make cloud copy of the page you're on, hopefully that will make it seem more person…

You can trigger the Internet Archive manually as well.

Oh neat didn't realise that, my mistake :)

Re: Show HN: Tesoro – Personal internet archive

#8

Post by dschep »

agamble wrote: post #3
Piskvorrr wrote: post #2

That's just as much "my own" as The Internet Archive: a website Out There somewhere. Worse, it's much more likely to rot and disappear than archive.org. Now, if I could run this locally ... (Yes, yes, `wget --convert-links`, I know. Not quite as convenient, though.)

OP here. The internet archive is great, but it's not so awesome if there's some ephemeral content you need to save right away, like Tweets or social media posts. Being able to trigger an archive immediately let's you save temporary content such as that which is more prone to deletion. I'm going to build a Chrome extension to click and make cloud copy of the page you're on, hopefully that will make it seem more person…

So like another toplevel commenter asked. Why build this or use this instead of archive.is? And there are already multiple extensions available for chrome for it ;)

I agree with GP here, that anything billed as "My own internet archive" should be run on my computer. Not some one elses.

Re: Show HN: Tesoro – Personal internet archive

#9

Post by agamble »

lozzo wrote: post #7

it would be nice to have a bit of explanation on how it works and why we can be confident that we can rely upon it

OP here. Definitely, great idea :)

Briefly: Sites are archived using a system written in Golang and uploaded to a Google Cloud bucket.

More: The system downloads the remote HTML, parses it to extract the relevant dependencies (, , etc) and then downloads these as well. Tesoro is even parsing CSS files to extract the url('...') file dependencies from here as well, meaning most background images and fonts should continue to work. All dependencies (even those hosted at remote domains) are downloaded and hosted with the archive, meaning the src attributes on the original page tags are wrangled to support the new location.

The whole thing is hosted on GCP Container Engine and I deploy with Kubernetes.

I'll write up a more comprehensive blog post in some time, which portion of this would you like to hear more about?

Post reply on HN