Live data from Hacker News

ArchiveBox/ArchiveBox: open-source self-hosted web archiving

github.com

11–20 of 27 posts

Re: ArchiveBox/ArchiveBox: open-source self-hosted web archiving

#11
Wow, it can even extract video! This looks phenomenal, and a great excuse to stock up on more disk space.

Their roadmap is also very interesting: "v2.0 Federated or distributed archiving + paid hosted service offering"

https://github.com/ArchiveBox/ArchiveBox/wiki/Roadmap#v20-fe...

Re: ArchiveBox/ArchiveBox: open-source self-hosted web archiving

#12

I really need to try this out soon. I keep bumping into it online. What do people on HN use it for? What I do right now "to collect, save, and view sites you want to preserve offline" is by use of a Firefox plugin called WebScrapBook. Click-click-done, and I have a local searchable (!) copy of a webpage exactly as it looked in the browser. With styles and all, in one file. WebScrapBook is pretty highly configurable.…

I’ve used it to save a lot of pages related to ham radio. I have several 30-40 year old radios and I’m afraid one day information about them will just drop off the internet.

Cool! How is the saving experience? Is it quick? And looking up? Or is it more just 'saving for later use'?

Re: ArchiveBox/ArchiveBox: open-source self-hosted web archiving

#13
post #7

What is the advantage of this over something like Kiwix, or just using Playwright CLI? It seems useful but a bit unnecessary if just using to create Archive.org links.

I use it like permanent bookmarks. I can go back to it and trust it'll still be there. And this isn't just "things disappear eventually" - for a specific example, I was working on something rather last-minute recently, and wanted to refer to a vendor's whitepaper - and their entire site was "down for maintenance" all weekend. So I went onto my archive and I still had a copy from my first pass over the topic. It's a f…

> I use it like permanent bookmarks.

I create browser bookmarks regularly but I wouldn't be bothered to SSH into my server to also tell it to grab a copy of the URL. Automating this with a browser plugin would be cool.

Re: ArchiveBox/ArchiveBox: open-source self-hosted web archiving

#15
Just FYI, I have this set up as a Docker container on my Synology and it is now patiently crawling through my (imported) 2000+ Pocket URLs, to which I’m adding a lot of other stuff scattered across other “clipping” tools (like OneNote).

Key benefit for me is having actual local files. The resulting PDFs are searchable on their own, so I can sync those back to my Mac for reference (and Spotlight indexing). But the HTML snapshots are also pretty decent.

One thing I’ll be looking into is automatic tagging (since it’s a Django app there are plenty of likely ways to inject that info).

Re: ArchiveBox/ArchiveBox: open-source self-hosted web archiving

#16
post #15

Just FYI, I have this set up as a Docker container on my Synology and it is now patiently crawling through my (imported) 2000+ Pocket URLs, to which I’m adding a lot of other stuff scattered across other “clipping” tools (like OneNote). Key benefit for me is having actual local files. The resulting PDFs are searchable on their own, so I can sync those back to my Mac for reference (and Spotlight indexing). But the HTM…

I just got my first Synology literally two days ago, a DS3617xsII. Looking forward to playing with it, especially the virtualization / Docker features. How do you like it?

Re: ArchiveBox/ArchiveBox: open-source self-hosted web archiving

#17
post #13
post #7

Earlier quoted context omitted.

I use it like permanent bookmarks. I can go back to it and trust it'll still be there. And this isn't just "things disappear eventually" - for a specific example, I was working on something rather last-minute recently, and wanted to refer to a vendor's whitepaper - and their entire site was "down for maintenance" all weekend. So I went onto my archive and I still had a copy from my first pass over the topic. It's a f…

> I use it like permanent bookmarks. I create browser bookmarks regularly but I wouldn't be bothered to SSH into my server to also tell it to grab a copy of the URL. Automating this with a browser plugin would be cool.

There is a web UI, so I have a JS "bookmarklet" in my toolbar. If you go to the web UI and Add a url, right at the bottom of the page there's a link you can bookmark to do the same. So that's my workflow - click Archive (or cmd-alt-1), then hit enter. Done.

Re: ArchiveBox/ArchiveBox: open-source self-hosted web archiving

#18

How does this compare with, say, Wallabag? https://github.com/wallabag Looks like ArchiveBox has more export options? EDIT: looks like ArchiveBox is focused on continuous change tracking rather than than just snapshots like Wallabag.

Actually, no. You can take more snapshots, but that's just an added feature.

Re: ArchiveBox/ArchiveBox: open-source self-hosted web archiving

#19
post #15

Just FYI, I have this set up as a Docker container on my Synology and it is now patiently crawling through my (imported) 2000+ Pocket URLs, to which I’m adding a lot of other stuff scattered across other “clipping” tools (like OneNote). Key benefit for me is having actual local files. The resulting PDFs are searchable on their own, so I can sync those back to my Mac for reference (and Spotlight indexing). But the HTM…

I just got my first Synology literally two days ago, a DS3617xsII. Looking forward to playing with it, especially the virtualization / Docker features. How do you like it?

Very much so, this is my second and I've had it for a year now: https://taoofmac.com/space/blog/2020/04/04/2310

Re: ArchiveBox/ArchiveBox: open-source self-hosted web archiving

#20
post #19

Earlier quoted context omitted.

I just got my first Synology literally two days ago, a DS3617xsII. Looking forward to playing with it, especially the virtualization / Docker features. How do you like it?

Very much so, this is my second and I've had it for a year now: https://taoofmac.com/space/blog/2020/04/04/2310

Cool post. Sounds like it has a lot of cool features, looking forward to messing with it over the weekend.
Post reply on HN