ArchiveBox: Open-source self-hosted web archive

Post by nikisweeting » Tue, Mar 12, 2019, 6:25 PM UTC

machawk1 wrote: post #49

aloer wrote: post #39

I have spent the last hours reading up on everything-WARC that I could find but I still haven't been able to answer my main question: why only as external crawlers? There does not seem to be a tool to actually capture a warc directly in your own browser session. webrecorder ( http://webrecorder.io/ ) is the only example I could find that comes close in terms of user experience but it still requires a third party and…

When I initially coded up WARCreate, the webRequest API was still experimental. I believe there are more mature APIs that can be used from the extension context but some require DevTools to be visually open, which is not a common usage pattern of a typical web user. Per the ticket, we have worked on a few other JavaScript-driven web preservation project like https://github.com/N0taN3rd/node-warc and https://github.co…

Post by nikisweeting » Sat, Mar 16, 2019, 7:53 PM UTC

narag wrote: post #32

amenod wrote: post #5

This sounds like a very good idea, but I'm having trouble making it work. For example, let's say I want to save a great website which will probably disappear soon ( https://launchaco.com ). I run `echo https://launchaco.com | ./archive` and then...? The generated index.html doesn't load css and js files. Or is this more for static content? Is there some tool that would allow one to make a copy of a modern SPA? Is tha…

Is there some tool that would allow one to make a copy of a modern SPA? If the interesting content is inside a database at the backend, copying the interface is not enough. You also want the database.