41–50 of 81 posts
How long until this is a feature baked into a mainstream web browser? Archive, prefetch, cache, all variants on a theme. History, bookmarks, local search engine, all the same.
I often wish that I could do a full text search of every page I've already visited.
Earlier quoted context omitted.
I often wish that I could do a full text search of every page I've already visited.
I'm working in that in my "self host the internet offline from your browsing history" project https://github.com/c9fe/22120 It makes a web archive from everything you browse, and lately I've been working on the full text search
Can you configure this tool to login to websites (for paid news subscriptions) and get past those paywalls?
You will need a lot of disk storage right?
For reference, archivebox uses 250GB for 5000 links in my setup.
Saving article only view (images + text) should probably do better
I suspect your numbers come from JavaScript and css, etc? Is there a way for archivebox to not download react 5000 times but share source files? Most likely custom bundles that sites compile will not make this possible most of the time. Just thinking out loud here.
so.. you CAN have a box that is "the internet"....
Can you configure this tool to login to websites (for paid news subscriptions) and get past those paywalls?
How can I use this to archive sites/pages that require logging in to see?
I feel like a simple automatic capture of timestamp + url + screenshot would already be very useful. This gives you a visual memory of the things you've seen on the web. I've wanted to develop this for a while, as a browser plugin. Being able to skim the past month or two click around the thumbnails would already be amazing. I've wanted to do that many times before to check if my memory was correct, or if a page chan…
This doesn't allow full text search easily, though.