How long until this is a feature baked into a mainstream web browser? Archive, prefetch, cache, all variants on a theme. History, bookmarks, local search engine, all the same.
Make Your Own Internet Archive with Archive Box
51–60 of 81 posts
Re: Make Your Own Internet Archive with Archive Box
#52My solution as heavy TTS user who has balabolka setup to read copied text which naturally leaves a log for future reference. There's extentions to auto copy highlighted text and append urls which makes entire flow straight forward. Log each day is around 1-5mbs of text saved in a big folder. Biggest limitation is trying to advance search unstructured text files by complex keywords within dates. I'm sure I can setup each clip with delimiters so logs can be imported into a searchable DB, just too lazy.
Re: Make Your Own Internet Archive with Archive Box
#53Interesting side note: It seems like a lot of people in this thread have an interest in retaining a "replayable timeline" of their own browsing/reading history. There's probably enough support here to gather a few contributors for an open source project.
Re: Make Your Own Internet Archive with Archive Box
#54How long until this is a feature baked into a mainstream web browser? Archive, prefetch, cache, all variants on a theme. History, bookmarks, local search engine, all the same.
Forever. Site owners will shit purple Twinkies and put the developers under a copyright cosh if the feature is released or not removed.
Re: Make Your Own Internet Archive with Archive Box
#55Earlier quoted context omitted.
I'm working in that in my "self host the internet offline from your browsing history" project https://github.com/c9fe/22120 It makes a web archive from everything you browse, and lately I've been working on the full text search
Seems it requires chrome to work?
Re: Make Your Own Internet Archive with Archive Box
#56Earlier quoted context omitted.
A few years ago, in an attempt to increase productivity, I used a screen recorder that took a screenshot every 10 seconds and played it back at the end of every day. So I had a timelapse of how I was spending my time -- mostly online. It was very enlightening. The most efficient format to store a sequence of screenshots in is video, because most of them will have heavily overlapping data.
Huh. That's a pretty nifty thing to do. Just wrote a python script to do that for me and it's running in the background right now. Shall be interesting to come back to it today in the evening. Do you recall how many seconds each screenshot would show itself in the final video (basically what was the framerate?). Currently considering about 4 frames per second but would love to get your take on it :)
Re: Make Your Own Internet Archive with Archive Box
#57Earlier quoted context omitted.
Seems it requires chrome to work?
Wow, your reading comprehension is amazingly good. Yep, that's correct.
Re: Make Your Own Internet Archive with Archive Box
#58Earlier quoted context omitted.
A few years ago, in an attempt to increase productivity, I used a screen recorder that took a screenshot every 10 seconds and played it back at the end of every day. So I had a timelapse of how I was spending my time -- mostly online. It was very enlightening. The most efficient format to store a sequence of screenshots in is video, because most of them will have heavily overlapping data.
Huh. That's a pretty nifty thing to do. Just wrote a python script to do that for me and it's running in the background right now. Shall be interesting to come back to it today in the evening. Do you recall how many seconds each screenshot would show itself in the final video (basically what was the framerate?). Currently considering about 4 frames per second but would love to get your take on it :)
I think at one point I used an ImageMagick script to add timestamps to them.
Originally I used a Windows thing called TimeSnapper which as a bonus lets you scrub through time and shows when there was / wasn't computer activity.
Re: Make Your Own Internet Archive with Archive Box
#59How can I use this to archive sites/pages that require logging in to see?
Re: Make Your Own Internet Archive with Archive Box
#60Earlier quoted context omitted.
For reference, archivebox uses 250GB for 5000 links in my setup.
That is an insane amount of storage for so few links. Is your setup somehow very greedy? Saving article only view (images + text) should probably do better I suspect your numbers come from JavaScript and css, etc? Is there a way for archivebox to not download react 5000 times but share source files? Most likely custom bundles that sites compile will not make this possible most of the time. Just thinking out loud here…