Per the GitHub readme, the video should be around 100-200 GB per year, not too bad.
Avg how many hours a day? Does it delete scenes with no text like movies and games
I made an open source Windows app to rewind and search everything on screen
41–50 of 172 posts
Re: I made an open source Windows app to rewind and search everything on screen
#42Amazing that this was done by a non-professional dev. Huge cudos.
(Tbh why not become a professional dev? You clearly have the skill and at least some interest.)
There's a huge miss in this implementation though: 95% of the time what is on screen is web-browsing. So to go from nicely formatted markup with title tags -> video -> OCR is clearly missing am ore obvious path (either a proxy or browser extension).
Re: I made an open source Windows app to rewind and search everything on screen
#43It would be cool to: 1) Make a Meta Smart Glasses take a photo every 2 seconds. 2) Send images to some server in the cloud. 3) Run OCR and object detection/labeling on these images. 4) Then present an app that allows searching (and chatting with) your past. I could then ask the LLM things like: 1) Where did I left my wallet? 2) Did I get my credit card back after paying the restaurant yesterday? (ADHD things, don't a…
Generally Black Mirror episodes are not intended to be aspirational.
And yet we are already rushing towards this.
Re: I made an open source Windows app to rewind and search everything on screen
#44Amazing that this was done by a non-professional dev. Huge cudos. (Tbh why not become a professional dev? You clearly have the skill and at least some interest.) There's a huge miss in this implementation though: 95% of the time what is on screen is web-browsing. So to go from nicely formatted markup with title tags -> video -> OCR is clearly missing am ore obvious path (either a proxy or browser extension).
I'm not so sure. This generalizes, plus "nicely formatted markup" is a big assumption in the brave new world of modern web apps. I guess it's probably pretty reliable to look for visible text strings, but there's something cool about only caring about what is directly visible.
I've often thought that screen readers might be better off now by attempting this visual approach. It used to not be possible, now it may be easier than relying on accessible markup.
Re: I made an open source Windows app to rewind and search everything on screen
#45It would be cool to: 1) Make a Meta Smart Glasses take a photo every 2 seconds. 2) Send images to some server in the cloud. 3) Run OCR and object detection/labeling on these images. 4) Then present an app that allows searching (and chatting with) your past. I could then ask the LLM things like: 1) Where did I left my wallet? 2) Did I get my credit card back after paying the restaurant yesterday? (ADHD things, don't a…
Generally Black Mirror episodes are not intended to be aspirational.
for a less misanthropic take on the same idea, I recommend Ted Chiang’s “The Truth of Fact, the Truth of Feeling”
Re: I made an open source Windows app to rewind and search everything on screen
#46A long time ago, someone got "cryofreeze" working on Linux processes, where you could freeze a process to disk and unfreeze it later .. but this was purely experimental and doesn't seem to have persisted.
Anyway, in my lab environment where I had this running .. over a decade ago now I guess .. I set up scripts to automatically cryofreeze the daemon processes I was writing, so I could indeed reset to the state in time, of interest during testing. This lab got re-comissioned for other things, and a needed kernel upgrade broke cryofreeze, and I never got back to it - but I have often wondered about it, as a temporal interface to some things would make for a whole new world of useful UI and other interation paradigms to explore.
I remember there was something like this possible on WANG and Tandem systems back in the 80's, and it always has kind of piqued my interest as to why this isn't still considered a thing. Well, I guess syscall complexity has vastly changed since WANG and Tandem were around, lol.
Anyway, I'd love to be able to do this on Linux again - I keep thinking to catch up with the state of the art of process freezing/unfreezing, so this has motivated me to do this - although I do confess that, as principally a Lua/C developer in my chosen market (embedded), I attain this re-playability in other ways (state sync'ing) which also allows me to move processes to other systems, relatively smoothly, also.
Still, would love to have this for normal Linux processes, out of the box. Am I ignoring an obvious way to do this?
Re: I made an open source Windows app to rewind and search everything on screen
#47Earlier quoted context omitted.
Generally Black Mirror episodes are not intended to be aspirational.
Black Mirror is fiction, a lot of it works well thanks to our suspension of disbelief. Remove cloud from the equation, replacing it with a properly safeguarded fully owned hardware located on your own premises - basically make it privacy-respecting, minimizing abuse potential, do a proper audit, and it becomes a super desirable system for people with neurological differences (or just stressed folks - attention and me…
Have you watched the Black Mirror episode in question (S1E3)? Because the point of it was the tech itself and had nothing to do with sharing or the cloud.
Re: I made an open source Windows app to rewind and search everything on screen
#48Similar project for macOS which is also open source: https://rem.ing https://github.com/jasonjmcghee/rem Previously submitted on HN by the dev with some decent discussion 3 months ago here: https://news.ycombinator.com/item?id=38787892
Author of rem here.
Come join in on development!
It's MIT Licensed.
I also kicked off a cross-platform version in rust https://github.com/jasonjmcghee/xrem which is earlier in development and could use even more help.
Re: I made an open source Windows app to rewind and search everything on screen
#49Similar project for macOS which is also open source: https://rem.ing https://github.com/jasonjmcghee/rem Previously submitted on HN by the dev with some decent discussion 3 months ago here: https://news.ycombinator.com/item?id=38787892
Is there anyone here that has used it for an extended period of time? Would be interested to see if it’s actually helpful.
I build a lot of stuff and forget why I did things the way I did.
You can do things like find the point in history where you fixed a bug and go watch yourself debug and put in the fix.
Pretty wild. It makes a lot more sense once you experience getting the value.
Personally I hope Apple adds the feature natively to the OS at some point. They're plenty experienced to build it themselves over there, but maybe having a reference implementation will encourage them to give it a shot.
Re: I made an open source Windows app to rewind and search everything on screen
#50Congrats on the great execution of this novel idea! Inspiring for everyone with a "why isn't there an app that does x" idea.
rewind.ai is another example of this, but their recent pivot into cloud only storage for this and renaming to limitless.ai makes me glad that open source stuff like this popping up so you are not forced into a cloud storage situation. And I say this as a paying customer who will probably stop being one.