Live data from Hacker News

I made an open source Windows app to rewind and search everything on screen

tonoko.notion.site

131–140 of 172 posts

Re: I made an open source Windows app to rewind and search everything on screen

#131

Similar project for macOS which is also open source: https://rem.ing https://github.com/jasonjmcghee/rem Previously submitted on HN by the dev with some decent discussion 3 months ago here: https://news.ycombinator.com/item?id=38787892

also http://rewind.ai which is a company doing the same thing

Re: I made an open source Windows app to rewind and search everything on screen

#132
This is great start. I've been wanting something like this for a while, 10-20gb per month feels like a lot though. Feel like archiving at quarter resolution and black and white and 32bit rate sound and eventually have AI upscale a good compromise.

Re: I made an open source Windows app to rewind and search everything on screen

#133
post #112
post #50

Earlier quoted context omitted.

rewind.ai is another example of this, but their recent pivot into cloud only storage for this and renaming to limitless.ai makes me glad that open source stuff like this popping up so you are not forced into a cloud storage situation. And I say this as a paying customer who will probably stop being one.

they also seem to have shifted to hardware/"AI" wearables (lavalier mics?). hardware is not a promising shift imho

the rise of open source competitors makes it harder to compete as a software-only product

Re: I made an open source Windows app to rewind and search everything on screen

#136

We built in almost 2 decades ago now (including the ability to scrub to a point in the past and resume execution from there) http://www.cs.columbia.edu/~orenl/papers/sosp07-dejaview.pdf Abstract: As users interact with the world and their peers through their computers, it is becoming important to archive and later search the information that they have viewed. We present DejaView, a personal virtual computer recorder…

Great project name!

Back in the early '00s there was be a Canadian cable channel called exactly the same. It still exists apparently - https://www.dejaviewtv.ca

Re: I made an open source Windows app to rewind and search everything on screen

#137

Similar project for macOS which is also open source: https://rem.ing https://github.com/jasonjmcghee/rem Previously submitted on HN by the dev with some decent discussion 3 months ago here: https://news.ycombinator.com/item?id=38787892

also http://rewind.ai which is a company doing the same thing

Why is it "AI" though.

Re: I made an open source Windows app to rewind and search everything on screen

#138

Amazing that this was done by a non-professional dev. Huge cudos. (Tbh why not become a professional dev? You clearly have the skill and at least some interest.) There's a huge miss in this implementation though: 95% of the time what is on screen is web-browsing. So to go from nicely formatted markup with title tags -> video -> OCR is clearly missing am ore obvious path (either a proxy or browser extension).

Thank you! However, coding feels quite daunting to me, as my talents lean more towards design. The reason I embarked on this project is that I strongly desired to address a particular need, but had unable to find an appropriate alternative or willing programming friends to help. Due to my limited development capabilities, many aspects of this app don’t seem to be optimally or fundamentally implemented. Potentially, an open-source approach may inspire others with the same needs to collaborate or provide better solutions.

And yes, most of my screen time is also web-browsing. Currently, I can use the web page's Windows title as a reference, which provides quite a bit of information. To enhance this feature, it might consider using like Chromedriver to gather more details, such as web links and page text, similar to what 'Rewind' offers.

Re: I made an open source Windows app to rewind and search everything on screen

#139

Has anyone built something like this using accessibility APIs instead of (or in addition to) OCR? It seems like a waste to OCR everything when you could just get the text directly from the accessibility APIs. Also seems like potentially a good way to connect LLMs to UIs, and something like this would be the way to collect the training data.

I've built a workflow recorder with a screen history (MVP).

I concluded that in case this is a viable approach, Microsoft or Apple will built that into their OS natively as part of a copilot that remembers everything and comes to assist the user with the knowlede.

My screen history was not as advanced as the app mentioned here though. And I didn't use it myself.

Re: I made an open source Windows app to rewind and search everything on screen

#140
The site is not usable on Firefox even after I temporarily allowed JS to run in my NoScript setup. Perhaps it wants me to disable uBlock Origin as well? Not gonna happen, so there is that. For me this is a no go area regardless of how cool the app is.
Post reply on HN