71–80 of 172 posts
We built in almost 2 decades ago now (including the ability to scrub to a point in the past and resume execution from there) http://www.cs.columbia.edu/~orenl/papers/sosp07-dejaview.pdf Abstract: As users interact with the world and their peers through their computers, it is becoming important to archive and later search the information that they have viewed. We present DejaView, a personal virtual computer recorder…
Has anyone built something like this using accessibility APIs instead of (or in addition to) OCR? It seems like a waste to OCR everything when you could just get the text directly from the accessibility APIs. Also seems like potentially a good way to connect LLMs to UIs, and something like this would be the way to collect the training data.
I would be curious if anybody feels that such a tool wouldn't be too much a danger as spyware. In particular from a Chinese developer.
Similar project for macOS which is also open source: https://rem.ing https://github.com/jasonjmcghee/rem Previously submitted on HN by the dev with some decent discussion 3 months ago here: https://news.ycombinator.com/item?id=38787892
Author of rem here. Come join in on development! It's MIT Licensed. I also kicked off a cross-platform version in rust https://github.com/jasonjmcghee/xrem which is earlier in development and could use even more help.
For Windows, there is also TimseSnapper [1], not open source, but the developer is sometimes here on HackerNews [1] https://timesnapper.com/
For time tracking with screenshots and advanced tagging based on window titles (and sometimes open documents), there is also ManicTime [1]. I don’t think it has OCR though. [1] https://www.manictime.com/
I wanted the same thing for Browser for a very long time. Since that is where 99% of all my information are consumed. But May be it does seems to fit in the OS in a broader prospective.
Earlier quoted context omitted.
Is the url correct? I get a file not found when I try to open it.
Ah, gotta love link rot. This one works : https://www.cs.columbia.edu/~nieh/pubs/sosp2007_dejaview.pdf This one’s broken: https://www.cs.columbia.edu/~orenl/papers/sosp07-dejaview.pd... When I search for “dejaview” in the main index, I get the same broken link in the search results[0]. At first I thought they’d changed the URL structure (/pubs/ to /papers/), but if you visit [1] it works, but [2] doesn’t work. I gues…
For Windows, there is also TimseSnapper [1], not open source, but the developer is sometimes here on HackerNews [1] https://timesnapper.com/
For time tracking with screenshots and advanced tagging based on window titles (and sometimes open documents), there is also ManicTime [1]. I don’t think it has OCR though. [1] https://www.manictime.com/
The free tier is bought by being a firehose of data for them.