For Windows, there is also TimseSnapper [1], not open source, but the developer is sometimes here on HackerNews
I made an open source Windows app to rewind and search everything on screen
21–30 of 172 posts
Re: I made an open source Windows app to rewind and search everything on screen
#22It would be cool to:
1) Make a Meta Smart Glasses take a photo every 2 seconds.
2) Send images to some server in the cloud.
3) Run OCR and object detection/labeling on these images.
4) Then present an app that allows searching (and chatting with) your past.
I could then ask the LLM things like:
1) Where did I left my wallet?
2) Did I get my credit card back after paying the restaurant yesterday? (ADHD things, don't ask)
3) What was written in my daughter's new tshirt today?
Bonus point if the app also records and transcribes audio so you could ask the LLM things like:
1) In the last meeting, what was the deadline that we settled on?
2) What was the phone number of that person I met in the park earlier today?
3) What was the name of the investor I met today?
Bonus bonus point if it has access to your phone calls to so it can transcribe and index what others said.
See Black Mirror episode "The Entire History of You": https://en.wikipedia.org/wiki/The_Entire_History_of_You
Re: I made an open source Windows app to rewind and search everything on screen
#23We built in almost 2 decades ago now (including the ability to scrub to a point in the past and resume execution from there)
http://www.cs.columbia.edu/~orenl/papers/sosp07-dejaview.pdf
Abstract: As users interact with the world and their peers through their computers, it is becoming important to archive and later search the information that they have viewed. We present DejaView, a personal virtual computer recorder that provides a complete record of a desktop computing experience that a user can playback, browse, search, and revive seamlessly. DejaView records visual output, checkpoints corresponding application and file system state, and captures displayed text with contextual information to index the record. A user can then browse and search the record for any visual information that has been displayed on the desktop, and revive and interact with the desktop computing state corresponding to any point in the record. DejaView combines display, operating system, and file system virtualization to provide its functionality transparently without any modifications to applications, window systems, or operating system kernels. We have implemented DejaView and evaluated its performance on real-world desktop applications. Our results demonstrate that DejaView can provide continuous low-overhead recording without any user noticeable performance degradation, and allows browsing, search and playback of records fast enough for interactive use.
Re: I made an open source Windows app to rewind and search everything on screen
#24For Windows, there is also TimseSnapper [1], not open source, but the developer is sometimes here on HackerNews [1] https://timesnapper.com/
Cheers, yeh, I am here a bit.
Re: I made an open source Windows app to rewind and search everything on screen
#25Re: I made an open source Windows app to rewind and search everything on screen
#26We built in almost 2 decades ago now (including the ability to scrub to a point in the past and resume execution from there) http://www.cs.columbia.edu/~orenl/papers/sosp07-dejaview.pdf Abstract: As users interact with the world and their peers through their computers, it is becoming important to archive and later search the information that they have viewed. We present DejaView, a personal virtual computer recorder…
Is the url correct? I get a file not found when I try to open it.
Re: I made an open source Windows app to rewind and search everything on screen
#27It would be cool to: 1) Make a Meta Smart Glasses take a photo every 2 seconds. 2) Send images to some server in the cloud. 3) Run OCR and object detection/labeling on these images. 4) Then present an app that allows searching (and chatting with) your past. I could then ask the LLM things like: 1) Where did I left my wallet? 2) Did I get my credit card back after paying the restaurant yesterday? (ADHD things, don't a…
That is exactly what the (highly criticised) Humane AI Pin does
Re: I made an open source Windows app to rewind and search everything on screen
#28Whoa, very cool project, I would be keen to try it out if it worked on Linux.
I wonder if there is a sensible API where you can track everything without storing a video file. Something like seeing Window positions, classes, names, and maybe even GTK/QT cache?
Re: I made an open source Windows app to rewind and search everything on screen
#29Earlier quoted context omitted.
Cheers, yeh, I am here a bit.
That’s fast :) Do you get notified when someone mentions your product, or are you _that_ active?
Neither, lol. Just happened across the comment within five minutes of it being posted. I think it was one of the first times I visited HN today.
Re: I made an open source Windows app to rewind and search everything on screen
#30It would be cool to: 1) Make a Meta Smart Glasses take a photo every 2 seconds. 2) Send images to some server in the cloud. 3) Run OCR and object detection/labeling on these images. 4) Then present an app that allows searching (and chatting with) your past. I could then ask the LLM things like: 1) Where did I left my wallet? 2) Did I get my credit card back after paying the restaurant yesterday? (ADHD things, don't a…
Generally Black Mirror episodes are not intended to be aspirational.