Live data from Hacker News

I made an open source Windows app to rewind and search everything on screen

tonoko.notion.site

91–100 of 172 posts

Re: I made an open source Windows app to rewind and search everything on screen

#91

Earlier quoted context omitted.

Did you actually build it or just write a paper? Where can I download it?

Previously commented with some other details. TL;DR: It's an old PhD project that requires custom patches to an ancient kernel version. So I guess you can't download it, and even if you could it wouldn't work on any system you'd want to use today: > compsciphd on Oct 11, 2022 | parent | context | favorite | on: Linux NILFS file system: automatic continuous snap... > we used NILFS 15 years ago in dejaview - https://ww…

> vnc didn't work for us as we needed better performance

15 years is a long time, performance wise VNC would be adequate and we're at the point now where OCRing a render is probably fast enough for most use cases (it's actually the most reasonable choice a lot of the time, e.g.: PDF parsing).

(But how's VNC support looking on Wayland based window managers?)

Re: I made an open source Windows app to rewind and search everything on screen

#92
post #83
post #60

I would be curious if anybody feels that such a tool wouldn't be too much a danger as spyware. In particular from a Chinese developer.

Any Chinese developer can call themselves John Smith. Even the spies.

I prefer to be also known as John Bigbooté.

Re: I made an open source Windows app to rewind and search everything on screen

#93

Earlier quoted context omitted.

Did you actually build it or just write a paper? Where can I download it?

Previously commented with some other details. TL;DR: It's an old PhD project that requires custom patches to an ancient kernel version. So I guess you can't download it, and even if you could it wouldn't work on any system you'd want to use today: > compsciphd on Oct 11, 2022 | parent | context | favorite | on: Linux NILFS file system: automatic continuous snap... > we used NILFS 15 years ago in dejaview - https://ww…

one thing I'd note: we didn't patch the kernel source, everything we did was through the module interface, though we did abuse it a bit, but a lot of that abuse was to provide our home grown cgroup/namespace like functionality that wasn't around when our checkpoint/restart work started. But it is fair to say because of that abuse, it was fairly tied to a specific set of kernels)

another project I created on the forensic side (steve bellovin asked the Q and I was like, yeah, I know exactly how to build thta) that might then interest you was something we called ISE-T (I See Everything Twice - Catch 22).

https://academiccommons.columbia.edu/doi/10.7916/D8HQ45MK

Two-Person Control Administration: Preventing Administration Faults through Duplication

Modern computing systems are complex and difficult to administer, making them more prone to system administration faults. Faults can occur simply due to mistakes in the process of administering a complex system. These mistakes can make the system insecure or unavailable. Faults can also occur due to a malicious act of the system administrator. Systems provide little protection against system administrators who install a backdoor or otherwise hide their actions. To prevent these types of system administration faults, we created ISE-T (I See Everything Twice), a system that applies the two-person control model to system administration. ISE-T requires two separate system administrators to perform each administration task. ISE-T then compares the results of the two administrators’ actions for equivalence. ISE-T only applies the results of the actions to the real system if they are equivalent. This provides a higher level of assurance that administration tasks are completed in a manner that will not introduce faults into the system. While the two-person control model is expensive, it is a natural fit for many financial, government, and military systems that require higher levels of assurance. We implemented a prototype ISE-T system for Linux using virtual machines and a unioning file system. Using this system, we conducted a real user study to test its ability to capture changes performed by separate system administrators and compare them for equivalence. Our results show that ISE-T is effective at determining equivalence for many common administration tasks, even when administrators perform those tasks in different ways.

I should note that the paper also discusses that 2 people might be expensive, so the same mechanism can be used by a single admin but in a manner that maintains an audit trail.

The above project wouldn't require any kernel modifications as the work was all about using unionfs (using normal vfs loadable module interface hooks) to capture changes and user spaces to log and compare them.

All this work led to what can be viewed as a proto-docker - https://www.usenix.org/legacy/events/atc10/tech/full_papers/... and https://www.usenix.org/legacy/events/lisa11/tech/full_papers...

Re: I made an open source Windows app to rewind and search everything on screen

#94

Earlier quoted context omitted.

Black Mirror is fiction, a lot of it works well thanks to our suspension of disbelief. Remove cloud from the equation, replacing it with a properly safeguarded fully owned hardware located on your own premises - basically make it privacy-respecting, minimizing abuse potential, do a proper audit, and it becomes a super desirable system for people with neurological differences (or just stressed folks - attention and me…

I have a coworker who was tracking Black Mirror premises that were being taken as inspiration by people on the internet. This may be one of those. A lot of SF authors have expressed this idea: "I meant it as a warning, not a road map". I think I read either Neal Stephenson or William Gibson expressing this about their respective dystopias and the Silicon Valley entrepreneurs who were trying to implement them. Anyway,…

“Don’t create the torment nexus”

https://knowyourmeme.com/memes/torment-nexus

Re: I made an open source Windows app to rewind and search everything on screen

#95
post #47

Earlier quoted context omitted.

Have you watched the Black Mirror episode in question (S1E3)? Because the point of it was the tech itself and had nothing to do with sharing or the cloud.

An extremely similar take on this, that predates Black Mirror, was in some sci-fi media whose name, appropriately enough, currently escapes me. Their premise is that there was a species who evolved to develop a flawless memory. It's a subset of the Black Mirror episode (and this dubious idea) because there, at least, memory is a purely private thing. Yet the end too was quite predictable and logical -- frequently des…

I am curious; ChatGPT suggests

- the science fiction novella "The Rememberers" by A.E. van Vogt, originally published as "The Book of Ptath" in 1943.

- the species known as "Trills" from the "Star Trek" universe, particularly in the series "Star Trek: Deep Space Nine."

Edit: the first suggestion seems to be a hallucination

Re: I made an open source Windows app to rewind and search everything on screen

#96
post #80
post #70

Earlier quoted context omitted.

For time tracking with screenshots and advanced tagging based on window titles (and sometimes open documents), there is also ManicTime [1]. I don’t think it has OCR though. [1] https://www.manictime.com/

> cloud or license The free tier is bought by being a firehose of data for them.

The opposite, actually. Nothing leaves the computer you install it on, unless you specifically pay for their cloud service or stand up your own server. This is one of the reasons I chose it for myself over using timely or toggl.

Re: I made an open source Windows app to rewind and search everything on screen

#97
There was this app, I don't remember the name, that was similar I think for MacOS. It would record the entire timeline, and you could just "scroll back in time - in real time btw-" to a specific date/time and see the open windows you had and what not.

I distinctly remember seeing it somewhere (I think it was here), but I can't find what the app was called, despite all teh gooling.

Re: I made an open source Windows app to rewind and search everything on screen

#98
post #22

It would be cool to: 1) Make a Meta Smart Glasses take a photo every 2 seconds. 2) Send images to some server in the cloud. 3) Run OCR and object detection/labeling on these images. 4) Then present an app that allows searching (and chatting with) your past. I could then ask the LLM things like: 1) Where did I left my wallet? 2) Did I get my credit card back after paying the restaurant yesterday? (ADHD things, don't a…

Generally Black Mirror episodes are not intended to be aspirational.

I don't see it as "Black Mirror" but rather as a feature. I pretty much record everything about myself anyway (locally, selfhosted) - so this alone wouldn't add any other obstacles than storage.

a local model that can analyze the videostream/files and answer questions would be great.

Re: I made an open source Windows app to rewind and search everything on screen

#99

There was this app, I don't remember the name, that was similar I think for MacOS. It would record the entire timeline, and you could just "scroll back in time - in real time btw-" to a specific date/time and see the open windows you had and what not. I distinctly remember seeing it somewhere (I think it was here), but I can't find what the app was called, despite all teh gooling.

Probably rewind.ai

Re: I made an open source Windows app to rewind and search everything on screen

#100

There was this app, I don't remember the name, that was similar I think for MacOS. It would record the entire timeline, and you could just "scroll back in time - in real time btw-" to a specific date/time and see the open windows you had and what not. I distinctly remember seeing it somewhere (I think it was here), but I can't find what the app was called, despite all teh gooling.

> I made this app on Windows. The major inspiration from the early concept of Mac app Rewind and Black Mirror S1E3 "The Entire History of You"
Post reply on HN