Live data from Hacker News

Rewind: The Search Engine for Your Life

rewind.ai

61–70 of 100 posts

Re: Rewind: The Search Engine for Your Life

#62
Interesting product. I will take a wait and see approach though because my trust of companies pinky promising not to upload my data, especially when dealing with such invasive data as camera and audio and screen recordings, has been wearing thin of late.

I've been recording my desktop on Mac, Windows and Linux, recording audio in my office, including transcription of the audio, and multiple camera capture for over a decade since early 2000's, and using a SenseCam-like device, on-and-off, for almost 20 years. My current setup of an NVidia Jetson does an admirable job of determining if one or more people are in the room, the activity they are engaged in, multiple camera angles, transcribing what is being said, music identification, desktop image capture and OCR of the images is very much kept locally and I can be assured nothing is leaking out without my explicit knowledge. I have a custom device on my desk that I built that can "pause the recording" or "forget the last 30 seconds" or "forget the last five minutes" for those events that probably shouldn't be captured, e.g. I'm picking my nose and carefully inspecting whatever was retrieved.

Re: Rewind: The Search Engine for Your Life

#63

Given that OpenAI Whisper is open source now, and pretty near SOTA, I think creating an audio only open-source version of this shouldn't be difficult. However, I don't know how to easily contextualise the audio - how would I search 'name of the movie I was discussing with Zeynep last week'?

Yes it does seem within reach. Even just the base-en whisper modal with 74M params performs remarkably well on transcription (the large model has 1550M params!).

Compare a base-en whisper transcription to a human transcription. This is the A Powerful Theory of Why the Far Right Is Thriving Across the Globe latest episode of the Ezra Klein Show, transcribed just now:

1. [whisper] https://modal-labs-whisper-pod-transcriber-fastapi-app.modal...

2. [human] https://www.nytimes.com/2022/11/01/opinion/ezra-klein-podcas...

(You can use the same app to transcribe other episodes on-demand and see the base-en model's quality)

Re: Rewind: The Search Engine for Your Life

#64
Congratulations on the launch! Looks fantastic! I have built a product https://gettrici.com that records your screen and stores the recordings locally as well. As a developer, watching a quick replay of my recording helps me recover my lost train of thought very very fast and saves me a ton of time. [ Show HN Post: https://news.ycombinator.com/item?id=29277671 ]

Its great that you have leveraged the power of Apple Silicon to analzye and index the recordings as well as keeping the size of the recordings very very small. Do you see this becoming available for Intel Chipsets a.k.a Windows and Linux anytime soon?

Re: Rewind: The Search Engine for Your Life

#70
post #65

The compression rate seems like a magic. Surprised nobody talks about that point... Signed up for the beta. Really curious about it.

I think they must be using similar AI / ML stuff to this recent work for audio https://arxiv.org/abs/2210.13438 but for video
Post reply on HN