Live data from Hacker News

I record myself on audio 24x7 and use an AI to process the information

roberdam.com

131–140 of 424 posts

Re: I record myself on audio 24x7 and use an AI to process the information

#132

I've been experimenting with this recently as well, but with an app on my apple watch. Looking for a method/model to split different speakers into different tracks to only look at audio from myself and certain people.

Check out this model, I've had limited success with it. Best I've done so far is to just add the labels it gives to the overlapping segments whisper spits out, which means some sentences have multiple speakers, but that's mostly the case because of cross-talk. I'd say it gets it right ~80% of the time with the 5 speakers I've done it on across ~16 hours of audio.

https://huggingface.co/pyannote/speaker-diarization

Re: I record myself on audio 24x7 and use an AI to process the information

#133

I've been experimenting with this recently as well, but with an app on my apple watch. Looking for a method/model to split different speakers into different tracks to only look at audio from myself and certain people.

Speaker identification is the next step, you might want to read about Pyannote's Diarization:

https://lablab.ai/t/whisper-transcription-and-speaker-identi...

Re: I record myself on audio 24x7 and use an AI to process the information

#134
Excellent idea. You can later search through your logs in the future for reference. As it's all in text.

Prior solutions posted on the net, had this take photo / record audio 24/7 features, but then those were stuck there. What next? What would anyone do with these data?

But this Hi Jarvis styled recording of text on the go is a very useful feature.

Another step ahead.

Re: I record myself on audio 24x7 and use an AI to process the information

#135

The future will definitely have devices which record visually/verbally all your life. VR headsets are already able to record all your facial expressions. A google glasses like gear which records all your life is pretty much possible in the near future. The future influencers won't have to carry a phone/camera to create vlogs, they would just see wherever they want and the glasses will record not only the thing they a…

> Privacy will probably not be such a big thing as now given most people with each generation are increasingly becoming more and more comfortable sharing their whole lives online

That's not quite right. People are just unaware of the power of what they share and usually react quite negatively if their data is used against them and start shielding themselves from surveillance of the sort that might affect them.

So predicting "people won't care about privacy because they share their whole lives online more and more" is a bit disingenuous.

It's what the tech companies like Facebook want but it's far from the truth.

Re: I record myself on audio 24x7 and use an AI to process the information

#137
post #123

A related question, is there a ready solution to do constant recording using some Linux box (e.g. Raspberry PI)? AFAIR I've seen someone recommended such software on HN but I can't find it right now, it was something for recording radio stations or similar. I would like to get some kind of sound monitoring of my house when I'm away or sleeping and besides using arecord I couldn't find anything useful.

An old laptop will work better. Raspberry pis don't have Audio in. You need USB microphone and drivers, which are hit or miss.

I was playing with this idea of recording everything using a 1st gen AIY voice kit. The driver is a linux kernel builtin module. The recording quality is good if I'm in the same room. But I didn't find the recording that useful, so I stopped doing that.

Re: I record myself on audio 24x7 and use an AI to process the information

#138
This is known as life logging with adjacency to sousveillance and it’s a fascinating topic.

https://en.m.wikipedia.org/wiki/Lifelog https://en.wikipedia.org/wiki/Sousveillance

We in general don’t want to be watched by others, but a managed record of our own activities can be extremely valuable, and even more so if you find yourself wrongly accused. Further it can be used to shine a light on corrupt officials, one example of this is the nycplacards exposes on twitter.

Re: I record myself on audio 24x7 and use an AI to process the information

#139
post #132

I've been experimenting with this recently as well, but with an app on my apple watch. Looking for a method/model to split different speakers into different tracks to only look at audio from myself and certain people.

Check out this model, I've had limited success with it. Best I've done so far is to just add the labels it gives to the overlapping segments whisper spits out, which means some sentences have multiple speakers, but that's mostly the case because of cross-talk. I'd say it gets it right ~80% of the time with the 5 speakers I've done it on across ~16 hours of audio. https://huggingface.co/pyannote/speaker-diarization

I will!

Re: I record myself on audio 24x7 and use an AI to process the information

#140

Are you planning to combine it with other info? Your smartwatch already knows how long you've slept, getting that info directly to your database seems more efficient and less error prone. The same goes for the amount of money you've spend, if your bank allows you to export that info it'll save you a step. Your bank doesn't know what you've bought, only the total cost, time and shop, but if you scan and upload your re…

Diarization might be my next step,(recognizing the speaker on the recording).

Combining the information from multiple sources as you say will get you a complete view (location history and time of the recording will let you know if you where speaking with a college or your spouse for example)

Post reply on HN