Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

I record myself on audio 24x7 and use an AI to process the information

roberdam.com

Post reply on HN
Print view View original

121–130 of 424 posts

Re: I record myself on audio 24x7 and use an AI to process the information

#121

Post by technofiend »

yellow_postit wrote: post #104
ninkendo wrote: post #11

Earlier quoted context omitted.

> Why is it so hard for me to find a single, precise location on my phone with an enumerated list of every command Siri or Google can work with? The likely answer here is that the engineers who work on such products would scoff at the idea that their work amounts to a simple list of commands. In their minds, they’re working on a natural language virtual assistant, whose understanding of user input is “intelligent”, a…

Not having lists means they can collect more training data. Build a database of all the attempted interactions. Cluster them by task. Sort by most used (or most monetizable) that the system can’t support today. Bam! You’ve got a rough futures capabilities roadmap. It’s more complicated of course but here you literally have a large customer base telling you what it wants, but your product can’t yet do, regularly.

Unfortunately there's also drift in behavior that comes from retraining. "OK Google, play NPR news headlines" get different results some days than others. Sometimes I get the latest hourly news, sometimes I get a robot voice reading headlines to me. Sometimes asking to dial someone calls them, sometimes it returns search results. Yadda.

Re: I record myself on audio 24x7 and use an AI to process the information

#122

Post by wincy »

Waterluvian wrote: post #2

> My biggest problem with “OK Google” is that I don’t know by heart what it can do interactively Maybe it’s just me but this feels unaddressed and that seems ridiculous. Why is it so hard for me to find a single, precise location on my phone with an enumerated list of every command Siri or Google can work with?

I stopped using Alexa after it almost burned my house down on thanksgiving. Apparently “bake at 400 degrees Fahrenheit for thirty minutes” somehow became “microwave for thirty minutes” even though it got all the words except bake! Who sets a temperature with their microwave?

Anyway we meant to bake something but instead absolutely roasted a metal pan and wire rack that merged into the glass somehow.

My wife thinks it’s kind of funny because the Disneyworld “Carousel of Progress” shows a very similar event happening due to voice controls, which they predicted in the 1960s!

Re: I record myself on audio 24x7 and use an AI to process the information

#123

Post by krzyk »

A related question, is there a ready solution to do constant recording using some Linux box (e.g. Raspberry PI)?

AFAIR I've seen someone recommended such software on HN but I can't find it right now, it was something for recording radio stations or similar.

I would like to get some kind of sound monitoring of my house when I'm away or sleeping and besides using arecord I couldn't find anything useful.

Re: I record myself on audio 24x7 and use an AI to process the information

#124

Post by [deleted] »

adamgordonbell wrote: post #28

An off the shelf solution for recording your whole life: I have a Sony recorder, ICD-UX570, and it has a setting where it turns on or off based on sound, and also adjusts the gain to best record. It takes a micro-SD card and has pretty solid battery. I think you could put it in a breast pocket and run it for several days on a single charge. Because it would just record when you are talking or making noises you could…

[deleted]

Re: I record myself on audio 24x7 and use an AI to process the information

#125

Post by frontman1988 »

The future will definitely have devices which record visually/verbally all your life. VR headsets are already able to record all your facial expressions. A google glasses like gear which records all your life is pretty much possible in the near future. The future influencers won't have to carry a phone/camera to create vlogs, they would just see wherever they want and the glasses will record not only the thing they are seeing but also their expressions. Privacy will probably not be such a big thing as now given most people with each generation are increasingly becoming more and more comfortable sharing their whole lives online.

Re: I record myself on audio 24x7 and use an AI to process the information

#126

Post by rolisz »

roberdam wrote: post #54
sorwin wrote: post #16

How would this work with other voices, like a coffee shop, would it hear those simultaneously, and interupt a command? Also, how do you handle using OpenAi whisper, seems like they do 30 second intervals - would that be an issue if your command is cut off mid word?

For now I try to give the commands when there is not much noise, but you can lower the gain of the microphone so that it only record my voice. The 30 second limit is not a Whisper model limit, but a limit some of the free online "try whisper" put.

I think he means that even whisper segments the audio into 30 second bits and does transcribing on them and then stiches everything together.

Re: I record myself on audio 24x7 and use an AI to process the information

#127

Post by rmac »

ogicar wrote: post #109

Very interesting idea. Would you be willing to share more info on the tech used in the process? >I bought a couple of Chinese microphones Which exact microphones? How long does their battery last? As well as other parts of the process.

Not the OP but I've been tinkering with the same concept (24/7 processing).

'm using vosk browser: https://github.com/ccoreilly/vosk-browser

To do speech to text locally and it works very well for English.

Re: I record myself on audio 24x7 and use an AI to process the information

#129

Post by habibur »

krzyk wrote: post #123

A related question, is there a ready solution to do constant recording using some Linux box (e.g. Raspberry PI)? AFAIR I've seen someone recommended such software on HN but I can't find it right now, it was something for recording radio stations or similar. I would like to get some kind of sound monitoring of my house when I'm away or sleeping and besides using arecord I couldn't find anything useful.

An old laptop will work better.

Raspberry pis don't have Audio in. You need USB microphone and drivers, which are hit or miss.

Re: I record myself on audio 24x7 and use an AI to process the information

#130

Post by dsalzman »

dsalzman wrote: post #128

I've been experimenting with this recently as well, but with an app on my apple watch. Looking for a method/model to split different speakers into different tracks to only look at audio from myself and certain people.

Someone is experimenting with diarization (speaker identification) + Whisper here https://github.com/openai/whisper/discussions/264
Post reply on HN