Interesting. This seems similar to (though using different methods/techniques) what q.ai (that was sold to Apple for $2b) is developing.
See this hn thread about it: https://news.ycombinator.com/item?id=46816228
Silent speech with ultrasound
11–20 of 37 posts
Re: Silent speech with ultrasound
#12Sony presented a simpler solution to this at CHI https://dl.acm.org/doi/10.1145/3772318.3791397 - check video in that. Also it seems every Cornell student is working on this. Just search on YouTube Cornell silent speech
Re: Silent speech with ultrasound
#13[flagged]
Re: Silent speech with ultrasound
#14I had thought of this, so nice to see it done!
Re: Silent speech with ultrasound
#15Straight out of Life Artificial...
Re: Silent speech with ultrasound
#16I find it annoying to try and talk completely silently. I'm always whispering at least a bit. I can't imagine doing this for the entirety of a call.
Re: Silent speech with ultrasound
#17The use of ultrasound is interesting! The first step (identifying speech) is called subvocalization recognition, and early research (Chuck Jorgensen, et. al (2023) from NASA) use EMG[1].
[1]: https://scispace.com/pdf/sub-auditory-speech-recognition-bas...
Re: Silent speech with ultrasound
#18I'm very eager for subvocalization tech to take off - this, AlterEgo, etc.
I have never liked talking aloud to Siri or similar, but I could see using "voice" as an interface for so much more if I could speak silently to my device.
Re: Silent speech with ultrasound
#19Really impressive. Seems like this could help people with health problems like ALS or Parkinson's, if you can discern clear intent from their tongue muscles. Or just help people who are intubated in the hospital.
Re: Silent speech with ultrasound
#20Very cool! While this is a different type of inverse problem, it reminds me of a radiolab story [0] about a device to help blind people “see” using electrical impulses on a metal strip under the tongue.