31–37 of 37 posts
That could be immensely helpful for people who cannot speak due to vocal chord problems. It could also be the ultimate, always-on remote control for everything around, with a near-zero error rate.
It could help not only people with vocal cord problems, but also essentially anyone who is paralyzed from the neck down.
> The two biggest hardware challenges are reducing the size and weight of the ultrasound probe and replacing ultrasound gel with a more practical coupling material, such as hydrogel. We think both are solvable, making it possible for the probe to eventually become a lightweight wearable or adhesive patch. Not sure I'd want to put an adhesive patch on my neck every morning so I can silently talk to an LLM in the cubic…
The idea is that you won’t need cubicles anymore. Your hands will always be free because you won’t need a keyboard or mouse. You’ll be able to control the digital world using only your tongue.
The future is bright: you’ll talk to your Jarvis while driving through the Norwegian fjords.
I'm having trouble imagining how one would use this. How do you speak without making sounds?
You move your mouth and tongue as if you are gonna make the sounds, just don't exhale the air. They have a demonstration video in the blog post. As somebody else have already pointed out, it's a great tool for interacting with always-on camera devices like smart assistants, makes it a bit less weird.
I'm very eager for subvocalization tech to take off - this, AlterEgo, etc. I have never liked talking aloud to Siri or similar, but I could see using "voice" as an interface for so much more if I could speak silently to my device.
The funny part is that the tongue itself could act as a cursor or perform gestures, which sets this approach apart from other silent-speech methods.
I'm having trouble imagining how one would use this. How do you speak without making sounds?
You move your mouth and tongue as if you are gonna make the sounds, just don't exhale the air. They have a demonstration video in the blog post. As somebody else have already pointed out, it's a great tool for interacting with always-on camera devices like smart assistants, makes it a bit less weird.
I remember reading about something like this tech in one of Asimov's Robot novels. Thought about trying to build something like this, but don't really have the skills. Awesome they did build this! I guess if they make it easy to train on your speech (just combine it with speech to text), it's a product waiting to happen!
Model already generalizes on out-of-distribution people, so you actually don't need to train a model for each person
I am researching in this field right now, MY ideas are if there is minimum amount of muscle movement will be the best .