Is there any work being done on speech to code in a deep learning area . I have severe RSI which prevents me from coding at all . I have tried to use speech recognition software such as vocola and windows speech engine . but it required me to speak in such a way that I always would hurt my throat . I have also injured my throat multiple times so I am searching for a solution that is more conversational then command driven . I have written over 10000 lines of command Fargo Cola and they're still too many edge cases which require me to continually speak in an Abrupt manner that causes strain on my throat .
Ask HN: Is there any work being done in speech-to-code with deep learning?
1–10 of 63 posts
Re: Ask HN: Is there any work being done in speech-to-code with deep learning?
#2I can’t help you with actually converting speech to code but it occurs to me this would be a benefit to everyone. Speaking the words that are represented by the code we write would require a much deeper understanding of what we are doing and why.
Food for thought for sure. Good luck.
Re: Ask HN: Is there any work being done in speech-to-code with deep learning?
#3While (likely) not using directly deep learning, I found the following talk [1] by Emily Shea on her code dictation setup (based on Talon Voice) both insightful and impressive.
EDIT: Actual demo with coding starts at 18.00: https://youtu.be/YKuRkGkf5HU?t=1076
Re: Ask HN: Is there any work being done in speech-to-code with deep learning?
#4I'd love to help! If anyone's working on this in this thread, lemme know :)
Re: Ask HN: Is there any work being done in speech-to-code with deep learning?
#5I came across Serenade (https://serenade.ai/) recently. It's still beta but I was very impressed. In the past I've used vocola, and a few other open-source options. Serenade felt much more natural and powerful. The founders are also super hands-on and genuinely seem to care about the problem.
Re: Ask HN: Is there any work being done in speech-to-code with deep learning?
#6I'm also curious about this.
The best project I've seen for voice coding is Talon Voice, but I doubt anything novel is being done with it and deep learning. I'd suggest trying it out if you haven't. They also have a pretty active slack channel, you might have some luck asking them if they know about anything on the horizon.
Re: Ask HN: Is there any work being done in speech-to-code with deep learning?
#7Have you tried VoiceCode? https://voicecode.io/
That in combination with switching to a Lisp (Clojure) almost made it feasible for me to code with RSI.
I just became a manager instead because I couldn’t work from home and talking like that in the office was a no-go for me.
If that’s your cup of tea you’d be surprised at how happy upper management is to have someone who’s actually good at technology be willing to engage with them.
Re: Ask HN: Is there any work being done in speech-to-code with deep learning?
#8Are you sure you have RSI and not TMS (tension myositis syndrome)? It's a condition that causes real physical symptoms (of which wrist pain is a common one) that are not due to pathological or structural abnormalities. Rather, the symptoms are caused by stress and repressed emotions.
Check out this success forum of people who have healed from all kinds of chronic pain symptoms by dealing with stress and changing their mindset:
https://www.tmswiki.org/forum/forums/success-stories-subforu...
Re: Ask HN: Is there any work being done in speech-to-code with deep learning?
#9Have you tried VoiceCode? https://voicecode.io/ That in combination with switching to a Lisp (Clojure) almost made it feasible for me to code with RSI. I just became a manager instead because I couldn’t work from home and talking like that in the office was a no-go for me. If that’s your cup of tea you’d be surprised at how happy upper management is to have someone who’s actually good at technology be willing to enga…
voicecode has been defunct for years now
Re: Ask HN: Is there any work being done in speech-to-code with deep learning?
#10I'm also curious about this. The best project I've seen for voice coding is Talon Voice, but I doubt anything novel is being done with it and deep learning. I'd suggest trying it out if you haven't. They also have a pretty active slack channel, you might have some luck asking them if they know about anything on the horizon. https://talonvoice.com/
Talon uses deep learning for the speech part, but not so much (yet) the code part. However, the continuous command recognition it uses can cause less strain than individual abrupt commands. You can string a dozen command words together more like a sentence instead of repeatedly saying a command then abruptly stopping and waiting to say the next command (which is how many older systems worked).
I'm definitely open to incorporating deep learning directly. I've already signed up for the GPT3 API waiting list and I have some ideas on how to use it, and I generally have some ideas on how I might otherwise approach more natural feeling voice programming down the line.