Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

On Voice Coding

dusty.phillips.codes

Post reply on HN
Print view View original

151–160 of 186 posts

Re: On Voice Coding

#151

Post by cjbassi »

nshm wrote: post #142
cjbassi wrote: post #54

For those on Linux, I've been working on a Talon inspired voice coding program called Osprey that uses the Google Cloud speech to text API: https://github.com/osprey-voice/osprey . It's still very much a work in progress but it's already been working very well for me and I'm actually using it to type out this response right now.

Why would you work with google when there are much more accurate open source speech recognizers based on Kaldi? With that specific usecase it is very easy to beat Google on accuracy.

Actually I don't think I ended up testing kaldi because it seemed difficult to set up but I'll give it a try now that you mention it.

Re: On Voice Coding

#152

Post by nshm »

mwiethoff wrote: post #58
random3 wrote: post #28

I had my second surgery just a few months ago. I can type again, but each time I had to use my left hand for months. Initially, it feels like your brain doesn't function properly anymore (not mentioning the psychological effort you have to make in order to be focused on work when you feel your hands are falling apart). Keyboard speed is directly related to how fast you can move your hands to support your thought flow…

I’m one of the creators of Serenade—thanks for mentioning us! We totally agree about the need for higher-level layers of abstraction, and we’re working on some of the code navigation functionality you mentioned right now. If you have any other ideas or feedback, we’d love to chat more, I’m matt@serenade.ai.

Among all demos above Serenade seems the only product that does the right thing. Why the hell I should say aloud "colon" or "quote" where tool can put them automatically.

Re: On Voice Coding

#153

Post by jorgeer »

I had several onsets of RSI a few years back, and had to resort to voice coding as a last resort, after stretches, pauses and ergonomic everything did not do the job. It was pretty awful.

But then, after having seen doctors and neurologists, and finally a physical therapist, I came across my salvation: - Exercising my hands.

I very rarely see this mentioned for some reason. I exercised regularly, but only the bigger muscle groups, rarely grip strength and wrist strength. It felt counter-intuitive to exercise my already extremely painfully aching hands (when typing), but using grip weights and other methods to work out my hands and wrists, the pain went away quickly! If you are not diagnosed with carpal tunnel, and not already doing this, definitely try it, it saved my career.

Re: On Voice Coding

#154

Post by benterris »

jorgeer wrote: post #153

I had several onsets of RSI a few years back, and had to resort to voice coding as a last resort, after stretches, pauses and ergonomic everything did not do the job. It was pretty awful. But then, after having seen doctors and neurologists, and finally a physical therapist, I came across my salvation: - Exercising my hands. I very rarely see this mentioned for some reason. I exercised regularly, but only the bigger…

Could you please elaborate on the exercises you're finding helpful ? I have a mild RSI myself (outer part of the forearm, near the elbow) and have been trying some eccentric exercises for a few months now but I'm not seeing a big improvement.

Re: On Voice Coding

#155

Post by cjbassi »

lunixbochs wrote: post #149
nshm wrote: post #142

Earlier quoted context omitted.

Why would you work with google when there are much more accurate open source speech recognizers based on Kaldi? With that specific usecase it is very easy to beat Google on accuracy.

I think google as the primary engine results in stuff like this: https://github.com/osprey-voice/osprey-starter-pack/blob/mas... On the other hand it’s probably better at general (non command) English.

Yeah it uses a lot of machine learning and context based inference, which is great for dictating phrases but less so for commands.

Re: On Voice Coding

#156

Post by nshm »

cjbassi wrote: post #151
nshm wrote: post #142

Earlier quoted context omitted.

Why would you work with google when there are much more accurate open source speech recognizers based on Kaldi? With that specific usecase it is very easy to beat Google on accuracy.

Actually I don't think I ended up testing kaldi because it seemed difficult to set up but I'll give it a try now that you mention it.

Ok, if you want to start with Kaldi it is probably easier to check kaldi-active-grammar mention above or https://github.com/alphacep/vosk-api

Re: On Voice Coding

#157

Post by modeless »

jorgeer wrote: post #153

I had several onsets of RSI a few years back, and had to resort to voice coding as a last resort, after stretches, pauses and ergonomic everything did not do the job. It was pretty awful. But then, after having seen doctors and neurologists, and finally a physical therapist, I came across my salvation: - Exercising my hands. I very rarely see this mentioned for some reason. I exercised regularly, but only the bigger…

Rock climbing has worked for me. I had mild wrist pain in college and worried that it would get worse, but it went away soon after I started climbing.

Re: On Voice Coding

#158

Post by cjbassi »

nshm wrote: post #156
cjbassi wrote: post #151

Earlier quoted context omitted.

Actually I don't think I ended up testing kaldi because it seemed difficult to set up but I'll give it a try now that you mention it.

Ok, if you want to start with Kaldi it is probably easier to check kaldi-active-grammar mention above or https://github.com/alphacep/vosk-api

Awesome, thanks, I'll check this out and the other one too.

Re: On Voice Coding

#159

Post by dsteinman »

qixxiq wrote: post #23

It's still surprising to see Dragon Speech Recognition as the recommended (and only) choice here. Is anyone working on decent speech recognition for Mac/Linux or know good resources for that? The ideal output is a stream of what could have been said, as well as some alternatives, each with a confidence. Every alternative I've tried has not been as effective as the version of Dragon I used from 2011. I think the focus…

I have been working on getting Mozilla's DeepSpeech and some additional JS libraries up to a level where it can be used (among other things) as a voice keyboard.

https://github.com/jaxcore/deepspeech-plugin

It's not quite there yet, but I'm working on it.

It can type numbers and symbols reasonably well, I need to do some additional work like build a custom language model to be able to type letters and plug some other gaps in Mozilla's CommonVoice model.

Here's the number typing example: https://github.com/jaxcore/deepspeech-plugin/tree/master/exa...

Re: On Voice Coding

#160

Post by ajmarcic »

benterris wrote: post #154
jorgeer wrote: post #153

I had several onsets of RSI a few years back, and had to resort to voice coding as a last resort, after stretches, pauses and ergonomic everything did not do the job. It was pretty awful. But then, after having seen doctors and neurologists, and finally a physical therapist, I came across my salvation: - Exercising my hands. I very rarely see this mentioned for some reason. I exercised regularly, but only the bigger…

Could you please elaborate on the exercises you're finding helpful ? I have a mild RSI myself (outer part of the forearm, near the elbow) and have been trying some eccentric exercises for a few months now but I'm not seeing a big improvement.

I list the low-hanging fruit first:

Look up nerve flossing exercises on YouTube. Routinely doing these had the largest impact for me. You'll feel the ones that work on whatever nerve is inflamed.

Try to improve your posture. My general mantra is "lift your head as much as possible. Pull your shoulders back". It gets easier eventually. If your head lies forward from the spine you have a hunch. You may notice a small lump of muscle behind your neck. That's bad. There are exercises to try and strengthen the opposite muscles.

If you sleep on your arms try to stop as well. I recommend sleeping on your back. Fluffy couches and back rests sacrifice posture. Don't use a laptop in bed.

Sleep, eat nutrient-dense foods, and run or swim. Avoid alcohol. If you do pushups or bench press, make sure to exercise your upper back equally to avoid imbalance.

Post reply on HN