Live data from Hacker News

On Voice Coding

dusty.phillips.codes

101–110 of 186 posts

Re: On Voice Coding

#101
Greetings Everyone, I help maintain the Caster project. The key difference from other solutions out there as we seek to support a completely open source voice coding stack. Open source is only way to go long term if you're going to being using a tool for most of your life. Fortunately for some it acts as a bridge until their RSI symptoms becomes manageable or goes into remission.

We are working towards cross-platform support Linux and Mac as well as adding support for Kaldi. Dragonfly is already cross-platform so just a few windows specific functions to be ported yet in Caster.

Kaldi via daanzu's kaldi active grammar. https://github.com/daanzu/kaldi-active-grammar

Talon may be free but is closed sourced.

Re: On Voice Coding

#102
post #20

I was curious what this might look like and found a couple videos on YouTube https://www.youtube.com/watch?v=fBhBqlQj00Q https://www.youtube.com/watch?v=hGPNs5C1Lp0

Here is a very early(2007) and unintentionally humorous attempt to script in Perl with voice recognition. https://www.youtube.com/watch?v=MzJ0CytAsec

I know it’s funny, but I hate the prevalence of this video so much, because people reference it as a reason voice programming doesn’t work, and I think it discourages people who may have otherwise had success with voice programming. You should consider linking to the middle of Emily Shea’s PerlCon video where she first plays this video then shows that it’s actually possible to dictate the same code effectively.

Re: On Voice Coding

#103
You can solve most carpal tunnel issues by massaging your forearms with a ball (or your knuckles).

I know it sounds crazy, but I solved a very intense bout of plantar fasciitis by massaging my calves. Took some time, but eventually the pain went away.

And when I had carpal tunnel, I did the same (although not learning heavily on my wrists helped a lot too).

You'll know if you're hitting the right spot because it'll hurt. A lot.

Re: On Voice Coding

#104
I've had some close calls with RSI and the most helpful things for me were:

1) Getting an ergo keyboard, in my case the Microsoft Sculpt 2) Remapping my keys to better match my workflow. Left and right parens are mapped to left and right shift - same for Ctrl-Braces and Alt for brackets. Mapping Caps lock to delete one word back was also a big one. Further, I have the number pad on the left to both make using the mouse require less movement in addition to remapping all the numpad keys to useful programming commands.

Re: On Voice Coding

#105

You can solve most carpal tunnel issues by massaging your forearms with a ball (or your knuckles). I know it sounds crazy, but I solved a very intense bout of plantar fasciitis by massaging my calves. Took some time, but eventually the pain went away. And when I had carpal tunnel, I did the same (although not learning heavily on my wrists helped a lot too). You'll know if you're hitting the right spot because it'll h…

* I am not a doctor, I have simply had a lot of experience with treating my own injuries and speaking to others in similar situations

This is partially good, but dangerously incomplete advice. The spectrum of RSI is far bigger than carpal tunnel, such as cubital tunnel, tennis elbow, tendinitis, and general neuropathy.

It can be caused by many things including various muscle groups in your shoulders, neck, posture, past injuries, nerve adhesion, flexibility, lack of strength.

Massage is a wonderful way to address nerve adhesion, flexibility, general tightness, but if you have a different issue it’s not really a panacea.

My philosophy is that you should do these things in strict order if you have symptoms:

1. reduce use (take breaks, get hobbies that take you away from the screen at home)

2. vary conditions of use (standing desk, ergonomics, using more than one kind of keyboard/mouse)

3. work out (yoga, swimming are highly recommended)

4. physical treatment (see a doctor, physical therapist, deep masseuse, etc)

5. alternative input (voice, eye tracking, etc)

If you do these in a different order or skip any of them you’re probably doing yourself a disservice.

Also. Don’t ice. Don’t take anti inflammatories or other pain meds while you continue to work. Blood flow is important to recovery - heat can soothe your pain similarly to as ice, but without causing further damage. And pain meds during working hours will make you ignore the damage that is causing your pain, allowing you to cause more damage. Bad.

I’ve also seen some negative studies on steroids and surgery, suggesting if you get those without changing your habits, your pain will recur within a year in 90% of cases. Do your own research, but you might as well change your habits first and only use surgery/drugs as an extreme last resort. (Unless you have the specific form of carpal tunnel that can be permanently fixed in a day with a minor surgery in exchange for lower grip strength?)

Re: On Voice Coding

#106

I've had some close calls with RSI and the most helpful things for me were: 1) Getting an ergo keyboard, in my case the Microsoft Sculpt 2) Remapping my keys to better match my workflow. Left and right parens are mapped to left and right shift - same for Ctrl-Braces and Alt for brackets. Mapping Caps lock to delete one word back was also a big one. Further, I have the number pad on the left to both make using the mou…

A minor tip for people fiddling with keyboards/layout. Be careful of regular pinky use for modifiers. Pinkies are weak and overuse can cause ulnar issues.

Corollary, if you have ulnar (pinky side) issues in your forearm, reduce pinky use.

Re: On Voice Coding

#107

Just want to point out a very accurate, yet completely inelegant solution to voice text input: Saying each letter and symbol individually. If you haven't tried it, you'll think I'm crazy, but it's amazing how fast computers can recognize individual letter names. You can just blurt them all out. I discovered this while entering a domain name by voice - just spell it out and poof, no problem, no corrections. Not sure I…

You’re exactly right, and this is something I put a lot of work into! I designed a new phonetic alphabet - the “Talon alphabet” - (which isn’t proprietary to Talon, people have used it with Caster as well). The trick is one-syllable words to represent each letter in the alphabet, but they have high phoneme diversity (sub-syllable unique sounds) and care was taken to ensure they can be differentiated even when saying…

How do you pronounce jury as one syllable word? I'm finding it difficult to imagine.

Re: On Voice Coding

#108

Just want to point out a very accurate, yet completely inelegant solution to voice text input: Saying each letter and symbol individually. If you haven't tried it, you'll think I'm crazy, but it's amazing how fast computers can recognize individual letter names. You can just blurt them all out. I discovered this while entering a domain name by voice - just spell it out and poof, no problem, no corrections. Not sure I…

You’re exactly right, and this is something I put a lot of work into! I designed a new phonetic alphabet - the “Talon alphabet” - (which isn’t proprietary to Talon, people have used it with Caster as well). The trick is one-syllable words to represent each letter in the alphabet, but they have high phoneme diversity (sub-syllable unique sounds) and care was taken to ensure they can be differentiated even when saying…

> air bat cap drum each fine gust harp sit jury crunch look made near odd pit quench red sun trap urge vest whale plex yank zip

How did you settle on jury? Notably it seems to be the only word that is more than one syllable.

Re: On Voice Coding

#109

This post starts out talking about expecting to spend around $1,000. There are at least two cross-platform projects where the biggest expense is a microphone instead of software. 1. My project, Talon. Windows/Linux/Mac support, and a first party local speech recognition engine that is pretty good and getting better. It’s free, but the engine is in a private beta (which is $15/mo to support development, optional if th…

I have intermittent RSI and I've been using Talon for 1.5 years for programming (web) with intellij and spacemacs. I reckon I'm as productive as using my hands if I use only voice. When my hands don't hurt and i mix talon with my hands I feel i can do more than I could do with my hands alone. Thanks, lunixbochs. Talon is great.

Can you give some examples of how you intermix the two? I'm curious in trying this out.

Re: On Voice Coding

#110
post #107

Earlier quoted context omitted.

You’re exactly right, and this is something I put a lot of work into! I designed a new phonetic alphabet - the “Talon alphabet” - (which isn’t proprietary to Talon, people have used it with Caster as well). The trick is one-syllable words to represent each letter in the alphabet, but they have high phoneme diversity (sub-syllable unique sounds) and care was taken to ensure they can be differentiated even when saying…

How do you pronounce jury as one syllable word? I'm finding it difficult to imagine.

You could pronounce it as jree.

Like tree with a j.

Post reply on HN