Hands-Free Coding: How I develop software using dictation and eye-tracking
121–130 of 141 posts
Re: Hands-Free Coding: How I develop software using dictation and eye-tracking
#122Since I don't have any problems writing, I would be interested if there was some sort of system that was multi-modal in its working, or that maybe I could turn on dictation based coding with some specific rules for what I am doing at the moment.
For example if I am reading some code and I see
const updatedSortFields = Object.values(options).map(({ value: id, label }) => ({ id, label }));
If I could then say "format line 130 multilines" and it would turn it into something nicely indented over multiple lines.
Re: Hands-Free Coding: How I develop software using dictation and eye-tracking
#123If you're using an eye-tracking mouse, you might enjoy Precision Gaze Mouse. Its a much faster way to click because you can skip the zoom in step. It uses eye tracking for large movements, and head tracking for small precision movements. I'm also a developer with an injury and I made it help myself, but several other people are using it now too.
Re: Hands-Free Coding: How I develop software using dictation and eye-tracking
#124Earlier quoted context omitted.
On my keyboard - which is.. I don't want to say 'full size', because maybe it's '80%' or whatever, but it's a regular external keyboard with numpad - f & j are centre to centre 60mm apart. If I outstretch my arms, straight, my index fingers are pretty much in line with my shoulders. So no, when I use my regular unsplit keyboard my hands/wrists are not straight, because my shoulders are not 60mm apart..? Am I missing…
I believe GP was talking about elbow-hand being completely straight. That would make sense if their elbows are on arm rests or some such thing. It does sound interesting. I did type this comment trying it, and it was pretty comfortable, with the exception of my right wrist. That being said, I've got kind of weird seating set up.
Oh.. then I'm not sure what we're doing differently, or what the difference is in hardware, but my arms/hands are straight from elbow to fingertip when I rest on 'home row' 'adsf'/'jkl;' - if I change to 'wefv' it's a significant contortion, if that's what it looks/feels like for some people using 'asdf' then I understand the problem and am not surprised they don't put up with it!
If I stick my elbow way out I can make 'wefv' as natural to me as 'asdf'. So I suppose either my elbows are more tucked in, or my keyboard's wider ('dfgh' for example contorts the other way, and analgously to 'wefv', 'rthn', or better but less analogously 'erth', is more comfortable there).
Re: Hands-Free Coding: How I develop software using dictation and eye-tracking
#125I have had an issue with dictation software... I want a dictation software to read me what it typed on screen. Right now the software expects you to check what it wrote and you have to necessarily keep looking at the screen. Call me lazy but I wish for a method where I could lay back, speak a sentence, wait for transcribing, listen to what was written and ahead I go.
when I was writing my last novel draft using nuance dragon 15, it had the 'read that' command which would read the last phrase I inputted, but that wasnt enough since I had a wireless headset that let me wander the house talking to the computer, but still needed to see the screen to know if it got the dictation correctly. I ended up fishing out a cheap $120 portable walmart windows laptop 2 in 1 and VNCing it into th…
my point exactly. all dictation softwares expect you to keep looking at the screen. your "I had a wireless headset that let me wander the house talking to the computer" is what i want a dictation software to do. sadly like you i am left unsatisfied
Re: Hands-Free Coding: How I develop software using dictation and eye-tracking
#126I have suffered with thoracic outlet syndrome for almost 2 years. Countless physical therapy and deep tissue massages helped alleviate the pain but nothing seems to solve the root cause. I am 26 and the thought of not being able to use my hands to do something I have frightened the hell out of me. That's when I stumbled upon John Sarno and his book "The mindbody prescription". I thought it's pseudoscience and I read…
I recommend having a read at this: https://mskneurology.com/how-truly-treat-thoracic-outlet-syn...
Re: Hands-Free Coding: How I develop software using dictation and eye-tracking
#127Earlier quoted context omitted.
I believe GP was talking about elbow-hand being completely straight. That would make sense if their elbows are on arm rests or some such thing. It does sound interesting. I did type this comment trying it, and it was pretty comfortable, with the exception of my right wrist. That being said, I've got kind of weird seating set up.
Oh.. then I'm not sure what we're doing differently, or what the difference is in hardware, but my arms/hands are straight from elbow to fingertip when I rest on 'home row' 'adsf'/'jkl;' - if I change to 'wefv' it's a significant contortion, if that's what it looks/feels like for some people using 'asdf' then I understand the problem and am not surprised they don't put up with it! If I stick my elbow way out I can ma…
Yes, your last paragraph is my natural position, with the elbows farther out. 'wefv' exaggerates the effect to demonstrate; the real position is about halfway between 'wefv' and 'sdfv'.
Re: Hands-Free Coding: How I develop software using dictation and eye-tracking
#128Earlier quoted context omitted.
I think parent is talking about the Tobii. I was also very very excited about it (I can’t find a mouse or trackball that won’t give me hand or shoulder or wrist pain) but then I saw it only works on windows... and nothing else. No Linux support. So that’s a no go. If someone knows of such a device for Linux, I’d love to hear about it!
Let me be more specific. The Tobii 4c, PCEye Mini, and Tobii 5* work approximately the same on Linux, Mac, and Windows with Talon out of the box. * The Tobii 5 does work, but is a work in progress and has some caveats until I do more work on it.
Would you mind elaborating on this? I'm ready to buy a Tobii but would like to know what the model 5 caveats are and how long you think it'll be WIP. And if you think the improved specs on the 5 make it worth waiting for. Thanks!
Re: Hands-Free Coding: How I develop software using dictation and eye-tracking
#129Appreciate all the discussion! I touch on this in the article, but I should say: I'm an edge-case when it comes to CTS. Most cases resolve spontaneously. Part of it is that my nerve dislocates when I bend my elbow, and this mobility causes a bunch of additional friction / inflammation. This happens naturally to about 13% of the population, and mine is particularly pronounced. All this to say, if you ever do start to…
Ah, that sounds like what I have! Subluxation of the ulnar nerve is what they told me it was - I could feel the nerve popping over my medial epicondyle. We tried steroid shots to reduce inflammation, but it came back after about nine months. It got so bad that I couldn't fully extend my arm or bring it in past ~45 degrees from extended. The inflammation showed up on an MRI. I had surgery to relocate the nerve to the inside of my elbow and have largely recovered from it, though it does flare up every so often.
The scare got me very interested in accessibility and I've looked into using Talon with eye tracking and stenography via Plover to improve my ergonomics, but I've never fully committed to any of them, but I'd love to know what communities exist. A Kinesis Advantage and a vertical mouse seem to keep it at bay on all but the longest of work days.
Re: Hands-Free Coding: How I develop software using dictation and eye-tracking
#130Appreciate all the discussion! I touch on this in the article, but I should say: I'm an edge-case when it comes to CTS. Most cases resolve spontaneously. Part of it is that my nerve dislocates when I bend my elbow, and this mobility causes a bunch of additional friction / inflammation. This happens naturally to about 13% of the population, and mine is particularly pronounced. All this to say, if you ever do start to…
Does this sort of thing show up on an MRI? (nerve inflammation/mobility)
Mine did. I eventually suffered very limited mobility due to the pain until I got surgery to move the nerve out of the cubital tunnel.