Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OptiKey – Full computer control and speech with your eyes

optikey.org

Post reply on HN
Print view View original

41–50 of 91 posts

Re: OptiKey – Full computer control and speech with your eyes

#41

Post by olympus »

samstave wrote: post #38

Here is an idea: Tell me if this is stupid: Assume you have a bunch of HUDs/AACs/Glasses/Whatever that are using this tracking tech. Assume that they are ONLY looking at the real world, not some online data/webpage etc... There is a camera that either is fwd looking or also 360 looking. Use the tech to eye track exactly everything that MANY people are looking at to train an AI as to what items in the real-world are i…

I don't think this is stupid, but probably won't happen any time soon. A project to correlate what humans look at to objects in the real world is probably possible, but would be a significant effort to get it to work reliably and accurately. Scaling it to a large population and processing the data to the point of providing useful insight about how we behave and look at things would be another hurdle.

Basically this probably won't happen until Google (or Facebook, or Apple, etc) decides that knowing what people look at is worth the effort/cost.

Re: OptiKey – Full computer control and speech with your eyes

#42

Post by JoeAltmaier »

olympus wrote: post #41
samstave wrote: post #38

Here is an idea: Tell me if this is stupid: Assume you have a bunch of HUDs/AACs/Glasses/Whatever that are using this tracking tech. Assume that they are ONLY looking at the real world, not some online data/webpage etc... There is a camera that either is fwd looking or also 360 looking. Use the tech to eye track exactly everything that MANY people are looking at to train an AI as to what items in the real-world are i…

I don't think this is stupid, but probably won't happen any time soon. A project to correlate what humans look at to objects in the real world is probably possible, but would be a significant effort to get it to work reliably and accurately. Scaling it to a large population and processing the data to the point of providing useful insight about how we behave and look at things would be another hurdle. Basically this p…

I'd be happy if all those time-and-space-stamped photos uploaded to facebook could be stitched together to make a photoessay of my vacation. That way I wouldn't even have to take a camera with me; facebook could use Other People's Pictures that I just happened to be in proximity to.

Re: OptiKey – Full computer control and speech with your eyes

#43

Post by olympus »

rsmith05 wrote: post #35

As someone that suffers from RSI, I'd be interested in an Opti-mouse. Does this exist yet?

Tobii bundles some (Windows only) integration software with their EyeX. It allows you to click on whatever you are looking at with the press of an action button (left ctrl key for me), along with a few other features (eye tracking the alt-tab switcher is what I really like). It works okay, but eye tracking isn't quite as accurate as a mouse and you either need to make your icons big and widely spaced or you have to zoom in (with an action click) before selecting the icon precisely.

Re: OptiKey – Full computer control and speech with your eyes

#44

Post by neilmovva »

Great work. I wonder if the author had heard of the Eyewriter project [1]? Similar system, fully open source, but I'm not sure how active development is nowadays. It's been up since ~2011, though, so quite old by software standards (uses openFrameworks/openCV). Still, it worked impressively well when I built a derivative system.

The accessibility space needs as much open-source development as possible - most of the commercial tech, if you can find it, is locked down and outdated.

[1]: http://www.instructables.com/id/The-EyeWriter-20/

Re: OptiKey – Full computer control and speech with your eyes

#45

Post by hammock »

Shorel wrote: post #16
melling wrote: post #2

In the demo, he was quick and he didn't even seem to use much autocompletion. However, I wonder if using a different keyboard layout would be helpful. Dvorak a Colmak, for example, place the more frequently used letters on the home row so you'll spend more time with your eyes there. You can evaluate different layouts with a tool like this: http://patorjk.com/keyboard-layout-analyzer/

For visual search I would disregard keyboards entirely and go alphabetical: A b c d E f g h I j k l m n O p q r s t U v x y z.

Arranged in a clock face perhaps?

Re: OptiKey – Full computer control and speech with your eyes

#46

Post by vanderZwan »

olympus wrote: post #39
gragas wrote: post #33

This is amazing software, but will it work with me? My left eye is a glass eye and it has little to no movement.

I have a Tobii EyeX and it has the option to track a single eye. You would basically need to set it to track just your right eye, which is a piece of cake in the config (on Windows at least).

And if OptiKey doesn't support it yet, open an issue on github! :)

Re: OptiKey – Full computer control and speech with your eyes

#47

Post by kefka »

_-__--- wrote: post #40
exhilaration wrote: post #30

Could this be covered by existing patents? Tools like these for the disabled are a big business, and patent holders have shut down competition in the past: http://www.disabilityscoop.com/2012/06/14/dispute-ipad-app-p...

This is a good point - how do copyrights protect intellectual property from open source alternatives? I think that this is a really good thing to open-source, but the law can be tricky to navigate. Almost like you need a degree in it...

Well, good luck shoving this code back in the bottle (read: git archive).

It's out and 22 public forks already. Who knows how many git clones...

Re: OptiKey – Full computer control and speech with your eyes

#48

Post by dwiel »

rsmith05 wrote: post #35

As someone that suffers from RSI, I'd be interested in an Opti-mouse. Does this exist yet?

I use a trackIR and linux-track with good success. The only issue is you have to have a reflective dot (or 3) on your head, ideally on the bill of a hat. It is accurate enough that I have to use the trackpad maybe once a day. I don't think it would work well for drawing or anything like that though ...

Re: OptiKey – Full computer control and speech with your eyes

#49

Post by dwiel »

rsmith05 wrote: post #35

As someone that suffers from RSI, I'd be interested in an Opti-mouse. Does this exist yet?

I use a trackIR and linux-track with good success. The only issue is you have to have a reflective dot (or 3) on your head, ideally on the bill of a hat. It is accurate enough that I have to use the trackpad maybe once a day. I don't think it would work well for drawing or anything like that though ...

Re: OptiKey – Full computer control and speech with your eyes

#50

Post by dwiel »

I have been using voicecode.io (with dragon naturally speaking) and IR head tracking so that I don't have to use my hands for anything now with pretty good success. The head tracking mouse has a much smaller learning curve, but programming by voice has been rewarding as well.
Post reply on HN