Live data from Hacker News

Webgazer.js webcam eye tracking on the browser

webgazer.cs.brown.edu

31–40 of 56 posts

Re: Webgazer.js webcam eye tracking on the browser

#31
post #16

The listed use cases here struck me as odd, I can't imagine why I or anyone wanting to read a news article would allow the site access to my webcam. Nor do I think most users would turn on their cameras to help with any given sites analytics. So aside from games, what is the actual use case here ?

I would absolutely love to see something like this combined with a live video filter to make actual eye contact during video chat possible.

Facetime calls (probably only from an iphone 10+) do this now https://9to5mac.com/2019/07/03/facetime-eye-contact-correcti...

Re: Webgazer.js webcam eye tracking on the browser

#33
post #22

Can't wait until this makes its way to adtech. You can have sites that hold their "premium" content hostage until you allow camera access and proved (via eye tracking) that you looked at their ad.

I wonder. Obviously its technologically possible, but would average user accept it?

Re: Webgazer.js webcam eye tracking on the browser

#34
post #19

In the brown undergraduate computer vision course one of the homework’s (or final project; my memory is a little hazy) was to improve the tracking of webgazer. People were pretty successful from what I remember. As an undergrad I didn’t think much of it but as a grad student I would be slightly mortified if undergraduates were improving on my current research for homework.

That's not too surprising, tbh. Building the baseline solution or platform from the ground up is often the most difficult part, and by the end of such a project, you end up with a 100 ideas about how to make it better. But either due to time constraints, a "perfect is the enemy of done" philosophy, or simply the fact that you reach a natural crossroads and there are multiple valid ways forwards, you have to draw a line in the sand and release at some point. It's natural that there my be low-hanging fruit for some people to pick up and improve on for some projects, particularly if they have different end goals than the initial project had.

Re: Webgazer.js webcam eye tracking on the browser

#35
post #16

The listed use cases here struck me as odd, I can't imagine why I or anyone wanting to read a news article would allow the site access to my webcam. Nor do I think most users would turn on their cameras to help with any given sites analytics. So aside from games, what is the actual use case here ?

Well, if I were a company designing an information service, perhaps monetized by ads, then it could make sense to collect eyetracking data to see what people tend to look at, perhaps as part of an AB testing regime.

Then the choice comes between: do I want to bring people in to my expensive lab where I can get high-fidelity results, or do I want to potentially get a much larger sample for cheaper at the cost of lower fidelity.

Re: Webgazer.js webcam eye tracking on the browser

#37
post #16

The listed use cases here struck me as odd, I can't imagine why I or anyone wanting to read a news article would allow the site access to my webcam. Nor do I think most users would turn on their cameras to help with any given sites analytics. So aside from games, what is the actual use case here ?

I'm starting to develop RSI in my wrists and hands, and have been looking at eye tracking systems as a potential way to help reduce the amount of clicking that I need to do. I was thinking maybe I could put webgazer.js into a chrome extension and use it to navigate through pages for me, but I don't think it has a click mechanism. fwiw - I'm a huge vimium extension user as keyboarding is less of a strain than mouse mo…

Check out Talon Voice. It's way better than these solutions.

Re: Webgazer.js webcam eye tracking on the browser

#38
post #16

The listed use cases here struck me as odd, I can't imagine why I or anyone wanting to read a news article would allow the site access to my webcam. Nor do I think most users would turn on their cameras to help with any given sites analytics. So aside from games, what is the actual use case here ?

I'm starting to develop RSI in my wrists and hands, and have been looking at eye tracking systems as a potential way to help reduce the amount of clicking that I need to do. I was thinking maybe I could put webgazer.js into a chrome extension and use it to navigate through pages for me, but I don't think it has a click mechanism. fwiw - I'm a huge vimium extension user as keyboarding is less of a strain than mouse mo…

quite a few folks in the voice programing community supplement voice commands with eye tracking using dedicated hardware. Talon [1] is considered an excellent resource in that field and there are also people in the Caster/dragonfly[2] ecosystem using EyeXMouse [3] and wolfmanstout [4] also has some work worth checking out.

[1] https://talonvoice.com/

[2] https://github.com/dictation-toolbox/Caster

[2] https://github.com/Versatilus/EyeXMouse

[4] https://handsfreecoding.org/2014/11/16/getting-started-with-...

Re: Webgazer.js webcam eye tracking on the browser

#39
Had a blast at LauzHack '16 using this library to make a Chrome extension enabling "no-hands scrolling"[1]. Sadly, reading web articles while eating with both hands is still a dream. We managed to get okay-ish results on a MacBook Pro in perfect lighting from time to time, but nothing consistent. In variable lighting and on lower-end laptops we found it impossible.

I wonder if it would be possible with a better webcam and good, consistent lighting.

[1] https://github.com/jarlg/lookmanohands

Re: Webgazer.js webcam eye tracking on the browser

#40
post #14

I had an idea for an evil-eye game, in the style of Happy Tree Friends or so. That is: a lot of cute creatures around, and nothing happens (they may giggle, jump or blink occasionally) until you look at them. If you do...

That's a really cool use case for the library ! I think the calibration stage could be made easier with some "click as fast as you can on the randomly appearing circle on screen" gamification, and just assume that people look at what they click on by default. It could be some little character changing color at random and you need to click it at that point, to make sure the user keeps his eyes on it for a few seconds before clicking.
Post reply on HN