Show HN: ASL Classifier Built with CoreML and Roboflow

#1

Post by narner » Mon, Feb 01, 2021, 7:56 PM UTC

Show HN: ASL Classifier Built with CoreML and Roboflow
github.com

Re: Show HN: ASL Classifier Built with CoreML and Roboflow

#2

Post by senkora » Mon, Feb 01, 2021, 9:18 PM UTC

Neat! I would qualify that this is an ASL fingerspelling classifier, rather than a general classifier for the ASL language.

Re: Show HN: ASL Classifier Built with CoreML and Roboflow

#3

Post by rocauc » Mon, Feb 01, 2021, 9:53 PM UTC

Did you find the model to perform better / worse when the background varied? I see it's all wood table examples in the gifs.

Re: Show HN: ASL Classifier Built with CoreML and Roboflow

#4

Post by yeldarb » Mon, Feb 01, 2021, 9:58 PM UTC

Is the app available on the App Store?

Re: Show HN: ASL Classifier Built with CoreML and Roboflow

#5

Post by j-sizz » Mon, Feb 01, 2021, 9:58 PM UTC

pretty awesome - I wonder if the algo could be used to teach people how to sign the alphabet - new twist on machine "learning"

Re: Show HN: ASL Classifier Built with CoreML and Roboflow

#6

Post by narner » Mon, Feb 01, 2021, 10:03 PM UTC

j-sizz wrote: post #5

pretty awesome - I wonder if the algo could be used to teach people how to sign the alphabet - new twist on machine "learning"

You could probably do that!

Re: Show HN: ASL Classifier Built with CoreML and Roboflow

#7

Post by narner » Mon, Feb 01, 2021, 10:05 PM UTC

rocauc wrote: post #3

Did you find the model to perform better / worse when the background varied? I see it's all wood table examples in the gifs.

Yeah; I found that if there was a lot of other objects in view (laptop/phone/notebook/pens/etc) then it had a hard time (I'm not great at signing anyways, ha

It may have performed better if I had done some image segmentation processing before running inference, then it may have performed even better

Re: Show HN: ASL Classifier Built with CoreML and Roboflow

#8

Post by narner » Mon, Feb 01, 2021, 10:08 PM UTC

yeldarb wrote: post #4

Is the app available on the App Store?

Not at the moment! Just an open-source demo for now; but I think this could be a very cool app for whenever the Apple glasses get released...

Re: Show HN: ASL Classifier Built with CoreML and Roboflow

#9

Post by rememberlenny » Mon, Feb 01, 2021, 10:30 PM UTC

Very cool project.

I love these applications of CV for accessibility for the blind. This is exactly what technology is made for.

Re: Show HN: ASL Classifier Built with CoreML and Roboflow

#10

Post by narner » Mon, Feb 01, 2021, 10:37 PM UTC

rememberlenny wrote: post #9

Very cool project. I love these applications of CV for accessibility for the blind. This is exactly what technology is made for.

Thanks Lenny! And yes, agreed. You should check out Oz Ramos' work: https://handsfree.js.org/