Live data from Hacker News

Teachable Machine: Teach a machine using your camera, live in the browser

blog.google

21–30 of 95 posts

Re: Teachable Machine: Teach a machine using your camera, live in the browser

#21
How long before I can teach my computer gestures that are mapped to real computer functions? For example, scroll up/down, switch apps, save document, cut/copy/paste, etc.

One could probably map each gesture to a regular USB device that acts as a second keyboard and mouse? The hard part is identifying enough unique gestures?

Re: Teachable Machine: Teach a machine using your camera, live in the browser

#22
post #20
post #7

Earlier quoted context omitted.

Surprisingly well! It's a really well put together demo & tutorial. I held a pen up next to me and held the green button. Then did the same with a mouse. It would flick between the two if I was holding nothing, so I held the orange button for a bit while holding nothing. Worked pretty much every time. Training is fast enough with a few hundred images per class that I didn't notice any delay.

What do you mean exactly by "held the green button"? I can't run the demo here (browser not capable enough, and no camera) and I'm getting really curious what this is about.

Watch the demo video in the link, it explains the green button

Re: Teachable Machine: Teach a machine using your camera, live in the browser

#23

Am I the only paranoid one who thinks this is just Google's way of capturing millions of faces in their database? Or did Apple beat them to it?

Facebook beat them to it... that's the whole reason for tagged images imo. Then they can relate identities with each other and with exif gps data to track their movements over time.

Re: Teachable Machine: Teach a machine using your camera, live in the browser

#24

Am I the only paranoid one who thinks this is just Google's way of capturing millions of faces in their database? Or did Apple beat them to it?

It's good to be paranoid about it but at the same time it's quite a cool thing to offer people.

Also I think a lot of the processing is done in the browser using deeplearning.js, so I don't know how much is sent back to Google.

Re: Teachable Machine: Teach a machine using your camera, live in the browser

#25
post #21

How long before I can teach my computer gestures that are mapped to real computer functions? For example, scroll up/down, switch apps, save document, cut/copy/paste, etc. One could probably map each gesture to a regular USB device that acts as a second keyboard and mouse? The hard part is identifying enough unique gestures?

You mean a device such as the Leap Motion Controller? http://store-eur.leapmotion.com/products/leap-motion-control... They seem to offer a VR headset add-on these days, but I've only ever seen the 'basic' controller in action, which worked okay-ish.

Re: Teachable Machine: Teach a machine using your camera, live in the browser

#26
post #8

Does anyone know what this uses under the hood? I loved the demo, but I would like a similarly easy way to get started locally with Python, for example. Is there an ML library that can easily start capturing images from the webcam so you can play around with training a model?

It says it in the video: https://deeplearnjs.org

Re: Teachable Machine: Teach a machine using your camera, live in the browser

#27
post #21

How long before I can teach my computer gestures that are mapped to real computer functions? For example, scroll up/down, switch apps, save document, cut/copy/paste, etc. One could probably map each gesture to a regular USB device that acts as a second keyboard and mouse? The hard part is identifying enough unique gestures?

You mean a device such as the Leap Motion Controller? http://store-eur.leapmotion.com/products/leap-motion-control... They seem to offer a VR headset add-on these days, but I've only ever seen the 'basic' controller in action, which worked okay-ish.

I think that’s infrared but the same idea. That never quite worked. Also, Leap didn’t continue to refine their hardware for consumers. They have next generation hardware that’s going directly into VR headsets, but you can’t buy it.

https://www.engadget.com/2014/08/28/leap-motion-s-next-senso...

Re: Teachable Machine: Teach a machine using your camera, live in the browser

#28

Am I the only paranoid one who thinks this is just Google's way of capturing millions of faces in their database? Or did Apple beat them to it?

I am pretty sure that Apple does not save your image data in any database. Apple is really trying to differentiate itself on privacy.

Also, I don't think that this sends any data to Google, since it trains the neural net in the browser. You could even verify this yourself by looking at the source code.

Re: Teachable Machine: Teach a machine using your camera, live in the browser

#29

Earlier quoted context omitted.

But won’t it be on just that FQDN alone? Google analytics and ads are served from a totally different domain. What’s the actual concern here?

So you are contending we are secure via DNS?

That's one of these arguments that may attack the parent in isolation, but makes absolutely no sense in the context of the thread they were replying to.

Because if you assume an attacker to have control over DNS, the security model of giving permission on a per-domain basis is broken anyway, and the initial concern with granting google this access is already subsumed in your general paranoia.

Re: Teachable Machine: Teach a machine using your camera, live in the browser

#30

be aware, at least in Chrome, once you give teachablemachine.withgoogle.com permission to use you camera, unless you revoke that permission is has permission to use your camera without further permission including from iframes. In other words every ad from and analytics from Google could start injecting camera access. I wish chrome would give the option to only give permission "this time" and I wish it didn't allow c…

But won’t it be on just that FQDN alone? Google analytics and ads are served from a totally different domain. What’s the actual concern here?

Google ads and analytics inject JavaScript which means they can insert iframes for any domain they want. If they injected https:// teachablemachine.withgoogle.com/spyonuserwithcamera" /> they'd be able to use your camera from the ad or analytics without asking for permission again.

Of course I'm not suggesting Google would actually do that but some other company might make seeamazingcamerameme.com to get users to turn on there camera for that domain and then after that make iframes for seeamazingcamerameme.com/spy

Post reply on HN