Live data from Hacker News

Teachable Machine: Teach a machine using your camera, live in the browser

blog.google

51–60 of 95 posts

Re: Teachable Machine: Teach a machine using your camera, live in the browser

#52

Earlier quoted context omitted.

You mean a device such as the Leap Motion Controller? http://store-eur.leapmotion.com/products/leap-motion-control... They seem to offer a VR headset add-on these days, but I've only ever seen the 'basic' controller in action, which worked okay-ish.

Using the Leap Motion on an Oculus is magic. Much better than hand held controllers. When I use it I don't get sick from VR.

Any decent apps that support it? I have been thinking of buying a Leap Motion to experiment together with Rift

Re: Teachable Machine: Teach a machine using your camera, live in the browser

#53

Earlier quoted context omitted.

Claims like these make privacy-focused efforts less valuable, and I wish people wouldn't make them. What value is there in taking care to store biometric data only locally, in a separate chip inaccessible even to the OS, if people will simply claim it's equivalent to keeping a remote database of millions of faces?

People will be much less likely to make those claims if you clearly state where the data is being stored. This article + their project page doesn't mention anything about privacy. I don't know anything about Squeezenet, but it makes a lot of calls to storage.googleapis.com. I wouldn't be surprised if it's making some PUT requests. https://github.com/googlecreativelab/teachable-machine/blob/...

People need to ask the question before making assumptions. In the case of Apple, they said it directly in the presentation of FaceID as well as TouchID IIRC. Yet people made these claims anyway. For this project, they also state it clearly on the page:

> Are my images being stored on Google servers?

> No. All the training is happening locally on your device.

Re: Teachable Machine: Teach a machine using your camera, live in the browser

#54
deeplearn.js author here...

We do not send any webcam / audio data back to a server, all of the computation is totally client side. The storage API requests are just downloading weights of a pretrained model.

We're thinking about releasing a blog post explaining the technical details of this project, would people be interested?

Re: Teachable Machine: Teach a machine using your camera, live in the browser

#55

deeplearn.js author here... We do not send any webcam / audio data back to a server, all of the computation is totally client side. The storage API requests are just downloading weights of a pretrained model. We're thinking about releasing a blog post explaining the technical details of this project, would people be interested?

Yes please! :)

And some quick questions:

What network topology do you use, and on what model is it based (e.g. "inception")?

What kind of data have you used to pretrain the model?

Re: Teachable Machine: Teach a machine using your camera, live in the browser

#57

Am I the only paranoid one who thinks this is just Google's way of capturing millions of faces in their database? Or did Apple beat them to it?

Don't need to, they've got Youtube or so. People has been providing free data set to Google for years anyway.

Re: Teachable Machine: Teach a machine using your camera, live in the browser

#58
post #53

Earlier quoted context omitted.

People will be much less likely to make those claims if you clearly state where the data is being stored. This article + their project page doesn't mention anything about privacy. I don't know anything about Squeezenet, but it makes a lot of calls to storage.googleapis.com. I wouldn't be surprised if it's making some PUT requests. https://github.com/googlecreativelab/teachable-machine/blob/...

People need to ask the question before making assumptions. In the case of Apple, they said it directly in the presentation of FaceID as well as TouchID IIRC. Yet people made these claims anyway. For this project, they also state it clearly on the page: > Are my images being stored on Google servers? > No. All the training is happening locally on your device.

Where is it clearly stating that? I couldn't find anything in the linked article + the github repo + teachablemachine.withgoogle.com

But I do agree people need to ask the question before making assumptions. Sadly, the two popular mindsets is either to not think about privacy at all, or believe that everything is infringing on your privacy.

Re: Teachable Machine: Teach a machine using your camera, live in the browser

#59
post #55

deeplearn.js author here... We do not send any webcam / audio data back to a server, all of the computation is totally client side. The storage API requests are just downloading weights of a pretrained model. We're thinking about releasing a blog post explaining the technical details of this project, would people be interested?

Yes please! :) And some quick questions: What network topology do you use, and on what model is it based (e.g. "inception")? What kind of data have you used to pretrain the model?

We're using SqueezeNet (https://github.com/DeepScale/SqueezeNet), which is similar to Inception (trained on the same ImageNet dataset) but is much smaller - 5MB instead of inception's 100MB - and inference is much much quicker.

The application takes webcam frames and infers through SqueezeNet, producing a 1000D logits vector for each frame. These can be thought of as unnormalized probabilities for each of ImageNet's 1000 classes.

During the collection phase, we collect these vectors for each class in browser memory, and during inference we pass the frame through SqueezeNet and do k-nearest neighbors to find the class with the most similar logits vector. KNN is quick because we vectorize it as one large matrix multiplication.

I'll go deeper in a blog post soon :)

Re: Teachable Machine: Teach a machine using your camera, live in the browser

#60

Am I the only paranoid one who thinks this is just Google's way of capturing millions of faces in their database? Or did Apple beat them to it?

The faces are unlabeled, and I'm not sure what that data would be good for. If Google really wanted face data, they could look at: - Gmail / Google Plus / Google Apps profile pictures - Google Street View - Google Hangouts - implementing a primitive Face ID or Snapchat-style camera on Google Android - the large mass of face pictures that they index with Google Images

Google Photos seems like the absolute best bet there, they're "organizing" them there by default.
Post reply on HN