Live data from Hacker News

A Deep Learning USB Stick

movidius.com

11–20 of 57 posts

Re: A Deep Learning USB Stick

#11

How powerful is it?

Not very... At 15 inferences per second in fp16 for Googlenet, I'd guesstimate 50-60 GHFLOPs. That would give it very roughly 2x perf/W over TitanX.

Given that figure and the Titan X at 250W TDP would put it somewhere around 1/125th of the performance. Which is probably more than good enough for inference given a network but you still need something beefy for the training.

It's still pretty interesting, though, since only need to do the training once.

Re: A Deep Learning USB Stick

#12
post #2

Betting on local instead of cloud is always an interesting gamble. Pros: - Security - Control Cons: - Resource limitations - (...)

Local is also useful in situations with limited or no internet access. Say you're trying to do deep recognition on a live video feed: many places this would be useful simply do not have the bandwidth available to stream video.

Also useful in latency-sensitive applications, such as the drone flight demo they use in their video.

Re: A Deep Learning USB Stick

#14
Thought TensorFlow already did this, how is this USB different?

Seems like the more logical approach would be to have a widget app developers could easily deploy embedded TensorFlow builds in Android & iPhones. Has anyone looked into doing this or found someone already doing this?

Re: A Deep Learning USB Stick

#16
post #14

Thought TensorFlow already did this, how is this USB different? Seems like the more logical approach would be to have a widget app developers could easily deploy embedded TensorFlow builds in Android & iPhones. Has anyone looked into doing this or found someone already doing this?

My understanding is that it allows you to take your tensorflow model, transfer it to the USB and plug it in (interface with) your 3rd party hardware (other than your phone) which isn't connected to the cloud.

Re: A Deep Learning USB Stick

#17

How about this kind of extra processor comes in a mobile phone, which improves regular camera vision, all health sensors, better everything that we can do with mobile phones..

This is not at all the case. Deep learning can do some great things, but its not magic.

Re: A Deep Learning USB Stick

#19

How about this kind of extra processor comes in a mobile phone, which improves regular camera vision, all health sensors, better everything that we can do with mobile phones..

You don't necessarily need it, Qualcomm have already demonstrated (live) image classification on tablets and it runs on a Snapdragon CPU:

https://www.youtube.com/watch?v=jkDSACXkErY

Post reply on HN