A Deep Learning USB Stick
movidius.com
A Deep Learning USB Stick
1–10 of 57 posts
Re: A Deep Learning USB Stick
#2Pros:
- Security
- Control
Cons:
- Resource limitations
- (...)
Re: A Deep Learning USB Stick
#3Acceleration is needed for training -- not running the models themselves. A quick glimpse of the power used (1 watt) lets you know exactly how much "acceleration" is going on in here. This is meant for tiny devices.
EDIT: My point is that this is a small-run dev board for a chip for some future $19 nannycam. It's not an "accelerator" you install on your PC to put your graphics card to shame running TensorFlow.
EDIT #2: This is another one of those HN threads that's overrun by enthusiasts. Jamming a chip onto a stick is simply how they sell embedded crap now.
Here's a crypto chip that'll really get you guys going: http://www.atmel.com/tools/AT88CK590.aspx
Re: A Deep Learning USB Stick
#4Re: A Deep Learning USB Stick
#5Betting on local instead of cloud is always an interesting gamble. Pros: - Security - Control Cons: - Resource limitations - (...)
Re: A Deep Learning USB Stick
#6This is a dev board, not a consumer product. And (contrary to the title) the press release explicitly says that it is not intended for "deep learning." Acceleration is needed for training -- not running the models themselves. A quick glimpse of the power used (1 watt) lets you know exactly how much "acceleration" is going on in here. This is meant for tiny devices. EDIT: My point is that this is a small-run dev board…
(For example, Google's voice recognition on Android can run when offline.)
Re: A Deep Learning USB Stick
#7Betting on local instead of cloud is always an interesting gamble. Pros: - Security - Control Cons: - Resource limitations - (...)
Re: A Deep Learning USB Stick
#8How powerful is it?
At 15 inferences per second in fp16 for Googlenet, I'd guesstimate 50-60 GHFLOPs. That would give it very roughly 2x perf/W over TitanX.
Re: A Deep Learning USB Stick
#9Re: A Deep Learning USB Stick
#10This is a dev board, not a consumer product. And (contrary to the title) the press release explicitly says that it is not intended for "deep learning." Acceleration is needed for training -- not running the models themselves. A quick glimpse of the power used (1 watt) lets you know exactly how much "acceleration" is going on in here. This is meant for tiny devices. EDIT: My point is that this is a small-run dev board…
This isn't true. Running neural networks (including CNNs) can be computationally and power intensive, and lends itself to the vector operations of GPUs, FPGAs, and ASICs. Putting the computations on devoted hardware could enable embedded applications that simply aren't possible otherwise.
Here's a whitepaper by Microsoft about using FPGA's to speed up CNNs: http://research.microsoft.com/apps/pubs/?id=240715
Article by Google explaining the importance of optimizing neural networks to run on mobile phones: http://googleresearch.blogspot.com/2015/07/how-google-transl...