Show HN: Try running deep learning inference on Raspberry Pi
1–10 of 12 posts
Re: Show HN: Try running deep learning inference on Raspberry Pi
#2Blog article about this release: https://blog.idein.jp/post/181016515935/alphareleaseen
Re: Show HN: Try running deep learning inference on Raspberry Pi
#3Blog article about this release: https://blog.idein.jp/post/181016515935/alphareleaseen
Why would I use this rather than Snips? Edge computing is great, but in a closed source, hard to audit form it will be a tough sell to get 3rd party developers onboard.
Re: Show HN: Try running deep learning inference on Raspberry Pi
#4Since this is about computing at the edge, I was wondering if anyone had an opinion on the intel neural compute stick 2?
I got one recently and I am not convinced, but I suppose someone on HN might have legitimate use cases.
Re: Show HN: Try running deep learning inference on Raspberry Pi
#5We don't need more proprietary machine learning devices in our homes. I'd appreciate this so much more, if it was open source, so I can reshape it to whatever use case I have.
There are plenty of viable business models, that give you your well earned money and us the option to customize and understand our devices.
Re: Show HN: Try running deep learning inference on Raspberry Pi
#6We don't need more proprietary machine learning devices in our homes. I'd appreciate this so much more, if it was open source, so I can reshape it to whatever use case I have. There are plenty of viable business models, that give you your well earned money and us the option to customize and understand our devices.
> We don't need more proprietary machine learning devices in our homes. I'd appreciate this so much more, if it was open source
It doesn't seem to do anything special? You can probably run your favorite machine learning framework on the Raspberry Pi, and it will work - albeit using the ARM cores and NEON only. Now, machine learning and inference _using the Raspberry Pi's GPU part_ (which is broadly documented, unlike most GPU hardware) would be a gamechanger, if only for educational scenarios.
Re: Show HN: Try running deep learning inference on Raspberry Pi
#7We don't need more proprietary machine learning devices in our homes. I'd appreciate this so much more, if it was open source, so I can reshape it to whatever use case I have. There are plenty of viable business models, that give you your well earned money and us the option to customize and understand our devices.
I agree, so I looked at running image detection offline on a raspberry pi and wrote a post about it. It can't do anywhere near real time object detection on the larger YOLO models, but real time detection is often unnecessary. Also there are smaller models (e.g. yolo-mini) that can likely give you an acceptable frame rate.
https://medium.com/ml-everything/offline-object-detection-an...
Re: Show HN: Try running deep learning inference on Raspberry Pi
#8You can run TensorFlow Lite on a Pi with no problems at all. You can even train and run basic gesture recognition with full TensorFlow on a Pi.
Source: wrote a tutorial doing this for Arm (https://github.com/ARM-software/ML-examples/blob/master/mult...)
Re: Show HN: Try running deep learning inference on Raspberry Pi
#9Since this is about computing at the edge, I was wondering if anyone had an opinion on the intel neural compute stick 2? I got one recently and I am not convinced, but I suppose someone on HN might have legitimate use cases.
I think the NCS2 has potential.. it's still early though. One thing on their roadmap is to support ARM, which I view as a must-have for low powered edge applications. Right now it only works with OpenVINO and certain x86 systems. So I view the real use cases coming when it can be used in settings with limited power (and limited or variable network connectivity).
Re: Show HN: Try running deep learning inference on Raspberry Pi
#10We don't need more proprietary machine learning devices in our homes. I'd appreciate this so much more, if it was open source, so I can reshape it to whatever use case I have. There are plenty of viable business models, that give you your well earned money and us the option to customize and understand our devices.
> We don't need more proprietary machine learning devices in our homes. I'd appreciate this so much more, if it was open source It doesn't seem to do anything special? You can probably run your favorite machine learning framework on the Raspberry Pi, and it will work - albeit using the ARM cores and NEON only. Now, machine learning and inference _using the Raspberry Pi's GPU part_ (which is broadly documented, unlike…
There is PlaidML[1] - a cross-platform deep learning framework that works, among others, on Raspberry Pi's GPU.
[1] - https://github.com/plaidml/plaidml
Edit: they don't support RPI GPU yet - https://github.com/plaidml/plaidml/issues/141