Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

SIMD-accelerated computer vision on a $2 microcontroller

shraiwi.github.io

Post reply on HN
Print view View original

21–30 of 60 posts

Re: SIMD-accelerated computer vision on a $2 microcontroller

#21

Post by implements »

shraiwi wrote: post #4
westurner wrote: post #3

> As I've been really interested in computer vision lately, I decided on writing a SIMD-accelerated implementation of the FAST feature detector for the ESP32-S3 [...] > In the end, I was able to improve the throughput of the FAST feature detector by about 220%, from 5.1MP/s to 11.2MP/s in my testing. This is well within the acceptable range of performance for realtime computer vision tasks, enabling the ESP32-S3 to e…

Thanks for reading! > What are some use cases for FAST? The FAST feature detector is an algorithm for finding regions of an image that are visually distinctive, which can be used as a first step in motion tracking and SLAM (simultaneous localization and mapping) algorithms typically seen in XR, robotics, etc. > Is there TPU-like functionality in anything in this price range of chips yet? I think that in the case of t…

> The FAST feature detector is an algorithm for finding regions of an image that are visually distinctive, …

Is that related to ‘Energy Function’ in any way?

(I ask because a long time ago I was involved in an Automated Numberplate Reading startup that was using an FPGA to quickly find the vehicle numberplate in an image)

Re: SIMD-accelerated computer vision on a $2 microcontroller

#22

Post by julius »

evanjrowley wrote: post #5

A comparable board is the ESP32-CAM, which is supported by this really practical computer vision project: https://github.com/jomjol/AI-on-the-edge-device?tab=readme-o...

Oh wow TIL ESP32 can run TensorFlowLite. Person detection in 54ms! https://github.com/espressif/esp-tflite-micro?tab=readme-ov-...

Re: SIMD-accelerated computer vision on a $2 microcontroller

#23

Post by rowanG077 »

rurban wrote: post #13

We prefer something more expensive and better: https://up-board.org/upsquared/specifications/ Intel UpSquared

More expensive sure. But better is pretty rich considering it is Intel. My money is on this platform just evaporating in the next 5 years. Esp32 has proven you can rely on supply and longevity.

Re: SIMD-accelerated computer vision on a $2 microcontroller

#24

Post by mppm »

DeathArrow wrote: post #17

>For silicon that's cheaper than the average coffee, that's pretty cool. Maybe it's not the chip that it's too cheap. Maybe it's the coffee that's too expensive.

OTOH, I've been waiting for disposable coffee cups with OLED-based video ads ever since Minority Report. But tech progress is just too damn slow :P

Re: SIMD-accelerated computer vision on a $2 microcontroller

#29

Post by yjftsjthsd-h »

mppm wrote: post #24
DeathArrow wrote: post #17

>For silicon that's cheaper than the average coffee, that's pretty cool. Maybe it's not the chip that it's too cheap. Maybe it's the coffee that's too expensive.

OTOH, I've been waiting for disposable coffee cups with OLED-based video ads ever since Minority Report. But tech progress is just too damn slow :P

I dunno about OLED, but now that you say it the costs do make some sort of "smart" coffee disturbingly plausible.

Re: SIMD-accelerated computer vision on a $2 microcontroller

#30

Post by Qwuke »

ladyanita22 wrote: post #25

Anyone with experience on Rust for ESP32 controllers could chime in on whether this is feasible on rust as well?

Compared to ESP8266, there's generally pretty good ESP32 support for Rust, but you'll likely need to use in your C++ toolchain if you want to use the standard library. no-std in Rust for ESP32 isn't terrible in my experience, though, just not as fleshed out - particularly for hooking into components like wifi/networking and probably a camera as well.

Like the other commenter said, there's plenty of support for SIMD and asm in Rust.

You might ask around on a Rust embedded or Rust ESP32 chatroom before making the dive.

Post reply on HN