Live data from Hacker News

Object Detection at 1840 FPS with TorchScript, TensorRT and DeepStream

paulbridger.com

41–50 of 58 posts

Re: Object Detection at 1840 FPS with TorchScript, TensorRT and DeepStream

#41
post #4

Out of curiosity, what are the possible use cases for object detection at >100 fps? I assume it would have to be objects that move very fast, i.e. nothing ordinary that I can think of. [edit] actually stupid question. I assume it's more about throughput than fps, i.e. be able to process lots of streams on the same machine, for instance for doing mass analysis of CCTV streams.

this would be useful for sorting cells at high speed. https://www.sinobiological.com/category/fcm-facs-facs

Re: Object Detection at 1840 FPS with TorchScript, TensorRT and DeepStream

#42

I see this and I immediately think of "trash sorting" at ultra high speed. If one can combine this with a bunch of accurate (laser precision) air guns, to shoot and move individual pieces of trash you can sort through a truck load of trash in a matter of seconds, perhaps in the air while they are being dumped! compare this approach with how we are currently doing it [0] - Somebody should get Elon Musk on this project…

Sorting by optical recognition and air guns to separate a falling curtain of product into two output streams is already a product. The development of these machines are the reason that 10 or 15 years ago you stopped seeing bad beans in bulk bean bags. I am involved in the tea industry where they are used to sort tea by grade - stems, bad leaves, broken leaves, full leaves.

Here is a diagram: https://www.satake-usa.com/what-is-optical-sorting.html

Re: Object Detection at 1840 FPS with TorchScript, TensorRT and DeepStream

#43

I see this and I immediately think of "trash sorting" at ultra high speed. If one can combine this with a bunch of accurate (laser precision) air guns, to shoot and move individual pieces of trash you can sort through a truck load of trash in a matter of seconds, perhaps in the air while they are being dumped! compare this approach with how we are currently doing it [0] - Somebody should get Elon Musk on this project…

[deleted]

Re: Object Detection at 1840 FPS with TorchScript, TensorRT and DeepStream

#44
Good work getting TensorRT running we had a real pain in the butt recently when working with it and just opted to go with ONNXRuntime, their graph optimizer and their TensorRT backend -- may not be as fast as straight TensorRT from comparisons I've seen but it got us to a competitive inference and latency so we're happy with it.

Re: Object Detection at 1840 FPS with TorchScript, TensorRT and DeepStream

#45

I see this and I immediately think of "trash sorting" at ultra high speed. If one can combine this with a bunch of accurate (laser precision) air guns, to shoot and move individual pieces of trash you can sort through a truck load of trash in a matter of seconds, perhaps in the air while they are being dumped! compare this approach with how we are currently doing it [0] - Somebody should get Elon Musk on this project…

This is a thing already. In my understanding, it's a staple in several kinds of recycling processes. Random sample of related links (there's a seemingly infinite amount of these though):

https://youtu.be/mLya2NuY4Yk

https://youtu.be/GJeOfHxMWQo?t=87

https://youtu.be/bWUuBz2hWc0?t=83

Re: Object Detection at 1840 FPS with TorchScript, TensorRT and DeepStream

#47
post #4

Out of curiosity, what are the possible use cases for object detection at >100 fps? I assume it would have to be objects that move very fast, i.e. nothing ordinary that I can think of. [edit] actually stupid question. I assume it's more about throughput than fps, i.e. be able to process lots of streams on the same machine, for instance for doing mass analysis of CCTV streams.

Roulette spin predictor

I guess, but that's generally illegal, and if it became common & easy then casinos would simply require bets to be placed before the ball is dropped.

Re: Object Detection at 1840 FPS with TorchScript, TensorRT and DeepStream

#48
post #4

Out of curiosity, what are the possible use cases for object detection at >100 fps? I assume it would have to be objects that move very fast, i.e. nothing ordinary that I can think of. [edit] actually stupid question. I assume it's more about throughput than fps, i.e. be able to process lots of streams on the same machine, for instance for doing mass analysis of CCTV streams.

Roulette spin predictor

Reminds me of:

http://www1.cs.columbia.edu/graphics/courses/mobwear/resourc...

Re: Object Detection at 1840 FPS with TorchScript, TensorRT and DeepStream

#49
post #42

I see this and I immediately think of "trash sorting" at ultra high speed. If one can combine this with a bunch of accurate (laser precision) air guns, to shoot and move individual pieces of trash you can sort through a truck load of trash in a matter of seconds, perhaps in the air while they are being dumped! compare this approach with how we are currently doing it [0] - Somebody should get Elon Musk on this project…

Sorting by optical recognition and air guns to separate a falling curtain of product into two output streams is already a product. The development of these machines are the reason that 10 or 15 years ago you stopped seeing bad beans in bulk bean bags. I am involved in the tea industry where they are used to sort tea by grade - stems, bad leaves, broken leaves, full leaves. Here is a diagram: https://www.satake-usa.co…

Reminds me of the library modernization drive in 'Rainbows End'. The book digitizer is basically a wood chipper with lights and high speed cameras in the debris chute.

Re: Object Detection at 1840 FPS with TorchScript, TensorRT and DeepStream

#50

Earlier quoted context omitted.

Self-driving. Ideally you want something around 1000fps and low latency, so it has time to react. I'm sure military and sports applications are obvious too.

I don't think you'll find a 1000 fps camera on a "standard" AV platform. And if you did, I imagine it would be too noisy to be useful without a ton of illumination.

Smartphones offer 960fps video capture since a while now.
Post reply on HN