Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: OpenCV based multi-object-tracker with various object detection models

github.com

Post reply on HN
Print view View original

11–20 of 22 posts

Re: Show HN: OpenCV based multi-object-tracker with various object detection models

#11

Post by adipandas »

ganeshkrishnan wrote: post #10
mendeza wrote: post #4

I work a lot with object detection at my current role. Would be cool to add Detectron 2, seems that this library that has some of the state of the art(SOTA) models in object detection. https://github.com/facebookresearch/detectron2 Also the TF Object Detection API has a suite of pretrained SOTA object detection models https://github.com/tensorflow/models/tree/master/research/ob... What makes object detection really v…

Facebook has such awesome AI tools open sourced. I am more impressed with their code than Google

Pytorch makes it even more fun.

Re: Show HN: OpenCV based multi-object-tracker with various object detection models

#12

Post by kevinsundar »

martinshen wrote: post #5

Have you tried using object attributes/features to enable tracking instead of IOU-based tracking? I suspect this tracker falls apart when there are significant obstructions. Thoughts on a Recurrent YOLO or DeepSORT based tracker?

I've found that IOU based tracking is surprisingly reliable (my dataset was primarily surveillance footage with a static camera) if you take measures to smooth the data and predict object motion using a kalman filter.

Re: Show HN: OpenCV based multi-object-tracker with various object detection models

#14

Post by mbpqd »

Question for HN experts: what would be the best approach for object-detection when the object I am trying to detect is a specific image (not a class of objects) printed on a 2D surface (therefore it could be partially folded / curved, but still more of a distorted 2D object than a complex 3D one)?

Re: Show HN: OpenCV based multi-object-tracker with various object detection models

#15

Post by deppp »

mendeza wrote: post #4

I work a lot with object detection at my current role. Would be cool to add Detectron 2, seems that this library that has some of the state of the art(SOTA) models in object detection. https://github.com/facebookresearch/detectron2 Also the TF Object Detection API has a suite of pretrained SOTA object detection models https://github.com/tensorflow/models/tree/master/research/ob... What makes object detection really v…

Check out our open-source tool called Label Studio, https://labelstud.io and we have a commercial offering that does exactly this, finetuning the models.

Re: Show HN: OpenCV based multi-object-tracker with various object detection models

#16

Post by mendeza »

mbpqd wrote: post #14

Question for HN experts: what would be the best approach for object-detection when the object I am trying to detect is a specific image (not a class of objects) printed on a 2D surface (therefore it could be partially folded / curved, but still more of a distorted 2D object than a complex 3D one)?

I would check out template matching or using OpenCV feature extractors such as SIFT, SURF, ORB

Template Matching scans an image with your template, smaller image and finds the location with highest cross correlation: https://opencv-python-tutroals.readthedocs.io/en/latest/py_t...

Template matching assumes the example image wont deform or take on different orientations.

Popular Feature Extraction finds and derive more robust features that help find objects in the scenarios of distortion, orientation, and scale.

Link for feature detection and matching: https://opencv-python-tutroals.readthedocs.io/en/latest/py_t...

Pyimagesearch does a cool method where they enable template matching to work at different scales. It ignores color information (by using edge detection), which could be a critical feature if the object has specific color:

https://www.pyimagesearch.com/2015/01/26/multi-scale-templat...

Re: Show HN: OpenCV based multi-object-tracker with various object detection models

#17

Post by mendeza »

adipandas wrote: post #8
mendeza wrote: post #4

I work a lot with object detection at my current role. Would be cool to add Detectron 2, seems that this library that has some of the state of the art(SOTA) models in object detection. https://github.com/facebookresearch/detectron2 Also the TF Object Detection API has a suite of pretrained SOTA object detection models https://github.com/tensorflow/models/tree/master/research/ob... What makes object detection really v…

@mendeza, Thank you for the feedback. I am planning to add detectron models as well to this repository. Initial intention of this project was to avoid direct dependency of any deep learning framework. I have only used pre-trained models and opencv for this project. Making a tool for data labeling is an awesome idea. I will definitely like to work on it. We can collaborate on this if possible. You are also welcome to…

This is a good idea! TF Object Detection framework takes a lot of effort to use on simple ideas, so frameworks that enable more abstraction the better!

Re: Show HN: OpenCV based multi-object-tracker with various object detection models

#18

Post by mendeza »

deppp wrote: post #15
mendeza wrote: post #4

I work a lot with object detection at my current role. Would be cool to add Detectron 2, seems that this library that has some of the state of the art(SOTA) models in object detection. https://github.com/facebookresearch/detectron2 Also the TF Object Detection API has a suite of pretrained SOTA object detection models https://github.com/tensorflow/models/tree/master/research/ob... What makes object detection really v…

Check out our open-source tool called Label Studio, https://labelstud.io and we have a commercial offering that does exactly this, finetuning the models.

It would be great if your tool integrates popular object detection frameworks such as TF Object Detection API. Would save people a lot of headache installing and configuring in order to begin finetuning

Re: Show HN: OpenCV based multi-object-tracker with various object detection models

#19

Post by alexcnwy »

I've built several object detection systems and you definitely want to fine-tune your model to get good results, even if the object class you want to track is available in a pre-trained model (often it isn't).

For example, pre-trained models don't work too well at detecting people in surveillance footage when the camera is mounted on the ceiling and people are at an angle in the footage. Off-the-shelf object detection models also don't work well in poor lighting conditions but can work well if you fine-tune one of the pre-trained models for your dataset and lighting conditions.

Here's a great and fun tutorial on how to fine-tune an object detection model using TensorFlow (it's a surprisingly fiddly process but worth the headache): https://towardsdatascience.com/how-to-train-your-own-object-...

I suspect you can use your fine-tuned model with this repo by replacing the `get_ssd_model.sh` compiled graph with your fine-tuned model graph.

It's also a fun exercise to implement the tracking yourself - here's a solid tutorial to get you started: https://www.pyimagesearch.com/2018/08/13/opencv-people-count...

Re: Show HN: OpenCV based multi-object-tracker with various object detection models

#20

Post by mendeza »

deppp wrote: post #15
mendeza wrote: post #4

I work a lot with object detection at my current role. Would be cool to add Detectron 2, seems that this library that has some of the state of the art(SOTA) models in object detection. https://github.com/facebookresearch/detectron2 Also the TF Object Detection API has a suite of pretrained SOTA object detection models https://github.com/tensorflow/models/tree/master/research/ob... What makes object detection really v…

Check out our open-source tool called Label Studio, https://labelstud.io and we have a commercial offering that does exactly this, finetuning the models.

I actually checked out your github repo and saw your framework that enables integration of trained models into your tool for active learning. Looks awesome! https://github.com/heartexlabs/pyheartex
Post reply on HN