Meta's Segment Anything written with C++ / GGML
1–10 of 34 posts
Re: Meta's Segment Anything written with C++ / GGML
#2This is a port of Meta's Segment Anything computer vision model which allows easy segmentation of shapes in images. Originally written in Python, Yavor Ivanov has ported it to C++ using the GGML library created by Georgi Gerganov which is optimized for CPU instead of GPU, specifically Apple Silicon M1/M2. The repo is still in it's early stage
Re: Meta's Segment Anything written with C++ / GGML
#3This is a port of Meta's Segment Anything computer vision model which allows easy segmentation of shapes in images. Originally written in Python, Yavor Ivanov has ported it to C++ using the GGML library created by Georgi Gerganov which is optimized for CPU instead of GPU, specifically Apple Silicon M1/M2. The repo is still in it's early stage
Do you know how the time to do the image embedding takes? In SAM, most of the time is spent generating a very expensive embedding (prohibitive for real-time object detection). From the timing on your page it looks like yours is also similarly slow, but I'm curious how it compares to the pytorch Meta implementation.
Re: Meta's Segment Anything written with C++ / GGML
#4While I love the efficiency from these Python to C++ ports I can't stop thinking about the long tail of subtle bugs that will likely infest these libraries forever but then the Python versions also sit atop C/C++ cores
Re: Meta's Segment Anything written with C++ / GGML
#5Big fan of your work GGML friends
Re: Meta's Segment Anything written with C++ / GGML
#6Well... damn. Is there a framework like this (or this directly?) which can run object detection? People, car types, makes, animals, etc?
Re: Meta's Segment Anything written with C++ / GGML
#7While I love the efficiency from these Python to C++ ports I can't stop thinking about the long tail of subtle bugs that will likely infest these libraries forever but then the Python versions also sit atop C/C++ cores
[flagged]
Re: Meta's Segment Anything written with C++ / GGML
#8Well... damn. Is there a framework like this (or this directly?) which can run object detection? People, car types, makes, animals, etc?
Yes, GroundingDINO is an open set object detector. There are some others (eg DETIC and OWL-ViT) as well.
We’ve been working on using them (often in conjunction with SAM) for auto-labeling datasets to train smaller faster models that can run in real-time at the edge: https://github.com/autodistill/autodistill
Re: Meta's Segment Anything written with C++ / GGML
#9Well... damn. Is there a framework like this (or this directly?) which can run object detection? People, car types, makes, animals, etc?
Yes, GroundingDINO is an open set object detector. There are some others (eg DETIC and OWL-ViT) as well. We’ve been working on using them (often in conjunction with SAM) for auto-labeling datasets to train smaller faster models that can run in real-time at the edge: https://github.com/autodistill/autodistill
[deleted]
Re: Meta's Segment Anything written with C++ / GGML
#10Well... damn. Is there a framework like this (or this directly?) which can run object detection? People, car types, makes, animals, etc?
Yes, GroundingDINO is an open set object detector. There are some others (eg DETIC and OWL-ViT) as well. We’ve been working on using them (often in conjunction with SAM) for auto-labeling datasets to train smaller faster models that can run in real-time at the edge: https://github.com/autodistill/autodistill
Would this be suitable for labeling images to search by keyword (think Apple Photos-like “car” searches to pull up photos of cars)