Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

SAM 2: Segment Anything in Images and Videos

github.com

Post reply on HN
Print view View original

31–40 of 159 posts

Re: SAM 2: Segment Anything in Images and Videos

#31

Post by alsodumb »

swyx wrote: post #23

i covered SAM 1 a year ago ( https://news.ycombinator.com/item?id=35558522 ). notes from quick read of the SAM 2 paper https://ai.meta.com/research/publications/sam-2-segment-anyt... 1. SAM 2 was trained on 256 A100 GPUs for 108 hours (SAM1 was 68 hrs on same cluster). Taking the upper end $2 A100 cost off gpulist means SAM2 cost ~$50k to train - surprisingly cheap for adding video understanding? 2. new dataset: the…

I might be minority, but I am not that surprised by the results or the not so significant GPU hours. I've been video segment tracking for a while now using SAM for mask generation and some of the robust academic video-object segmentation models (see CUTIE: https://hkchengrex.com/Cutie/ presented at CVPR this year.)for tracking the mask.

I need to read SAM2 paper, but 4. seems a lot like what Rex has in CUTIE. CUTIE can consistently track segments across video frames even if they get occluded/ go out of frame for a while.

Re: SAM 2: Segment Anything in Images and Videos

#34

Post by ulrikhansen54 »

nravi20 wrote: post #2

Hi from the Segment Anything team! Today we’re releasing Segment Anything Model 2! It's the first unified model for real-time promptable object segmentation in images and videos! We're releasing the code, models, dataset, research paper and a demo! We're excited to see what everyone builds! https://ai.meta.com/blog/segment-anything-2/

Awesome model - thank you! Are you guys planning to provide any guidance on fine-tuning?

Re: SAM 2: Segment Anything in Images and Videos

#37

Post by daemonologist »

gpm wrote: post #36

> This research demo is not open to residents of, or those accessing the demo from, the States of Illinois or Texas. Alright, I'll bite, why not?

I know Illinois and Texas have biometric privacy laws; I would guess it's related to that. (I am in Illinois and cannot access the demo, so I don't know what if anything it's doing which would be in violation.)

Re: SAM 2: Segment Anything in Images and Videos

#38

Post by daemonologist »

simonw wrote: post #5

Has anyone built anything cool with the original SAM? What did you build?

I used it for segmentation for this home climbing/spray wall project: https://freeclimbs.org/wall/demo/edit-set

It does detection on the backend and then feeds those bounding boxes into SAM running in the browser. This is a little slow on the first pass but allows the user the adjust the bboxes and get new segmentations in nearly real time, without putting a ton of load on the server. Saved me having to label a bunch of holds with precise masks/polygons (I labeled 10k for the detection model and that was quite enough). I might try using SAM's output to train a smaller model in the future, haven't gotten around to it.

(Site is early in development and not ready for actual users, but feel free to mess around.)

Post reply on HN