Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

SAM 2: Segment Anything in Images and Videos

github.com

Post reply on HN
Print view View original

51–60 of 159 posts

Re: SAM 2: Segment Anything in Images and Videos

#52

Post by j7ake »

vivzkestrel wrote: post #45
nravi20 wrote: post #2

Hi from the Segment Anything team! Today we’re releasing Segment Anything Model 2! It's the first unified model for real-time promptable object segmentation in images and videos! We're releasing the code, models, dataset, research paper and a demo! We're excited to see what everyone builds! https://ai.meta.com/blog/segment-anything-2/

stupid question from a noob: what exactly is object segmentation? what does your library actually do? Does it cut clips?

Given an image, it will outline where objects are in the image.

Re: SAM 2: Segment Anything in Images and Videos

#53

Post by rkagerer »

minimaxir wrote: post #14

The web demo is actually pretty neat: https://sam2.metademolab.com/demo I selected each shoe as individual objects and the model was able to segment them even as they overlapped.

I guess the demo simply doesn't work unless you accept cookies?

Re: SAM 2: Segment Anything in Images and Videos

#54

Post by ipsum2 »

gpm wrote: post #36

> This research demo is not open to residents of, or those accessing the demo from, the States of Illinois or Texas. Alright, I'll bite, why not?

It's because their biometric privacy laws are written in such a general way that detecting the presence of a face is considered illegal.

Re: SAM 2: Segment Anything in Images and Videos

#55

Post by pzo »

Impressive, wondering if this is now out of the box fast enough to run on iphone. Previous SAM had some community projects such as FastSAM, MobileSAM, EfficientSAM that tried to speed up. Wish when Readme reporting FPS, provided on what hardware it was tested

Re: SAM 2: Segment Anything in Images and Videos

#56

Post by andy_ppp »

albert_e wrote: post #51

How do these techniques handle transparent, translucent, mesh/gauge/hair like objects that interact with background. Splashing water or Orange juice, spraying snow from skis, rain and snowfall, foliage, fences and meshes, veils etc.

State of the art still looks pretty bad at this IMO.

Re: SAM 2: Segment Anything in Images and Videos

#58

Post by snovv_crash »

djsavvy wrote: post #44
Imnimo wrote: post #19

I think the first SAM is the open source model I've gotten the most mileage out of. Very excited to play around with SAM2!

What have you found it useful for?

Annotating datasets so I can train a smaller more specialized production model.

Re: SAM 2: Segment Anything in Images and Videos

#59

Post by snovv_crash »

ei8htyfi5e wrote: post #50

Will it handle tracking out of frame? i.e. if I stand in the center of my room and take a video of the room spinning around slowly over 5 seconds. Then reverse spin around for 5 seconds. Will it see the same couch? Or will it see two couches?

I think it depends how long it is out of frame for, there is a cache that you might be able to tweak the size of.
Post reply on HN