Live data from Hacker News

SAM 2: Segment Anything in Images and Videos

github.com

91–100 of 159 posts

Re: SAM 2: Segment Anything in Images and Videos

#91

Earlier quoted context omitted.

I guess the demo simply doesn't work unless you accept cookies?

Are there people who don’t accept cookies? Don’t most websites require you to accept cookies?

Always refuse them, close to zero problems.

I can’t think of a technical reason a website without auth needs cookies to function.

Re: SAM 2: Segment Anything in Images and Videos

#92

The web demo is actually pretty neat: https://sam2.metademolab.com/demo I selected each shoe as individual objects and the model was able to segment them even as they overlapped.

"The Firefox browser doesn’t support the video features we’ll need to run this demo. Please try again using Chrome or Safari."

Re: SAM 2: Segment Anything in Images and Videos

#93
post #80

Wonder if I can use this to count my winter wood stock. Before resuscitating my mutilated Python environment, could someone please run this on a photo of stacked uneven bluegum logs to see if it can segment the pieces? OpenCV edge detection does not cut it: https://share.icloud.com/photos/090J8n36FAd0_lz4tz-TJfOhw

Heads up that link reveals real name. Maybe edit it out if you care

Re: SAM 2: Segment Anything in Images and Videos

#94
post #28

Earlier quoted context omitted.

Code, model, data and under Apache 2.0. Impressive. Curious how this was allowed to be more open source compared to Llama's interesting new take on "open source". Are other projects restricted in some form due to technical/legal issues and the desire is to be more like this project? Or was there an initiative to break the mold this time round?

LLMs are trained on the entire internet so loads of copyrighted data, which Meta can’t distribute, and is afraid to even reference

[flagged]

Re: SAM 2: Segment Anything in Images and Videos

#97

Earlier quoted context omitted.

I guess the demo simply doesn't work unless you accept cookies?

Are there people who don’t accept cookies? Don’t most websites require you to accept cookies?

In many jurisdictions requiring blanket acceptance of cookies to access the whole site is illegal, eg https://ico.org.uk/for-organisations/direct-marketing-and-pr... . Sites have to offer informed consent for nonessential cookies - but equally don't have to ask if the only cookies used are essential. So a popup saying 'Accept cookies?' with no other information doesn't cut it.

Re: SAM 2: Segment Anything in Images and Videos

#99

Earlier quoted context omitted.

It looks like it’s working to me. Segmentation isn’t supposed to be used for tracking alone. If you add tracking on top, the uncertainty in the estimated mask for the white ball (which is sometimes getting confused with the wall) would be accounted for and you’d be able to track it well.

The blog post ( https://ai.meta.com/blog/segment-anything-2/ ) mentions tracking as a use case. Similar objects is known to be challenging and they mention it in the Limitations section. In that video, I only used one frame, but in some other tests even when I prompted in several frames as recommended, it didn't really work, still.

Yeah, it's a reasonable expectation since the blog highlights it. Just figure it's worth calling out that SOTA trackers are able to deal with object disappearance well enough that when used with this it would handle things. I'd venture to say that most people doing any kind of tracking aren't relying on their segmentation process.

Re: SAM 2: Segment Anything in Images and Videos

#100
post #52

Earlier quoted context omitted.

Given an image, it will outline where objects are in the image.

and extract segments of images where the object are in the image as I understand it? A segment then is a collection of images that follow each other in time? So if you have a video comprised of img1, img2, img3, img4 and object shows in img1 and img2 and img4 Can you catch that as a sequence img1, img2, img3, img4 and can you also catch just the object img1, img2, img4 but get some sort of information that there is a…

I'm not in the field and what SAM does is immediately apparent when you view the home page. Did you not even give it a glance?
Post reply on HN