Live data from Hacker News

SAM 2: Segment Anything in Images and Videos

github.com

101–110 of 159 posts

Re: SAM 2: Segment Anything in Images and Videos

#101
post #96

Hi from Germany. In case you were wondering, we regulated ourselves to the point where I can't even see the demo of SAM2 until some other service than Meta deploys it. Does anyone know if this already happened?

Which German regulation prevents this? Is it biometric related?

It seems that https://mullvad.net is a necessary part of my Internet toolkit these days, for many reasons.

Re: SAM 2: Segment Anything in Images and Videos

#102
post #96

Hi from Germany. In case you were wondering, we regulated ourselves to the point where I can't even see the demo of SAM2 until some other service than Meta deploys it. Does anyone know if this already happened?

It’s more like “Meta is restricting European access to models even though they don’t have to, because they believe it’s an effective lobbying technique as they try to get EU regulations written to their preference.”

The same thing happened with the Threads app which was withheld from European users last year for no actual technical reason. Now it’s been released and nothing changed in between.

These free models and apps are bargaining chips for Meta against the EU. Once the regulatory situation settles, they’ll do what they always do and adapt to reach the largest possible global audience.

Re: SAM 2: Segment Anything in Images and Videos

#103
post #2

Hi from the Segment Anything team! Today we’re releasing Segment Anything Model 2! It's the first unified model for real-time promptable object segmentation in images and videos! We're releasing the code, models, dataset, research paper and a demo! We're excited to see what everyone builds! https://ai.meta.com/blog/segment-anything-2/

Oh, nice!

The first one was excellent. Now part of my Gimp toolbox. Thanks for your work!

Re: SAM 2: Segment Anything in Images and Videos

#104
post #28

Earlier quoted context omitted.

Code, model, data and under Apache 2.0. Impressive. Curious how this was allowed to be more open source compared to Llama's interesting new take on "open source". Are other projects restricted in some form due to technical/legal issues and the desire is to be more like this project? Or was there an initiative to break the mold this time round?

LLMs are trained on the entire internet so loads of copyrighted data, which Meta can’t distribute, and is afraid to even reference

[deleted]

Re: SAM 2: Segment Anything in Images and Videos

#105
post #103
post #2

Hi from the Segment Anything team! Today we’re releasing Segment Anything Model 2! It's the first unified model for real-time promptable object segmentation in images and videos! We're releasing the code, models, dataset, research paper and a demo! We're excited to see what everyone builds! https://ai.meta.com/blog/segment-anything-2/

Oh, nice! The first one was excellent. Now part of my Gimp toolbox. Thanks for your work!

How did you add it to gimp?

Re: SAM 2: Segment Anything in Images and Videos

#106
post #100

Earlier quoted context omitted.

and extract segments of images where the object are in the image as I understand it? A segment then is a collection of images that follow each other in time? So if you have a video comprised of img1, img2, img3, img4 and object shows in img1 and img2 and img4 Can you catch that as a sequence img1, img2, img3, img4 and can you also catch just the object img1, img2, img4 but get some sort of information that there is a…

I'm not in the field and what SAM does is immediately apparent when you view the home page. Did you not even give it a glance?

Yes I did give it a glance, polite and clever HN member, it showed an object in a sequence of images extracted from video, and evidently followed the object from sequence.

Perhaps however my interpretation of what happens here is way off, which is why I asked in an obviously incorrect and stupid way that you have pointed out to me without clarifying exactly why it was incorrect and stupid.

So anyway there is the extraction of the object I referred to, but also seeming to follow the object through sequence of scenes?

https://github.com/facebookresearch/segment-anything-2/raw/m...

So it seems to me that they identify the object and follow it for a contiguous sequence. Img1, img2, img3, img4, is my interpretation incorrect here?

But what I am wondering is - what happens if the object is not in img3 - like perhaps two people talking and shifting viewpoint from person talking to person listening. Person talking is in img1, img2, img4. Can you get that sequence or is it just img1, img2 the sequence.

It says "We extend SAM to video by considering images as a video with a single frame." which I don't know what that means, does it mean that they concatenated all the video frames into a single image and identified the object in them, in which case their example still shows contiguous images without the object ever disappearing so my question still pertains.

So anyway my conclusion is what said when addressing me was wrong, to quote: "what SAM does is immediately apparent when you view the home page" because I (the you addressed) viewed the homepage I wondered about some things? Obviously wrong things that you have identified as being wrong.

And thus my question is: If what SAM does is immediately apparent when you view the home page can you point out where my understanding has failed?

On edit: grammar fixes for last paragraph / question.

Re: SAM 2: Segment Anything in Images and Videos

#107
post #96

Hi from Germany. In case you were wondering, we regulated ourselves to the point where I can't even see the demo of SAM2 until some other service than Meta deploys it. Does anyone know if this already happened?

Sounds like big tech's strategy to make you protest against regulating them is working brilliantly.

Re: SAM 2: Segment Anything in Images and Videos

#108
post #2

Hi from the Segment Anything team! Today we’re releasing Segment Anything Model 2! It's the first unified model for real-time promptable object segmentation in images and videos! We're releasing the code, models, dataset, research paper and a demo! We're excited to see what everyone builds! https://ai.meta.com/blog/segment-anything-2/

I've been supporting non-computational (i.e. scientists) to use and finetune SAM for biological applications, so excited to see how SAM2 performs and how the video aspects work for large image stacks of 3D objects.

Considering the instant flood of noisy issues/PRs on the repo and the limited fix/update support on SAM, are there plans/buy-in for support of SAM2 on the medium-term beyond quick fixes? Either way, thank you to the team for your work on this and the continued public releases!

Re: SAM 2: Segment Anything in Images and Videos

#110

Earlier quoted context omitted.

The blog post ( https://ai.meta.com/blog/segment-anything-2/ ) mentions tracking as a use case. Similar objects is known to be challenging and they mention it in the Limitations section. In that video, I only used one frame, but in some other tests even when I prompted in several frames as recommended, it didn't really work, still.

Yeah, it's a reasonable expectation since the blog highlights it. Just figure it's worth calling out that SOTA trackers are able to deal with object disappearance well enough that when used with this it would handle things. I'd venture to say that most people doing any kind of tracking aren't relying on their segmentation process.

Reference?
Post reply on HN