Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

SAM 2: Segment Anything in Images and Videos

github.com

Post reply on HN
Print view View original

131–140 of 159 posts

Re: SAM 2: Segment Anything in Images and Videos

#131

Post by phyrex »

pavlov wrote: post #130
phyrex wrote: post #128

Earlier quoted context omitted.

> The same thing happened with the Threads app which was withheld from European users last year for no actual technical reason. Now it’s been released and nothing changed in between. No technical reason, but legal reasons. IIRC it was about cross-account data sharing from Instagram to Threads, which is a lot more dicey legally in the EU than in NA.

It’s not like Meta doesn’t know how it works. They ship many apps that share accounts like FB + Messenger most prominently. They’ve also had separate apps in the past that shared an Instagram account, like IGTV (2018 - 2022). The Threads delay was primarily a lobbying ploy.

No, it really was a legal privacy thing. I worked in privacy at Meta at that time. Everybody was eager to ship it everywhere, but it wasn't worth the wrath of the EU to launch without a clear data separation between IG and threads.

Re: SAM 2: Segment Anything in Images and Videos

#132

Post by ska »

richard___ wrote: post #110
kajecounterhack wrote: post #99

Earlier quoted context omitted.

Yeah, it's a reasonable expectation since the blog highlights it. Just figure it's worth calling out that SOTA trackers are able to deal with object disappearance well enough that when used with this it would handle things. I'd venture to say that most people doing any kind of tracking aren't relying on their segmentation process.

Reference?

I’m not sure what you are looking for a reference to exactly, but segmentation as a preprocessing step for tracking has been one of, if not the primary, most typical workflow for decades.

Re: SAM 2: Segment Anything in Images and Videos

#134

Post by ignoramous »

Imnimo wrote: post #19

I think the first SAM is the open source model I've gotten the most mileage out of. Very excited to play around with SAM2!

> ...the first SAM is the open source model I've gotten the most mileage out of

How's OpenMMLab's MMSegmentation, if you've tried it? https://github.com/open-mmlab/mmsegmentation

It seems like Amazon is putting its weight behind it (from the papers they've published): https://github.com/amazon-science/bigdetection

Re: SAM 2: Segment Anything in Images and Videos

#135

Post by Lucasoato »

minimaxir wrote: post #14

The web demo is actually pretty neat: https://sam2.metademolab.com/demo I selected each shoe as individual objects and the model was able to segment them even as they overlapped.

> This research demo is not open to residents of, or those accessing the demo from, the States of Illinois or Texas.

Are there laws stricter than in California or EU in those places?

Re: SAM 2: Segment Anything in Images and Videos

#136

Post by bryanrasmussen »

nsonha wrote: post #127
bryanrasmussen wrote: post #106

Earlier quoted context omitted.

Yes I did give it a glance, polite and clever HN member, it showed an object in a sequence of images extracted from video, and evidently followed the object from sequence. Perhaps however my interpretation of what happens here is way off, which is why I asked in an obviously incorrect and stupid way that you have pointed out to me without clarifying exactly why it was incorrect and stupid. So anyway there is the extr…

> A segment then is a collection of images that follow each other in time? A segment is a visually distinctive... segment of image, segmentation is basically splitting an image into objects: https://segment-anything.com , as such it has nothing to do with time or video. Now SAM 2 is about video, so they seem to add object tracking (that is attributing same object to the same segment throughout frames) The videos in t…

Thanks!

Re: SAM 2: Segment Anything in Images and Videos

#137

Post by 8organicbits »

phkahler wrote: post #89
8organicbits wrote: post #62

Earlier quoted context omitted.

Yeah, but there's a CLA for some reason. I'm wary they will switch to a new license down the road.

So get it today. You can't retroactively change a license on someone.

Yeah, but it's a signal they aren't thinking of the project as a community project. They are centralizing rights towards themselves in an unequal way. Apache 2.0 without a CLA would be fine otherwise.

Re: SAM 2: Segment Anything in Images and Videos

#138

Post by rikroots »

nullandvoid wrote: post #113

Anyone have any home project ideas (or past work) to apply this to / inspire others? I was initially thinking the obvious case would be some sort of system for monitoring your plant health. It could check for shrinkage / growth, colour change etc and build some sort of monitoring tool / automated watering system off that.

After playing with the SAM2 demo for far too long, my immediate thought was: this would be brilliant for things like (accessible, responsive) interactive videos. I've coded up such a thing before[1] but that uses hardcoded data to track the position of the geese, and a filter to identify the swans. When I loaded that raw video into the SAM2 demo it had very little problem tracking the various birds - which would make building the interactivity on top of it very easy, I think.

Sadly my knowledge of how to make use of these models is limited to what I learned playing with some (very ancient) MediaPipe and Tensorflow models. Those models provided some WASM code to run the model in the browser and I was able to find the data from that to pipe it though to my canvas effects[2]. I'd love to get something similar working with SAM2!

[1] - https://scrawl-v8.rikweb.org.uk/demo/canvas-027.html

[2] - https://scrawl-v8.rikweb.org.uk/demo/mediapipe-003.html

Re: SAM 2: Segment Anything in Images and Videos

#140

Post by nyxtom »

nravi20 wrote: post #2

Hi from the Segment Anything team! Today we’re releasing Segment Anything Model 2! It's the first unified model for real-time promptable object segmentation in images and videos! We're releasing the code, models, dataset, research paper and a demo! We're excited to see what everyone builds! https://ai.meta.com/blog/segment-anything-2/

Is there a reason Texans can't use the demo?
Post reply on HN