[flagged]
SAM 2: Segment Anything in Images and Videos
121–130 of 159 posts
Re: SAM 2: Segment Anything in Images and Videos
#122Would love to use it for my startup, but I believe it is to self-host on a server with GPU? Or is there an easy to use API?
I ran it with 3040x3040px images on my MacBook M1 Pro in about 9 seconds + 200ms or so for the masking.
Re: SAM 2: Segment Anything in Images and Videos
#123Earlier quoted context omitted.
What about Mac/Metal?
this is what I was getting at, i tried on my mbp and no luck. might be just an installer issue but I wanted confirmation from someone with more know-how before diving in
I got SAM 1 to work with MPS device on my MacBook Pro M1, don’t know if it works with this one too.
Re: SAM 2: Segment Anything in Images and Videos
#124Earlier quoted context omitted.
I guess the demo simply doesn't work unless you accept cookies?
Are there people who don’t accept cookies? Don’t most websites require you to accept cookies?
You don't need consent for functional cookies that are necessary for the website to work. Anything you are accepting or declining in a cookie popup shouldn't affect the user experience in any major way.
I know a lot of people who reflexively reject all cookies, and the internet indeed does keep working for them.
Re: SAM 2: Segment Anything in Images and Videos
#125The web demo is actually pretty neat: https://sam2.metademolab.com/demo I selected each shoe as individual objects and the model was able to segment them even as they overlapped.
"The Firefox browser doesn’t support the video features we’ll need to run this demo. Please try again using Chrome or Safari."
Same :(
Just a guess, maybe it's the VideoFrame API? It was the only video-related feature I could find that Chrome and Safari have and FF doesn't.
Re: SAM 2: Segment Anything in Images and Videos
#126Hi from Germany. In case you were wondering, we regulated ourselves to the point where I can't even see the demo of SAM2 until some other service than Meta deploys it. Does anyone know if this already happened?
It’s more like “Meta is restricting European access to models even though they don’t have to, because they believe it’s an effective lobbying technique as they try to get EU regulations written to their preference.” The same thing happened with the Threads app which was withheld from European users last year for no actual technical reason. Now it’s been released and nothing changed in between. These free models and a…
> Meta is restricting European access to models even though they don’t have to
This video segmentation model could be used by self-driving cars to detect pedestrians, or in road traffic management systems to detect vehicles, either of which would make it a Chapter III High-Risk AI System.
And if we instead say it's not specific to those high-risk applications, it is instead a general purpose model - wouldn't that make it a Chapter V General Purpose AI Model?
Obviously you and I know the "general purpose AI models" chapter was drafted with LLMs (and their successors) in mind, rather than image segmentation models - but it's the letter of the law, not the intent, that counts.
Re: SAM 2: Segment Anything in Images and Videos
#127Earlier quoted context omitted.
I'm not in the field and what SAM does is immediately apparent when you view the home page. Did you not even give it a glance?
Yes I did give it a glance, polite and clever HN member, it showed an object in a sequence of images extracted from video, and evidently followed the object from sequence. Perhaps however my interpretation of what happens here is way off, which is why I asked in an obviously incorrect and stupid way that you have pointed out to me without clarifying exactly why it was incorrect and stupid. So anyway there is the extr…
> A segment then is a collection of images that follow each other in time?
A segment is a visually distinctive... segment of image, segmentation is basically splitting an image into objects: https://segment-anything.com, as such it has nothing to do with time or video.
Now SAM 2 is about video, so they seem to add object tracking (that is attributing same object to the same segment throughout frames)
The videos in the main article demonstrate that it can track objects in and out of frame (the one with bacteria or the one with boy going around the tree). However they do acknowledge this part of the algorithm can produce incorrect result sometimes (example with the horses).
The answer to your question is img1, img2, img4, as there is no reason to believe that it can only track objects in contiguous sequence.
Re: SAM 2: Segment Anything in Images and Videos
#128Hi from Germany. In case you were wondering, we regulated ourselves to the point where I can't even see the demo of SAM2 until some other service than Meta deploys it. Does anyone know if this already happened?
It’s more like “Meta is restricting European access to models even though they don’t have to, because they believe it’s an effective lobbying technique as they try to get EU regulations written to their preference.” The same thing happened with the Threads app which was withheld from European users last year for no actual technical reason. Now it’s been released and nothing changed in between. These free models and a…
> The same thing happened with the Threads app which was withheld from European users last year for no actual technical reason. Now it’s been released and nothing changed in between.
No technical reason, but legal reasons. IIRC it was about cross-account data sharing from Instagram to Threads, which is a lot more dicey legally in the EU than in NA.
Re: SAM 2: Segment Anything in Images and Videos
#129Earlier quoted context omitted.
I guess the demo simply doesn't work unless you accept cookies?
Are there people who don’t accept cookies? Don’t most websites require you to accept cookies?
I reject cookies on the regular. Generally do not see any downsides for the things I browse.
Re: SAM 2: Segment Anything in Images and Videos
#130Earlier quoted context omitted.
It’s more like “Meta is restricting European access to models even though they don’t have to, because they believe it’s an effective lobbying technique as they try to get EU regulations written to their preference.” The same thing happened with the Threads app which was withheld from European users last year for no actual technical reason. Now it’s been released and nothing changed in between. These free models and a…
> The same thing happened with the Threads app which was withheld from European users last year for no actual technical reason. Now it’s been released and nothing changed in between. No technical reason, but legal reasons. IIRC it was about cross-account data sharing from Instagram to Threads, which is a lot more dicey legally in the EU than in NA.
It’s not like Meta doesn’t know how it works. They ship many apps that share accounts like FB + Messenger most prominently.
They’ve also had separate apps in the past that shared an Instagram account, like IGTV (2018 - 2022).
The Threads delay was primarily a lobbying ploy.