Live data from Hacker News

Meta Releases New AI-Based Photo Segmentation Tool to Everybody

arstechnica.com

41–50 of 82 posts

Re: Meta Releases New AI-Based Photo Segmentation Tool to Everybody

#41
post #2

Unrelated, but can we please get web browsers to enable users to totally turn off all auto play video and video encoding? I hate websites like this where you deal with a minefield of video areas that might start playing audio at the smallest tap and drain your bandwidth for content you have zero desire to watch.

Many browsers have settings built in for this, and those that don't natively definitely have browser extensions for doing this.

I'm not sure chrome mobile has either.

Yep, Google removed the setting to disable it in version 80 for Android.

Re: Meta Releases New AI-Based Photo Segmentation Tool to Everybody

#42

Meta does stellar work in AI. I’m quite certain the recent DMCAs were a case of the left hand not knowing what the right hand is doing. This model is open source in every sense of the word, and they’ve now released two impactful models in the span of a month. This tweet chain is a pretty great overview: https://twitter.com/drjimfan/status/1643647849824161792?s=61...

I agree, Meta's work in AI has been really impressive, and it's encouraging how they are open-sourcing so much.

It's funny, back in the 90s I disliked Microsoft and thought they were inherently culturally opposed to open source. But big corporations really just follow their business incentives when it comes to open source.

It's not like Meta "loves to be open". But they would hate a world where all the powerful AI development happened on one of the big clouds. Imagine if every researchers used some closed-source API from Google or Azure or AWS. Meta would try to hire some AI people, and they'd be like, ugh if we take the job we have to use this weird Facebook-specific thing. (Flow)

So, supporting PyTorch and providing open source models is just a good business strategy for Meta. I'm glad to see it.

Re: Meta Releases New AI-Based Photo Segmentation Tool to Everybody

#43
post #42

Meta does stellar work in AI. I’m quite certain the recent DMCAs were a case of the left hand not knowing what the right hand is doing. This model is open source in every sense of the word, and they’ve now released two impactful models in the span of a month. This tweet chain is a pretty great overview: https://twitter.com/drjimfan/status/1643647849824161792?s=61...

I agree, Meta's work in AI has been really impressive, and it's encouraging how they are open-sourcing so much. It's funny, back in the 90s I disliked Microsoft and thought they were inherently culturally opposed to open source. But big corporations really just follow their business incentives when it comes to open source. It's not like Meta "loves to be open". But they would hate a world where all the powerful AI de…

> I agree, Meta's work in AI has been really impressive, and it's encouraging how they are open-sourcing so much.

My usual reaction to anything Facebook releases is "yawn, they released yet another model that is practically useless because it's released under a non-commercial license", but I'm pleasantly surprised that this one seems to be actually liberally licensed! Hopefully this continues into the future.

Re: Meta Releases New AI-Based Photo Segmentation Tool to Everybody

#44

I relly hope Meta (FB research) releases this wonderful noise reduction library: https://github.com/facebookresearch/denoiser I tested MANY while building various audio tech and this was by far the best (beats the shit out of all the python Pandas Hugging Face lists etc). Incredibly ability to cut noise (tho, it must be noted that perceptual improvements for humans do not usually increase machine transcription as AI…

Somewhat tangential question, have you looked for/found any audio models/tools that can be used for separating out individual voices to separate audio tracks automatically? Perhaps this is already possible with existing tools that I am uninitiated in.

Re: Meta Releases New AI-Based Photo Segmentation Tool to Everybody

#45

Earlier quoted context omitted.

Are the weights open source?

Right here: https://github.com/facebookresearch/segment-anything#model-c...

For anyone curious about file sizes for the PyTorch models:

* default/sam_vit_h_4b8939.pth: 2.4GB

* sam_vit_l_0b3195.pth: 1.2GB

* sam_vit_b_01ec64.pth: 358MB

Re: Meta Releases New AI-Based Photo Segmentation Tool to Everybody

#46

I relly hope Meta (FB research) releases this wonderful noise reduction library: https://github.com/facebookresearch/denoiser I tested MANY while building various audio tech and this was by far the best (beats the shit out of all the python Pandas Hugging Face lists etc). Incredibly ability to cut noise (tho, it must be noted that perceptual improvements for humans do not usually increase machine transcription as AI…

Somewhat tangential question, have you looked for/found any audio models/tools that can be used for separating out individual voices to separate audio tracks automatically? Perhaps this is already possible with existing tools that I am uninitiated in.

That's called "speaker diarization" and there's quite a bit of work in the field. https://github.com/topics/speaker-diarization

I have no idea what's good or the best, but there's a starting point!

Re: Meta Releases New AI-Based Photo Segmentation Tool to Everybody

#47

Any idea how/when this will make it into Photoshop? According to the article, the weights haven't been open sourced, so nobody can take this and build their own Photoshop plugin. But I'm incredibly curious if they'll license this to Adobe, or if Adobe's already got its own team building the same thing that'll be just as good, or what. It's not super-clear to me why Meta as opposed to Adobe has come out with this firs…

Photoshop already has the Object Selection tool: https://helpx.adobe.com/photoshop/using/tool-techniques/obje...

I tried Meta's photo segmentation tool and I didn't see anything magical in it.

Re: Meta Releases New AI-Based Photo Segmentation Tool to Everybody

#48

I relly hope Meta (FB research) releases this wonderful noise reduction library: https://github.com/facebookresearch/denoiser I tested MANY while building various audio tech and this was by far the best (beats the shit out of all the python Pandas Hugging Face lists etc). Incredibly ability to cut noise (tho, it must be noted that perceptual improvements for humans do not usually increase machine transcription as AI…

Somewhat tangential question, have you looked for/found any audio models/tools that can be used for separating out individual voices to separate audio tracks automatically? Perhaps this is already possible with existing tools that I am uninitiated in.

I haven't tested this with multiple voices and it sounds like you want something more specific but it's produced 10/10 results with a couple dozen audio files I've thrown at it, might be of use... https://vocalremover.org/

Re: Meta Releases New AI-Based Photo Segmentation Tool to Everybody

#49

I relly hope Meta (FB research) releases this wonderful noise reduction library: https://github.com/facebookresearch/denoiser I tested MANY while building various audio tech and this was by far the best (beats the shit out of all the python Pandas Hugging Face lists etc). Incredibly ability to cut noise (tho, it must be noted that perceptual improvements for humans do not usually increase machine transcription as AI…

Somewhat tangential question, have you looked for/found any audio models/tools that can be used for separating out individual voices to separate audio tracks automatically? Perhaps this is already possible with existing tools that I am uninitiated in.

https://speechbrain.readthedocs.io/en/latest/API/speechbrain...

Re: Meta Releases New AI-Based Photo Segmentation Tool to Everybody

#50
post #15

Are there any open source alternatives for this? Or still too early?

I wrote a napari-plugin for it, https://github.com/JoOkuma/napari-segment-anything

You just need to have napari installed. I only tested on Linux, so it might not work on Windows/OSX.

Post reply on HN