Earlier quoted context omitted.
Where? From the article: >Currently, the code (without the weights) is available on GitHub
In the README on said github https://github.com/facebookresearch/segment-anything#model-c...
[deleted]
Meta Releases New AI-Based Photo Segmentation Tool to Everybody
31–40 of 82 posts
Re: Meta Releases New AI-Based Photo Segmentation Tool to Everybody
#32Meta does stellar work in AI. I’m quite certain the recent DMCAs were a case of the left hand not knowing what the right hand is doing. This model is open source in every sense of the word, and they’ve now released two impactful models in the span of a month. This tweet chain is a pretty great overview: https://twitter.com/drjimfan/status/1643647849824161792?s=61...
> left hand not knowing what the right hand is doing.
No it was trying to stop abuse. Unlike OpenAI, facebook can't get away with releasing a thing that is more than capable of making up libellous, racist or any other type of illegal or PR decimating thing.
The point of the really restrictive release was to at least try to limit that kind of issue.
Fortunatly for meta, most people who use the weights aren't the end user with a large twitter following, so the risk is (now) low.
Re: Meta Releases New AI-Based Photo Segmentation Tool to Everybody
#33Any idea how/when this will make it into Photoshop? According to the article, the weights haven't been open sourced, so nobody can take this and build their own Photoshop plugin. But I'm incredibly curious if they'll license this to Adobe, or if Adobe's already got its own team building the same thing that'll be just as good, or what. It's not super-clear to me why Meta as opposed to Adobe has come out with this firs…
> According to the article, the weights haven't been open sourced, so nobody can take this and build their own Photoshop plugin.
The article seems to be misleading, since I can just go to the github and download the weights right now: https://github.com/facebookresearch/segment-anything#model-c...
However, for sake of fairness, competition, and reproducible science, I hope that if Adobe makes this a part of their commercial offering, they train their own so we can have two variants of the same model available to us.
Re: Meta Releases New AI-Based Photo Segmentation Tool to Everybody
#34Unrelated, but can we please get web browsers to enable users to totally turn off all auto play video and video encoding? I hate websites like this where you deal with a minefield of video areas that might start playing audio at the smallest tap and drain your bandwidth for content you have zero desire to watch.
My firefox seems to not play it by default.
Re: Meta Releases New AI-Based Photo Segmentation Tool to Everybody
#35Meta does stellar work in AI. I’m quite certain the recent DMCAs were a case of the left hand not knowing what the right hand is doing. This model is open source in every sense of the word, and they’ve now released two impactful models in the span of a month. This tweet chain is a pretty great overview: https://twitter.com/drjimfan/status/1643647849824161792?s=61...
Are the weights open source?
Re: Meta Releases New AI-Based Photo Segmentation Tool to Everybody
#36Perhaps it's not as sophisticated as Meta, but doesn't iOS16 do this?
I recall my partner discovering it by accident whilst messing about with some photos. The people in the foreground were lifted off the background.
Re: Meta Releases New AI-Based Photo Segmentation Tool to Everybody
#37Meta does stellar work in AI. I’m quite certain the recent DMCAs were a case of the left hand not knowing what the right hand is doing. This model is open source in every sense of the word, and they’ve now released two impactful models in the span of a month. This tweet chain is a pretty great overview: https://twitter.com/drjimfan/status/1643647849824161792?s=61...
The Economist had a recent overview of the AI competitive landscape that highlights Meta's outsize role thanks to their embrace of openness. https://www.economist.com/business/2023/03/26/big-tech-and-t...
Re: Meta Releases New AI-Based Photo Segmentation Tool to Everybody
#38Perhaps it's not as sophisticated as Meta, but doesn't iOS16 do this? I recall my partner discovering it by accident whilst messing about with some photos. The people in the foreground were lifted off the background.
Yes, but it is closed to Apple's app only. Android has something something similar, but they haven't released to the public.
Meta is releasing it to everyone, so you can use it on your own apps/services. (and it is a great implementation/state of the art).
Re: Meta Releases New AI-Based Photo Segmentation Tool to Everybody
#39Here's a great summary: https://twitter.com/DrJimFan/status/1643647849824161792
these are toy examples
If course they are. I haven't looked into this model in particular, but unless I'm way off base, these general purpose pretrained things are completely unsuitable for any specialized (say medical or whatever) application. This seems just like a better version of some of the previous semantic segmentation models they trained on coco.
It's probably a good starting point for fine tuning for custom application though, that's the main use of these big models.
Re: Meta Releases New AI-Based Photo Segmentation Tool to Everybody
#40Perhaps it's not as sophisticated as Meta, but doesn't iOS16 do this? I recall my partner discovering it by accident whilst messing about with some photos. The people in the foreground were lifted off the background.
Yes, but it is closed to Apple's app only. Android has something something similar, but they haven't released to the public. Meta is releasing it to everyone, so you can use it on your own apps/services. (and it is a great implementation/state of the art).
Thanks for confirming (wasn't sure if I'd misremembered it somehow!!)
And totally with you that the Meta release is great for getting this kind of thing more widely adopted.