51–60 of 82 posts
Earlier quoted context omitted.
Are the weights open source?
The weights are not "source".
Earlier quoted context omitted.
I agree, Meta's work in AI has been really impressive, and it's encouraging how they are open-sourcing so much. It's funny, back in the 90s I disliked Microsoft and thought they were inherently culturally opposed to open source. But big corporations really just follow their business incentives when it comes to open source. It's not like Meta "loves to be open". But they would hate a world where all the powerful AI de…
> I agree, Meta's work in AI has been really impressive, and it's encouraging how they are open-sourcing so much. My usual reaction to anything Facebook releases is "yawn, they released yet another model that is practically useless because it's released under a non-commercial license", but I'm pleasantly surprised that this one seems to be actually liberally licensed! Hopefully this continues into the future.
Any idea how/when this will make it into Photoshop? According to the article, the weights haven't been open sourced, so nobody can take this and build their own Photoshop plugin. But I'm incredibly curious if they'll license this to Adobe, or if Adobe's already got its own team building the same thing that'll be just as good, or what. It's not super-clear to me why Meta as opposed to Adobe has come out with this firs…
Photoshop already has the Object Selection tool: https://helpx.adobe.com/photoshop/using/tool-techniques/obje... I tried Meta's photo segmentation tool and I didn't see anything magical in it.
Earlier quoted context omitted.
How does it compare to Adobe's recent AI audio enhancement?
Not sure. Anyone else wanna chime in on that? BTW - in my search just now in response to your question, I see Dolby also has an API: https://dolby.io/products/enhance/
"magic wand tool that cuts an image from the background"
"like photoshop where you cut an object from the background"
"photo segmentation tool"
Google would be the de facto here, but its kind of worthless as its gamed by SEO.
Earlier quoted context omitted.
Somewhat tangential question, have you looked for/found any audio models/tools that can be used for separating out individual voices to separate audio tracks automatically? Perhaps this is already possible with existing tools that I am uninitiated in.
That's called "speaker diarization" and there's quite a bit of work in the field. https://github.com/topics/speaker-diarization I have no idea what's good or the best, but there's a starting point!
I relly hope Meta (FB research) releases this wonderful noise reduction library: https://github.com/facebookresearch/denoiser I tested MANY while building various audio tech and this was by far the best (beats the shit out of all the python Pandas Hugging Face lists etc). Incredibly ability to cut noise (tho, it must be noted that perceptual improvements for humans do not usually increase machine transcription as AI…
Somewhat tangential question, have you looked for/found any audio models/tools that can be used for separating out individual voices to separate audio tracks automatically? Perhaps this is already possible with existing tools that I am uninitiated in.
https://www.izotope.com/en/products/rx.html
I can't speak to it's effectiveness because I don't have any need for it, and also RX 10 Advanced is commercial software and pretty expensive for a casual user, but the feature seems to be on the horizon for other apps.
I've been wanting to build an app that will transform a photo into a template for stained glass. Interactive, to choose the "granule" size, merge color groups into one single piece, change border thickness, etc. Something like this would really help there and make it almost a piece of cake.
Meta does stellar work in AI. I’m quite certain the recent DMCAs were a case of the left hand not knowing what the right hand is doing. This model is open source in every sense of the word, and they’ve now released two impactful models in the span of a month. This tweet chain is a pretty great overview: https://twitter.com/drjimfan/status/1643647849824161792?s=61...
I agree, Meta's work in AI has been really impressive, and it's encouraging how they are open-sourcing so much. It's funny, back in the 90s I disliked Microsoft and thought they were inherently culturally opposed to open source. But big corporations really just follow their business incentives when it comes to open source. It's not like Meta "loves to be open". But they would hate a world where all the powerful AI de…
I have never, ever seen a convincing business case for their doing so, however.
Not your opinion. A compelling business case.
Meta does stellar work in AI. I’m quite certain the recent DMCAs were a case of the left hand not knowing what the right hand is doing. This model is open source in every sense of the word, and they’ve now released two impactful models in the span of a month. This tweet chain is a pretty great overview: https://twitter.com/drjimfan/status/1643647849824161792?s=61...
I agree, Meta's work in AI has been really impressive, and it's encouraging how they are open-sourcing so much. It's funny, back in the 90s I disliked Microsoft and thought they were inherently culturally opposed to open source. But big corporations really just follow their business incentives when it comes to open source. It's not like Meta "loves to be open". But they would hate a world where all the powerful AI de…