11–20 of 144 posts
Earlier quoted context omitted.
I once trained a model from data from a simulator which I wrote myself. I think it's clean. Just sayin, zero is a strong claim.
Yeah and as much as I may not be a big Adobe fan, they legit hold the rights to plenty of "clean" IP-compliant training material (OPs comment re generative text not withstanding)
https://www.cdpinstitute.org/news/adobe-firefly-partly-train....
Earlier quoted context omitted.
I once trained a model from data from a simulator which I wrote myself. I think it's clean. Just sayin, zero is a strong claim.
Yeah and as much as I may not be a big Adobe fan, they legit hold the rights to plenty of "clean" IP-compliant training material (OPs comment re generative text not withstanding)
That's like saying, "Not withstanding the part of this that is true, but would be inconvenient to the idea that Adobe has something invaluable."
You can't train a useful text-to-image model without some kind of text conditioning approach. All the existing text conditioning approaches cannot be developed using only the data they have. How else can I put this?
The whole insight here is that the idea of "clean" is already kind of magical, that people want "clean" image models but they don't really understand the meaning of "clean" - or rather, nobody wants to take leadership in educating how these models work. People want good vibes, aesthetically pleasing "clean" image generators, not actually technologically clean image generators.
But this court case would outlaw the good vibes "clean" generators, and since there are no technologically clean image generators, that's it for image generators.
There are no clean image models. Zero. Using today's model architectures, the problem of using non-expressly-permitted data for training is insurmountable. I welcome anyone more knowledgeable on the matter to go ahead and comment about a counterexample before downvoting. So if the artists prevail, image generators are donezo. Open source, proprietary, whatever. People saying otherwise just don't know enough about how…
Earlier quoted context omitted.
Asking why the artists are mad at the corporations that are trying to profit off their labor without permission and not the fed or other artists is definitely a take.
You are making a bad faith comment. There's no mystery why artists are mad at Stability and Midjourney. I agree that demanding lower interest rates would be ridiculous. That is my point. You could delete Midjourney, Stability, DALL-E3, etc. tomorrow, and it will still suck harder today to be a working artist than it did in 2021, when interest rates were lower and there were literally hundreds more TV series being pro…
Earlier quoted context omitted.
I'm very excited for discovery.
Didn't the Enron dataset that's now part of the Pile become public during discovery too? Some great image datasets might drop.
There are no clean image models. Zero. Using today's model architectures, the problem of using non-expressly-permitted data for training is insurmountable. I welcome anyone more knowledgeable on the matter to go ahead and comment about a counterexample before downvoting. So if the artists prevail, image generators are donezo. Open source, proprietary, whatever. People saying otherwise just don't know enough about how…
I might be getting mixed up… The diffusion part is just trained with the images, and the guidance part… is trained to produce the image when given the additional information of the embedding of the text? I find it difficult to imagine how the information from the CLIP embedding of the text could result in much information about the images that CLIP was trained with, ending up in the generated images?
There are no clean image models. Zero. Using today's model architectures, the problem of using non-expressly-permitted data for training is insurmountable. I welcome anyone more knowledgeable on the matter to go ahead and comment about a counterexample before downvoting. So if the artists prevail, image generators are donezo. Open source, proprietary, whatever. People saying otherwise just don't know enough about how…
There are no clean image models. Zero. Using today's model architectures, the problem of using non-expressly-permitted data for training is insurmountable. I welcome anyone more knowledgeable on the matter to go ahead and comment about a counterexample before downvoting. So if the artists prevail, image generators are donezo. Open source, proprietary, whatever. People saying otherwise just don't know enough about how…
My understanding was that CLIP handled prompt comprehension - like, there's a set of vectors in CLIP space for "gold humanoid robot" that "C3-PO" would map to from the small language model, and pictures of C3-PO would map to from the image model in CLIP. But the U-net doing the actual image diffusion wouldn't know how to fill that part of CLIP space with the specific copyrightable representation of the Star Wars character unless it'd been trained on the same set of images. It might generalize how to draw a gold robot, which is not a copyrightable image feature, but not C3-PO specifically.
It's entirely plausible that a court might say training CLIP on copyrighted material is OK, but training the VAE or U-net layers is not, based on the technical capability of each layer to reproduce trained-on material.
The moral arguments being bandied about by artists are broader than copyright. Firefly - or even a fully public-domain-trained model - cannot satisfy them. Being trained on is a moral insult, but they would still be insulted by AI bros and corporate stooges boasting about how AI can eliminate entire classes of artistic work. To be clear, the AI models we currently have - as well as those we will have in the future - are not useful tools for artists. The problem is not a lack of training data or the provenance of said data, it's the fact that text is not a good interface for visual artists.
It is, however, a very good interface for people who want artists to go away. What AI art is doing in 2024 is satisficing - i.e. providing viewers and users of art with a good-enough market substitute.
The bigger questions you raise about ownership are orthogonal to the questions of who gets to own the model. The artists opposing AI rightfully want to see tech companies bleed, because tech companies are the same companies who sold their bosses on the tools that steal their wages - e.g. streaming services that pay fractions of a cent if you're lucky. If AI were to prevail the alternative would then be to engage in copyright laundry in protest. e.g. "If you won't protect us against AI, then we'll weaponize it against the media conglomerates who want to use it to fire us with."