Some of these are very obviously trained on webtoons and manga, probably pixiv as well. This is very clear due to seeing CG buildings and other misc artifacts. So this is obviously trained on copyrighted material. Art is something that cannot be generated like synthetic text so it will have to be nearly forever powered by human artists or else you will continue to end up with artifacting. So it makes me wonder if art…
AniSora: Open-source anime video generation model
101–110 of 232 posts
Re: AniSora: Open-source anime video generation model
#102Earlier quoted context omitted.
> As my mom retired from being a translator, she went from typewriter to machine-assisted translation with centralised corpus-databases. All the while the available work became less and less, and the wages became lower and lower. She was lucky to be able to retire when she did, as the job of a translator is definitely going to become extinct. You can already get higher quality translations from machine learning model…
Maybe for dry text. Translation of art is art too and there's no such thing as higher quality art.
Re: AniSora: Open-source anime video generation model
#103Some of these are very obviously trained on webtoons and manga, probably pixiv as well. This is very clear due to seeing CG buildings and other misc artifacts. So this is obviously trained on copyrighted material. Art is something that cannot be generated like synthetic text so it will have to be nearly forever powered by human artists or else you will continue to end up with artifacting. So it makes me wonder if art…
> So it makes me wonder if artists will just be downgraded to an "AI" training position, but it could be for the best as people can draw what they like instead and have that input feed into a model for training which doesn't sound too bad. Doesn’t sound too bad? It sounds like the premise of a dystopian novel. Most artists would be profoundly unhappy making “art” to be fed to and deconstructed by a machine. You’re no…
Re: AniSora: Open-source anime video generation model
#104Some of these are very obviously trained on webtoons and manga, probably pixiv as well. This is very clear due to seeing CG buildings and other misc artifacts. So this is obviously trained on copyrighted material. Art is something that cannot be generated like synthetic text so it will have to be nearly forever powered by human artists or else you will continue to end up with artifacting. So it makes me wonder if art…
Of course it can be, you're seeing it first hand with your very own eyes.
Re: AniSora: Open-source anime video generation model
#105Some of these are very obviously trained on webtoons and manga, probably pixiv as well. This is very clear due to seeing CG buildings and other misc artifacts. So this is obviously trained on copyrighted material. Art is something that cannot be generated like synthetic text so it will have to be nearly forever powered by human artists or else you will continue to end up with artifacting. So it makes me wonder if art…
> Art is something that cannot be generated like synthetic text 10 years ago: "real real text cannot be generated like stock phrases, so writing will be nearly forever powered by human writers."
Obviously we have synthetic graphics (like synthetic text). So something else must be meant by "art" here.
Re: AniSora: Open-source anime video generation model
#106Earlier quoted context omitted.
> So it makes me wonder if artists will just be downgraded to an "AI" training position, but it could be for the best as people can draw what they like instead and have that input feed into a model for training which doesn't sound too bad. Doesn’t sound too bad? It sounds like the premise of a dystopian novel. Most artists would be profoundly unhappy making “art” to be fed to and deconstructed by a machine. You’re no…
Surely we’re way past the point now that models could be improved via RLHF using upvotes, or something equally banal?
Re: AniSora: Open-source anime video generation model
#107You could argue that those tools in the hands of skilled craftsman will create amazing things faster, but we all know what will happen is absolute flood of AI slop in every entertainment category.
Re: AniSora: Open-source anime video generation model
#108Earlier quoted context omitted.
I think many artists will see that if they publish anything original then AI companies will immediately use it as training data without regards to copyright. The result will be less original art. They will simply stop creating it or publishing it. IMO music streaming has similarly lead to a collapse in quality music artistry, as fewer talented individuals are incentivised to go down that path. AI will do the same for…
100% Agree. I wonder if there is a mitigation strategy for this. Is there a way to make (human-made-art) scraping robustly difficult, while leaving human discovery and exploration intact?
Re: AniSora: Open-source anime video generation model
#109Earlier quoted context omitted.
It’s great that you have sympathy for illustrators, but I don’t see a big difference if the training data is a novel, a picture, a song, a piece of code, or even a piece of legal text. As my mom retired from being a translator, she went from typewriter to machine-assisted translation with centralised corpus-databases. All the while the available work became less and less, and the wages became lower and lower. In the…
Here’s the argument: The output of her translations had no copyright. Language developed independently of translators. The output of artists has copyright. Artists shape the space in which they’re generating output. The fear now is that if we no longer have a market where people generate novel arts, that space will stagnate.
Re: AniSora: Open-source anime video generation model
#110I tested this out with a promotional illustration from Neon Genesis Evangelion . The model works quite well, but there are some temporal artifacts w.r.t. the animation of the hair as the head turns: https://goto.isaac.sh/neon-anisora Prompt: The giant head turns to face the two people sitting. Oh, there is a docs page with more examples: https://pwz4yo5eenw.feishu.cn/docx/XN9YdiOwCoqJuexLdCpcakSln...
link's broke