Live data from Hacker News

How an AI Anime Is Created

aventos.dev

21–30 of 48 posts

Re: How an AI Anime Is Created

#21
post #8

The end result[1] looks quite impressive! The animation feels like it's quite high quality--very smooth. However, some things seem off: bad lip sync, minor animation errors, discontinuous scene-to-scene feel. Given that these are supposed to be their best examples, meant as advertisements, I would guess these errors are hard to fix using only the models. So my verdict is that AI-only anime is still not there yet (alt…

As the quality of each scene might someday surpass the budget of entire shows, anime can be infinitely more animated and creating something new in the process. What would a “multi-billion-dollar” episode look like? Hope we find out soon. Exciting times.

Re: How an AI Anime Is Created

#22

Pretty cool overview of the process even if I would rather claw my eyes out than view the result.

https://www.aventos.dev/our-work dunno, I've seen worse and some of the scenes if you asked me if it was AI or not I probably couldn't tell you. most egregious thing I saw was at the 27 second mark where the girl is inside the table. At the current level of tech it feels like it would be a pretty dull full length Anime, and hard to squeeze all the bugs out but for something shorter like a commercial or FMVs for like…

0:19 - the bowl has soup in it, despite coming from the middle of the stack.

0:19 - [same time] several bowls are just sloppified, e.g., having two bottoms

0:45 - last of the soup phases out the bottom of the bowl

Continuity errors with the smock. (Is there a logo on the pocket, or no? Does it have a pocket?)

("How Asians Pay for the Bill" … what a title)

0:29 - a water drop drops off the ice cube and falls to the next ice cube … inside the water?

The cards are never quite the same; sometime the contacts are misplaced, sometimes they're missing.

But things like the girl phasing in the table, the soup phasing through the bowl … these are things a human would never animate, because they've lived their entire life understanding the physics of soup. Or, like with the card … they'd get a reference.

Re: How an AI Anime Is Created

#23
I have to admit that people interpreting current affairs/hot moments in real life through the lens of anime tropes really tickles in a way I never believed possible.

The aha moment was when people made ones over the Pam Bondi DOW over 50k meme but the recent World Cup ones have been very amusing too

Re: How an AI Anime Is Created

#24

Pretty cool overview of the process even if I would rather claw my eyes out than view the result.

https://www.aventos.dev/our-work dunno, I've seen worse and some of the scenes if you asked me if it was AI or not I probably couldn't tell you. most egregious thing I saw was at the 27 second mark where the girl is inside the table. At the current level of tech it feels like it would be a pretty dull full length Anime, and hard to squeeze all the bugs out but for something shorter like a commercial or FMVs for like…

One consistent tell is in hair. The most obvious manifestation is how long hair splits and merges back into itself (as at 0:27).

AI hair often doesn't follow proper "form" and looks like overcomplicated, random tufts that can clash and overlap. It might not be obvious on a first glance, but you can learn to tell the difference pretty quickly.

Re: How an AI Anime Is Created

#26
What I love about this post showing is that it admits up front that the quality of a given entertainment medium is in the writing.

Staff writers are not respected and treated as less than in Hollywood.

Yet the classics of any given medium have emotionally resonating entertainment medium have unique or paradigm-shifting results on audiences, and the medium itself (novel, comic book, TV show, miniseries, film, video game) has influence, but ultimately, it's the writing that is the single most important element of an entertainment IP's value.

An entertainment product that makes you feel emotions beyond boredom is doing its job. True crime/horror bring emotions of fear, mystery, and danger. Sci-Fi/Fantasy bring wonder, curiosity, and discovery, with genre-specific forms of each of those emotions. Mysteries and thrillers bring, well, mysteries and thrills.

So a slice of life AI anime, if it can properly portray from its writing a sense of growing mutual trust, awkwardness of growing up, combined with hope for a better tomorrow, it will have done its job as an entertainment product.

I'm procrastinating working on a fantasy novel which I started in 2012 and need to finish it. It has to hold up in today's neon flashing lights tiktok world as a book. But then there's no reason I couldn't use AI tools to direct adaptations of the source material to an anime or manga or TV show or web series.

Do I wish I could hire and pay and create an anime with a dedicated studio of practitioners who are pros and passionate about the medium beyond my wildest dreams? Sure! Is that likely to happen in 100 million lifetimes? Nope! So if I want to have my IP appear as an anime or TV show, my only realistic option with my one life on earth would be to try to do a similar process to how this animation studio works.

Bravo for them for advancing the medium for this, to find what works and what doesn't. Maybe some day if I will just finish my actual novel and get it eviscerated, after I've figured out how much it will take to pay Michael Kramer and Kate Reading to do an audiobook for it, I can find wild business success such that I could commission an anime series for the IP as my creative vision directs, and have humans do the interesting parts, and let the AIs do the boring inbetweens and tedium work.

But until then, I'll be keeping an eye on aventos to see where they go with this potential.

Re: How an AI Anime Is Created

#27
post #4

> [we did this so anime production companies would] pay the employees(artists) better I mean, has pay gone up in other fields where AI has taken over a lot of jobs? In any case, I think the reason pay is awful in anime is the same reason as in gamedev: if people get into it for passion, the companies can pay less and still have employees.

[deleted]

Re: How an AI Anime Is Created

#28
"Better pay for artists" by replacing as much art production as possible with AI prompting is the most insane canard I've heard in a long time.

The whole "AI is trash at writing (my job), but for the audio/visual stuff (their job) it's a great cost-saver!" thing is just...beneath contempt.

Goes to show human review doesn't amount to anything if the reviewer is blind to the flaws they're supposed to catch, whether they're going over video gens or a self-aggrandizing puff piece.

Re: How an AI Anime Is Created

#29
post #19

I wonder if it would be better to work on models thst can produce the 3D scenes in Blender that can be rendered to an anime style. That technique is already common, but if you could get AI to generate it in that format you could more easily ammend issues in the output or more easily add artistic direction, detail and the human touch.

Agree 100%, once you get things into 3D with a camera the possibilities open up, and it's very on-trend anyway.

Family Guy's Korea team famously did this early on. So did some major animes like Trigun (surprisingly early).

With Genshin Impact / Honkai Star Rail, I think the trend of "anime in 3D" is only intensifying anyway, and that's totally aside from your mentioned use case of just making it easier to automate shots and transitions to perfect fidelity without AI artifacting.

Re: How an AI Anime Is Created

#30
post #16

I must admit, the short sample for “How Asians Pay the Bill” was kinda fun :)

Thank you, its unfortunate that it performed terribly on social media, otherwise I wouldve loved to continue making this sort of content

Oh well back to making 'I got isekaid to a medival time period with a cheat skill and harem'

Post reply on HN