Live data from Hacker News

How an AI Anime Is Created

aventos.dev

31–40 of 48 posts

Re: How an AI Anime Is Created

#31
> When we choose a story, or write one ourselves, we always have to think about the consumer.

I really am getting to a point with this stuff that all I can say is "OK".

I don't think people will ever be fans of aventos or the media it throws out to the world. Calling the people looking to enjoy something you made "consumers" might be one thing to change, but fundementally you've stripped away everything interesting about yourselves as artists. I have no argument that will be convincing to you, but I just can't imagine anyone caring too deeply. I hope you enjoy doing this for your own sake and good luck with whatever.

Re: How an AI Anime Is Created

#32

It's weird how consistent the 'ai art style' is for each medium. You really only need a glance at the right frame in these to know immediately. ( https://www.aventos.dev/our-work ) Not looking for errors or anything, just style. The ramen one is markedly subtler about it than the others at least. I always assumed this was due to people using 'default' styling by not specifying anything in particular, but these people…

The vast majority of anime has a very similar style, which is why it's immediately recognisable as such; AI has picked an average of that.

Re: How an AI Anime Is Created

#33

Earlier quoted context omitted.

https://www.aventos.dev/our-work dunno, I've seen worse and some of the scenes if you asked me if it was AI or not I probably couldn't tell you. most egregious thing I saw was at the 27 second mark where the girl is inside the table. At the current level of tech it feels like it would be a pretty dull full length Anime, and hard to squeeze all the bugs out but for something shorter like a commercial or FMVs for like…

0:19 - the bowl has soup in it, despite coming from the middle of the stack. 0:19 - [same time] several bowls are just sloppified, e.g., having two bottoms 0:45 - last of the soup phases out the bottom of the bowl Continuity errors with the smock. (Is there a logo on the pocket, or no? Does it have a pocket?) ("How Asians Pay for the Bill" … what a title) 0:29 - a water drop drops off the ice cube and falls to the ne…

I watched the whole thing and didn’t notice anything off, other than soup moving a bit weirdly. But if no one had told me it was AI, then I’d think that’s just the animation style. Then I read the list of tells and oh ok, now I can see a little of it if I pause at just the right time and replay it a few times. But who watches anime like that? I think it’s good enough for the vast majority of people, who would enjoy it at first, then later find out it’s AI, and hate it because that’s the cool thing to do.

Re: How an AI Anime Is Created

#35
post #28

"Better pay for artists" by replacing as much art production as possible with AI prompting is the most insane canard I've heard in a long time. The whole "AI is trash at writing (my job), but for the audio/visual stuff (their job) it's a great cost-saver!" thing is just...beneath contempt. Goes to show human review doesn't amount to anything if the reviewer is blind to the flaws they're supposed to catch, whether the…

Indeed. Is there a word or phrase where the outcome of your actions is the exact opposite of your stated goal or motivation?

Closest I can think of is destroying the village to save it, and I think that's very much the territory we're in here.

Re: How an AI Anime Is Created

#36
post #33

Earlier quoted context omitted.

0:19 - the bowl has soup in it, despite coming from the middle of the stack. 0:19 - [same time] several bowls are just sloppified, e.g., having two bottoms 0:45 - last of the soup phases out the bottom of the bowl Continuity errors with the smock. (Is there a logo on the pocket, or no? Does it have a pocket?) ("How Asians Pay for the Bill" … what a title) 0:29 - a water drop drops off the ice cube and falls to the ne…

I watched the whole thing and didn’t notice anything off, other than soup moving a bit weirdly. But if no one had told me it was AI, then I’d think that’s just the animation style. Then I read the list of tells and oh ok, now I can see a little of it if I pause at just the right time and replay it a few times. But who watches anime like that? I think it’s good enough for the vast majority of people, who would enjoy i…

So, yes, some of this I'd've missed if I hadn't been combing over it quite as finely. But not all of it.

But in particular, the cut of the bowl stack being spilled … that scene in particular makes no sense. The entire physics of it should feel wrong because they are wrong. In the same way that CGI animations and/or games get more realistic looking the closer they simulate physics, so too does animation: if a character drops a bowl (in a setting with gravity), then it must act so, and animators know this and render it as such. Yes, and AI will try to predict it, but it strikes me akin to trying to perform a computation in screen space that must be performed in 3D space.

The soup also feels wrong, and it only takes a second rewatch to determine why; the shot feels non-committal, because it is: are we ladling, are we pouring, is the soup phasing out the bottom?

The best animators out there, to me, reward you for watching harder. Small things that make sense in the context of what you're seeing, but aren't necessary. The more you look, the more detail there is to the scene. I'd offer Frieren as an example here. For example, in E21 (the episode where Frieren breaks the barrier during the test): the episode starts when Flamme brings Frieren before Serie; this occurs hundreds, if not more than a millennia, prior to the main events. We see Serie in a temple. Later, when Frieren breaks the barrier, we see Serie remark: "This is why I will never retire."; the same temple, but now the walls are worn with time. This is made somewhat apparent, as there's a fade to denote the passage of the time. (Less apparent is there is allegedly a one or two frame shot of Serie, whose barrier it is, overlaid in the spell Frieren casts to break it. It's visible if you watch it, but not really intelligible.) As another example, the timeskip in E1 has her visiting the same shop twice, and the aging of the shop keeper & shop is visible. It's not just the same shop, it's from the same angle, specifically so that we the viewer can understand it to be the same shop. It's not required for the plot, but it builds out a richer story. As a final example, E17, Fern comes in from the cold & touches Stark on the face ("You're a monster!", Stark screams.) Later, when Fern falls ill, Stark tries to wake Frieren, who is by this point notorious for sleeping too long. Stark wakes her by touching her face, to which Frieren responds, "You're a monster." (Honestly Frieren is one of those animes that's probably so littered with these things that I'm missing like 80% of them.) But good animations make detailed choices all the way down to that level: as far as the plot cares, Stark only needs to wake Frieren, but he wakes her in the particular way that makes sense for the character we've built.

But in AI pieces, the detail is just never there, because when it's "wall in background", there's so many walls, in so many backgrounds, all muddled up in the training data.

Frieren's earrings are actually somewhat similar to the smock comment: her earrings are visually consistent throughout the entire anime, not merely a few shots. (Again, this is an example that's rich in detail, too: chronologically earlier shots of Frieren notably lack the earrings, which is made possible to notice by their consistency & distinctiveness when they're present in the first place. We're probably to presume she acquires them at some yet unrevealed point, and the visual similarity to her teacher Flamme's jewelery also leaves the viewer to wonder if they're related. But it's that choice, that these two sets of accessories appear similar, that allows us to build that connection. It's also the sort of thing that leaves me wondering "how long were the writers planning?!")

(I'd also offer the soundtrack as something that I don't know that AI can ever reach. The song "Knife to the Throat" gives me chills if I play it in my mind. But it's harder to demonstrate detail and thematic elements in a musical piece, I think. An a musical example, I'd offer "Pink Pony Club": the opening notes to which are a musical allusion to "I Will Survive". The notes are chosen intentionally, as a specific reference (one thematically relevant to the song), to set a specific tone and setting for the song that is to come, and you need to know the reference and the history and context it exists in, to be able to appreciate it.)

Re: How an AI Anime Is Created

#37
post #8

The end result[1] looks quite impressive! The animation feels like it's quite high quality--very smooth. However, some things seem off: bad lip sync, minor animation errors, discontinuous scene-to-scene feel. Given that these are supposed to be their best examples, meant as advertisements, I would guess these errors are hard to fix using only the models. So my verdict is that AI-only anime is still not there yet (alt…

As the quality of each scene might someday surpass the budget of entire shows, anime can be infinitely more animated and creating something new in the process. What would a “multi-billion-dollar” episode look like? Hope we find out soon. Exciting times.

The problem with ai is that it's extremely good at front loading everything. Sure it can make a scene, but can it make 20 scenes that are coherent? Can it follow human prompt for story? Or do you prompt and hope the result is like you wanted? Which leads to inevitably settling for something you did not.

Re: How an AI Anime Is Created

#38

> One, fans here actually get to make anime in the US. Instead of needing to fly to Japan, speak Japanese, and preferably be Japanese to break into the industry. Does this come off as wildly tone deaf to anybody else? "We love your product and what you do, but could we get it without associating with or paying you in any way?" > ...Smaller and faster means more financially feasible so we can give better wages for art…

> Does this come off as wildly tone deaf to anybody else? "We love your product and what you do, but could we get it without associating with or paying you in any way?"

Like Japan with cars, electronics, etc?

Re: How an AI Anime Is Created

#39

It's weird how consistent the 'ai art style' is for each medium. You really only need a glance at the right frame in these to know immediately. ( https://www.aventos.dev/our-work ) Not looking for errors or anything, just style. The ramen one is markedly subtler about it than the others at least. I always assumed this was due to people using 'default' styling by not specifying anything in particular, but these people…

The vast majority of anime has a very similar style, which is why it's immediately recognisable as such; AI has picked an average of that.

The majority of anime, at least the Japanese ones, do resemble each other a lot at times, but the AI anime style resembles none of them. It has this distinct style that makes it recognizable as AI art. It is more similar to the style used in illustrations, like the ones you see in many gacha games. And the same style is used even for AI generated comics and illustrations. I think that was the grandparent poster was trying to say when writing "consistent in every medium".

That said, AI is pretty good for creating goofy stuff that otherwise won't sell to the mainstream audiences. My recent favourite AI anime is Chemical Cooker Ryo.

Re: How an AI Anime Is Created

#40
post #16

I must admit, the short sample for “How Asians Pay the Bill” was kinda fun :)

Thank you, its unfortunate that it performed terribly on social media, otherwise I wouldve loved to continue making this sort of content Oh well back to making 'I got isekaid to a medival time period with a cheat skill and harem'

Frankly, it sounds like you are being a bit short-sighted with the whole endeavour.

The lowered production costs enabled by AI should to a degree insulate you from the usual financial risks, and should allow you to be more authentic. It might seem risky to make niche content, but I think it could help attract a real initial audience, never underestimate the demand for true authenticity.

It might sound strange talking about authenticity when it comes to AI, but I do agree with your perspective, that it can empower creative thinkers to produce content with real authorial intent directly, and without the compromises inherent to large production teams.

You seem to be operating like a corporate production company with large costs that needs to appeal to the lowest common denominator to get ROI, but you are doing it without the benefits of the higher production budgets.

You are wasting your advantage. Do the things they cannot afford to do because they are too risky or too niche. If you say that AI allows you to empower your writers, don't waste their talents on brainless content!

Post reply on HN