Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Style2Paints: AI colorization of images

github.com

Post reply on HN
Print view View original

21–30 of 51 posts

Re: Style2Paints: AI colorization of images

#21

Post by icebraining »

mistercow wrote: post #7
awesomepantsm wrote: post #5

Earlier quoted context omitted.

This is the result of the brightest minds working on advertising. Who do you think made TensorFlow? Hint: it was Google.

I think there's a legitimate point to be made that it's a shame that the best way we've found to coordinate our resources to advance science and technology is capitalism. It's not like capitalism doesn't work, but if you envision a sort of "coordination oracle" which divides up resources ideally, and which everyone magically trusts, it seems pretty obvious that we would be advancing much more quickly. But I also agre…

if you envision a sort of "coordination oracle" which divides up resources ideally

Except not everyone agrees on what is ideal, and therefore such an oracle is impossible even as a limit to be approached.

Re: Style2Paints: AI colorization of images

#22

Post by anon203597 »

myrryr wrote: post #15

This is amazing. Do you think it would be possible to keep the coloring constant across an animation? If so, you will certainly have a market for this. The coloring work in animation take a lot of time and is very expensive.

Similar work on art style transfer usually has yielded somewhat surreal shifting results when they applied it to videos even after adding some logic that stabilized things from frame to frame.

Plus this is far from perfect, it works best if you provide a lot of hinting and even then it produces results that may look pleasing enough but are not really close to what one has intended for a particular character design.

I would guess that it can be made good enough for some novelty videos but it's still far from professional production quality.

Re: Style2Paints: AI colorization of images

#23

Post by julius »

myrryr wrote: post #15

This is amazing. Do you think it would be possible to keep the coloring constant across an animation? If so, you will certainly have a market for this. The coloring work in animation take a lot of time and is very expensive.

Interesting. It would be amazing if you could find the time, to elaborate, share some insights into this industry.

Specifically: What are 2-3 major companies that would profit? How does the current process work; do they make an entire uncolored scene and then color it? What do I have to google, to find example videos of uncolored animation? Can you ballpark how much it costs to color a 30min TV-Episode?

Re: Style2Paints: AI colorization of images

#24

Post by anon203597 »

julius wrote: post #23
myrryr wrote: post #15

This is amazing. Do you think it would be possible to keep the coloring constant across an animation? If so, you will certainly have a market for this. The coloring work in animation take a lot of time and is very expensive.

Interesting. It would be amazing if you could find the time, to elaborate, share some insights into this industry. Specifically: What are 2-3 major companies that would profit? How does the current process work; do they make an entire uncolored scene and then color it? What do I have to google, to find example videos of uncolored animation? Can you ballpark how much it costs to color a 30min TV-Episode?

> What do I have to google, to find example videos of uncolored animation?

key animation, genga (原画)

uncolored: https://sakugabooru.com/post/show/23064

finished: https://sakugabooru.com/post/show/23126

> How does the current process work;

This depends a lot on the production process used. These days it's anything between hand drawn frames with digital coloring to completely digital processes using 2D vector graphics or 3D models.

Re: Style2Paints: AI colorization of images

#25

Post by imaginenore »

amelius wrote: post #16
imaginenore wrote: post #11

Earlier quoted context omitted.

What's creepy about them?

I suppose the images look creepy because of the combination of young age with poses and looks that are not usually associated with girls of such young age.

What's their age and what posses are not associated with that age?

Re: Style2Paints: AI colorization of images

#26

Post by icebraining »

amelius wrote: post #16
imaginenore wrote: post #11

Earlier quoted context omitted.

What's creepy about them?

I suppose the images look creepy because of the combination of young age with poses and looks that are not usually associated with girls of such young age.

What's absurd is determining the age in the first place. It's hard enough to do it reliably by looking at photos of Japanese Idols, let alone of heavily stylized characters.

Re: Style2Paints: AI colorization of images

#27

Post by Mithaldu »

bencollier49 wrote: post #14

I was thinking of trying it on something less Anime, and then noticed that another poster didn't like the original poster's subject-matter, so I ran it on this: https://imgur.com/a/z00jG Not bad? I guess?

Hm, i wouldn't say that's usefully different from anime? The failure mode for e.g. pencil sketches is honestly kind of impressive. https://i.imgur.com/vdceynO.png https://i.imgur.com/2lvrpwE.png

On the other hand: https://i.imgur.com/QkFDOVs.png

Edit: Also, i missed this earlier, but this video shows nicely how the AI can be guided with color hints: https://www.bilibili.com/video/av14443094/

Re: Style2Paints: AI colorization of images

#29

Post by Houshalter »

Jack000 wrote: post #9
mistercow wrote: post #7

Earlier quoted context omitted.

I think there's a legitimate point to be made that it's a shame that the best way we've found to coordinate our resources to advance science and technology is capitalism. It's not like capitalism doesn't work, but if you envision a sort of "coordination oracle" which divides up resources ideally, and which everyone magically trusts, it seems pretty obvious that we would be advancing much more quickly. But I also agre…

Capitalism = greedy optimization with a Bayesian assumption. It tends to get stuck in local maxima and does weird things when the inputs are biased, but otherwise works ok. There are almost certainly better ways to search the solution space, but most serious attempts attempts thus far have been non-sensical or impractical.

No one objects that capitalism isn't a good optimization processes. Just that it's optimizing the wrong utility function. At one point something like 50% of STEM majors at MIT went to work on wall street. And the ones that don't go there go to work making more efficient targeted advertisements or addictive smartphone games or other unethical shit.

Our population has a limited number of "smart people". I don't think any alien looking in from the outside, would think we are allocating them even remotely efficiently. It would be pretty difficult to design a system that does worse than ours on this aspect.

The solution isn't necessarily communism, but perhaps a hybrid. E.g. the government funds things capitalism has no incentive to optimize for, like scientific research.

Re: Style2Paints: AI colorization of images

#30

Post by mrmondo »

amelius wrote: post #16
imaginenore wrote: post #11

Earlier quoted context omitted.

What's creepy about them?

I suppose the images look creepy because of the combination of young age with poses and looks that are not usually associated with girls of such young age.

Indeed, they seem somewhat hypersexualised for their suggested age or at least hypersensualised to some extent.

Furthermore, and this is purely my opinion of course - they seem a bit... tacky(?) and I must admit if I had opened this link at work I would have been a bit embarrassed if someone cartoons of young girls like this on my display.

Perhaps at least a more diverse range of sketches would be both more relatable and useful to demonstrate the project.

Regardless, I’m not sure what rules of HN I broke to deserve -5 votes for voicing my reaction to a projects landing page.

Post reply on HN