Live data from Hacker News

Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks

junyanz.github.io

51–60 of 146 posts

Re: Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks

#51
very very cool. One thing I noticed that with image to image translation tasks the output tends to be a bit "organic" looking, like the photo to map example. With photographic output it's not noticeable, but it's very jarring for graphical output.

I wonder if there is a way to fix this, possibly by stacking another GAN on top?

Re: Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks

#52

I've only recently started reading about deep neural networks, and the thing that strikes me the most about the literature is the lack of mathematics . Open a NIPS paper from 2010 or so, and you'll see extremely dense mathematics: nonparametrics, variational approximation, sampling theory, riemannian geometry. But from my (admittedly small) sampling of the convnet / RNN literature there really doesn't seem to be much…

I think once the underpinnings were created via math it became questions about what network geometries to use.

We don't have much math I'm aware of that can describe the capabilities of different network configurations from first principles. Even though we constructed the network it feels like we're back to the beginnings of science with this one.

Let's change this and see what happens.

Re: Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks

#53
post #35

Earlier quoted context omitted.

So... photoshop?

I think beyond photoshop - more like the ability to seamlessly insert or "imagine" situations that never occurred in real life. For instance, imagine if you could feed in a ton of images of person A - then a ton of images of porn - then have the system imagine a porn scene. ...or a drug-usage scene. ...or any other thing you could think up. It's even possible this could be pushed into a generated movie. You could eve…

I've seen some work on using GANs to generate 3D models from single images, but the results aren't particularly high-quality yet.[0]

[0]http://3dgan.csail.mit.edu/

Re: Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks

#54
This style transfer idea, though eye candy and sometimes impressive, seems to be the core application of deep learning these days. François Chollet tweeted something like that two years ago about the prisma app (yes it was 2015). He back then anticipated many other killer apps behind the corner but it seems not much had materialized. It's 2017 now and people are still super excited about yet another style transfer network. I'm not even sure where this would be practically useful, aside from being yet another photoshop/instagram filter. Am I the only one skeptical about this?

Re: Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks

#55
post #52

I've only recently started reading about deep neural networks, and the thing that strikes me the most about the literature is the lack of mathematics . Open a NIPS paper from 2010 or so, and you'll see extremely dense mathematics: nonparametrics, variational approximation, sampling theory, riemannian geometry. But from my (admittedly small) sampling of the convnet / RNN literature there really doesn't seem to be much…

I think once the underpinnings were created via math it became questions about what network geometries to use. We don't have much math I'm aware of that can describe the capabilities of different network configurations from first principles. Even though we constructed the network it feels like we're back to the beginnings of science with this one. Let's change this and see what happens.

The thing is, the underpinnings have been there for decades. The convnet was invented in the '90s. The only thing that's changed is the availability of data and processing power.

Re: Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks

#56
post #23

While this is undoubtedly very impressive, I think it's just another logical step to what we've been seeing so far: - In the past, you needed to have a pianist at home to perform you a song, with the music box and then the phonograph you don't need to hire anyone anymore. It's probably not as good as a live performance (maybe?), but it's good enough for many people, and much much cheaper, faster, and available. - You…

https://news.ycombinator.com/item?id=11452026

Re: Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks

#57
post #31
post #23

While this is undoubtedly very impressive, I think it's just another logical step to what we've been seeing so far: - In the past, you needed to have a pianist at home to perform you a song, with the music box and then the phonograph you don't need to hire anyone anymore. It's probably not as good as a live performance (maybe?), but it's good enough for many people, and much much cheaper, faster, and available. - You…

The next step would be to have it actually turned into an actual canvas rendering, with the texture and such of actual paint. Could probably be done using 3d printer technology, inkjet, and/or robotics in some manner... ...in fact, I know you can already get photos printed to canvas - but taking it to the next stage of texture would be amazing - right now, I think the best you can get is to have a trained person "hig…

What for? Really, honest question. If you look at it as an achievement of technology, then it's fine. But if you look at it as real thing from real person, then it's fake.

Re: Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks

#58

TIL - remap green pixels to grey/white and you go from summer to a contrived notion of winter. This done easily in Photoshop. - select green pixels, smooth it a bit, then paint white over it.. - apply a blue cast on it https://s17.postimg.org/q68dz04sf/test.jpg

I'm still up in the air on how much of this is an amazing breakthrough in cognitive image manipulation and how much is a parlor trick. It is very cool, but the scope seems a little too narrow in their examples.

Me too.. in the example where they showed conversion of Yosemite valley from winter to summer - How did they know to make the grass yellow instead of green? Did they index a lot of pics of yosemite valley sufficiently to assume the valley's grass is more often yellow than green?

Re: Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks

#59

TIL - remap green pixels to grey/white and you go from summer to a contrived notion of winter. This done easily in Photoshop. - select green pixels, smooth it a bit, then paint white over it.. - apply a blue cast on it https://s17.postimg.org/q68dz04sf/test.jpg

It's a lot cheaper to get an ai to do it than a person.

I'm demonstrating that it doesn't require AI. It's all procedural. A script with https://www.imagemagick.org/script/index.php . would suffice.

Re: Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks

#60
post #52

Earlier quoted context omitted.

I think once the underpinnings were created via math it became questions about what network geometries to use. We don't have much math I'm aware of that can describe the capabilities of different network configurations from first principles. Even though we constructed the network it feels like we're back to the beginnings of science with this one. Let's change this and see what happens.

The thing is, the underpinnings have been there for decades. The convnet was invented in the '90s. The only thing that's changed is the availability of data and processing power.

ConvNet was indeed invented a long time ago. But a lot of things have changed since then other than data and processing power. There have been new development in optimizers, non linearities, architectures, loss functions and theoretical understanding.
Post reply on HN