It should also be appreciated that it comes with code and a short blog post.
The relativistic discriminator: a key element missing from standard GAN
21–30 of 33 posts
Re: The relativistic discriminator: a key element missing from standard GAN
#22This is just confusing misuse of the word "relativistic", being based as it is on _relative_ probability and having little to do with philosophical relativism and nothing to do with physics relativity.
It is not quite relative but regularised by another GAN...
Re: The relativistic discriminator: a key element missing from standard GAN
#23Interesting, especially the performance on bigger images, and it looks like a low-effort modification of many standard GAN losses. Seriously, I want to give this a try right now. What do GAN researchers think about this paper? It should also be appreciated that it comes with code and a short blog post.
Re: The relativistic discriminator: a key element missing from standard GAN
#24Re: The relativistic discriminator: a key element missing from standard GAN
#25Same guy who wrote this has another post called Deep learning with cats[1] which has a great open source repo[2] with multiple GANs. 1. https://ajolicoeur.wordpress.com/cats/ 2. https://github.com/AlexiaJM/Deep-learning-with-cats
Re: The relativistic discriminator: a key element missing from standard GAN
#26what 'computer scientist' uses wordpress for their blog. Though, I don't have a blog, so...
I don't see any sense in attacking the credibility by the choice of the blogging infrastructure - the author wanted to convey a message, present his findings and he achieved that. This should be the only thing that counts. I guess the best (even if in a totally opposite field) argument against opinionated choice of web-technologies would be the website of Berkshire Hathaway [1]. They invest in highly sophisticated co…
Re: The relativistic discriminator: a key element missing from standard GAN
#27Re: The relativistic discriminator: a key element missing from standard GAN
#28Re: The relativistic discriminator: a key element missing from standard GAN
#29This is just confusing misuse of the word "relativistic", being based as it is on _relative_ probability and having little to do with philosophical relativism and nothing to do with physics relativity.
Many of the words used by the machine learning community are gratuitously unrelated to what they mean in other fields. If you hear a ML person use a term and you don't know the ML meaning, you probably need to ask for clarification.
Re: The relativistic discriminator: a key element missing from standard GAN
#30Earlier quoted context omitted.
It's not even probability in standard GAN is it? Since you are taking the difference before the sigmoid. It can't really be interpreted as probability until it the range is clamped. Critic's difference or Critical Difference would be a better term perhaps.
It's logits or log odds or the logarithm of the odds, i.e. log(odds(p)) = log(p / (1 - p)): https://en.wikipedia.org/wiki/Logit Since sigmoid(C(x_r)) = p(x_r is real) and C(x_f) = p(x_f is real), the sigmoid of the difference expresses some probability that that x_r looks more real than x_f or vice versa (depending on whether it is C(x_r) - C(x_f) or C(x_f) - C(x_r)). Not sure whether there is a probabilistic interpr…