Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Dank Learning: Generating Memes Using Deep Neural Networks

arxiv.org

Post reply on HN
Print view View original

31–38 of 38 posts

Re: Dank Learning: Generating Memes Using Deep Neural Networks

#31

Post by minimaxir »

fixermark wrote: post #26
minimaxir wrote: post #17

As someone who has spent a lot of time working with text-generating neural networks ( https://github.com/minimaxir/textgenrnn ), I have a few quick comments. 1) The input dataset from Memegenerator is a bit weird. More importantly, it does not distinctly identify top and bottom texts (some have a capital letter to signifify the start of the bottom text, which isn't always true). A good technique when encoding text fo…

Question: This is one of the pieces of neural nets that has always seemed completely opaque voodoo to me. What estimating are you doing to suggest a 512-cell LSTM could stand to be swapped out with a 256-cell bidirectional? What constraints are you optimizing for?

Not a constraint per se, but having too big of a neural network (or any statistical model) can cause it to overfit and generalize poorly; of course, generalizing better is a good objective for text generation.

You can use 512-cell LSTMs if you have a lot of text, though.

Re: Dank Learning: Generating Memes Using Deep Neural Networks

#32

Post by dsfyu404ed »

jwilk wrote: post #28
ekianjo wrote: post #9

Earlier quoted context omitted.

Pretty unfunny results.

"I should buy a boat" and "blackjack and hookers" image macros usually require external context to be understood. So you can't even tell if they're funny or not. The other generated images are just dumb.

I at least chuckled at the "I'm not racist, I'm just a hipster". That said, I'm not a hipster so it doesn't personally insult me and I don't see how the image is at all relevant to the text.

Re: Dank Learning: Generating Memes Using Deep Neural Networks

#34

Post by brian-armstrong »

Xyzodiac wrote: post #33

I was expecting this to use some formats that aren't from 2012. It would be interesting to see a neural network that could decide text for more complex meme formats that trend on twitter and instagram.

Yeah, I immediately looked for a date on this - feels like "neural net generates ancient text using ancient tomes"

Re: Dank Learning: Generating Memes Using Deep Neural Networks

#36

Post by yellowapple »

minimaxir wrote: post #23
stochastic_monk wrote: post #20

Earlier quoted context omitted.

Interestingly, this subreddit is generated by vanilla Markov chains: no neural networks.

I created a similar subreddit which does use neural networks: https://www.reddit.com/r/SubredditNN/

"Why does the sun work?"

"Because that's just how it be sometimes."

Magnificent.

EDIT: apparently human comments are allowed, which might explain why that one fits so well.

Re: Dank Learning: Generating Memes Using Deep Neural Networks

#37

Post by minimaxir »

yellowapple wrote: post #36
minimaxir wrote: post #23

Earlier quoted context omitted.

I created a similar subreddit which does use neural networks: https://www.reddit.com/r/SubredditNN/

"Why does the sun work?" "Because that's just how it be sometimes." Magnificent. EDIT: apparently human comments are allowed, which might explain why that one fits so well.

Yes, that is a human comment (unfortunately, training NNs for comments is a bit cost/time prohibitive)

Re: Dank Learning: Generating Memes Using Deep Neural Networks

#38

Post by typon »

All their generated examples look like Markov chain generated captions. Pretty random and generally unfunny. I completely disagree with the claim that you can't differentiate between these generated memes and real memes. None of these would make the front page of reddit, for example.
Post reply on HN