Live data from Hacker News

Dank Learning: Generating Memes Using Deep Neural Networks

arxiv.org

11–20 of 38 posts

Re: Dank Learning: Generating Memes Using Deep Neural Networks

#11
post #8

This is a complete joke, right? What is better about those results than a simple "image + headline + random bottom line" algorithm?

Exactly. Memes are funny because they make meta references that are culturally relevant or simply attach absurd bottom lines. It's highly unlikely a deep neural network can model anything like that.

Re: Dank Learning: Generating Memes Using Deep Neural Networks

#12
post #8

This is a complete joke, right? What is better about those results than a simple "image + headline + random bottom line" algorithm?

Judging from the url posted in an earlier top thread, this might be a student report.

https://web.stanford.edu/class/cs224n/reports/6909159.pdf

Re: Dank Learning: Generating Memes Using Deep Neural Networks

#14
post #8

This is a complete joke, right? What is better about those results than a simple "image + headline + random bottom line" algorithm?

Judging from the url posted in an earlier top thread, this might be a student report. https://web.stanford.edu/class/cs224n/reports/6909159.pdf

I'd put $100 on the researcher coming up with the title and working from there. "Dank Learning"? Come on, it's a meme in itself. That said, worth publishing? Sure it's at the top of HN. Ground breaking results, nah. Though, I admit I am impressed with the applied solution, using deep learning and some apriori direction to derive context from images is neat.

Re: Dank Learning: Generating Memes Using Deep Neural Networks

#17
As someone who has spent a lot of time working with text-generating neural networks (https://github.com/minimaxir/textgenrnn), I have a few quick comments.

1) The input dataset from Memegenerator is a bit weird. More importantly, it does not distinctly identify top and bottom texts (some have a capital letter to signifify the start of the bottom text, which isn't always true). A good technique when encoding text for these types of things is to use a control token (e.g. a newline) to indicate these types of behaviors. (the conclusion notes this problem: "One example would be to train on a dataset that includes the break point in the text between upper and lower for the image. These were chosen manually here and are important for the humor impact of the meme.")

2) The use of GLoVe embeddings don't make as much sense here, even as a base. Generally the embeddings work best on text which follows real-world word usage, which memes do not follow. (in this case, it's better to let the network train the embeddings from scratch)

3) A 512-cell LSTM might be too big for a word-level model of that size; since the text follows rules, a 256-cell Bidirectional might work better.

Re: Dank Learning: Generating Memes Using Deep Neural Networks

#18
post #15

It looks like a joke now but I'm fairly convinced that in the not too distant future the most influential social media accounts will be run by some kind of AI.

Who knows, maybe they already are? I mean I'm confident there's a ton of content farms out there already that just run a cronjob every couple minutes to pluck the top ten images off of a subreddit, checks if they've been published on their own channel yet and republishes them.

If not, I'll brb, need to set up some websites / facebook accounts.

Post reply on HN