Emoji and Deep Learning

This is cool, even if it seems kind of frivolous. Word embeddings work for emoji just like they do for actual words, and it's neat to see an idea for how to commercialize that directly.

I wish they had explained details, such as what two-dimensional non-linear projection they're using for their map.

I also don't see it fully explained how they're getting representations of sequences of emoji. They explain how their RNN handles sequences of input words, but the result of that is a vector that they're comparing to their emoji-embedding space. Does the emoji-embedding space contain embeddings of specific sequences as well?

Re: Emoji and Deep Learning

#7

Post by wxs » Thu, Jun 09, 2016, 5:40 PM UTC

rspeer wrote: post #6

This is cool, even if it seems kind of frivolous. Word embeddings work for emoji just like they do for actual words, and it's neat to see an idea for how to commercialize that directly. I wish they had explained details, such as what two-dimensional non-linear projection they're using for their map. I also don't see it fully explained how they're getting representations of sequences of emoji. They explain how their R…

We use t-SNE for the projection! We do mention it somewhere in there. Could maybe be more clear

The sequences of emoji we ended up glossing over here (difficult balance making these concepts as accessible as possible). In the app we can beam search to predict combos, just as you would in sequence to sequence learning. That's not demo'd on the live website though.

Re: Emoji and Deep Learning

#8

Post by wxs » Thu, Jun 09, 2016, 5:47 PM UTC

jderick wrote: post #5

Can it generate sequences of emoji that is has not seen before?

Yes it can, language models can generate phrases that have not been seen before. Karpathy's RNN post is a pretty good intro to how that works http://karpathy.github.io/2015/05/21/rnn-effectiveness/

Re: Emoji and Deep Learning

#9

Post by wxs » Thu, Jun 09, 2016, 5:48 PM UTC

thomasfoster96 wrote: post #3

mnkmnk wrote: post #2

>IBM uses them for operationalizing business unit synergies What does this mean?

I'm inclined towards thinking that it might be a joke.

;)

Re: Emoji and Deep Learning

#10

Post by sherjilozair » Thu, Jun 09, 2016, 5:56 PM UTC

The real question is, where do you get this training data from?