Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Using Doc2Vec to Suggest SubReddits

reddit2vec.com

Post reply on HN
Print view View original

11–14 of 14 posts

Re: Using Doc2Vec to Suggest SubReddits

#11

Post by jmportilla »

utunga wrote: post #5

Hi! Great work. I guess my question is - do you use 'averaging' of word vectors or the Chinese Restaurant process - to get to sub reddit vectors. You describe the Chinese Restaurant process as a "more sophisticated method" that you "can" use, but in my experiments with word2vec and reddit ( https://github.com/utunga/gensimred ) I quickly discovered that simple averaging just does not work. Averaging has this awful 'r…

I used the gensim Doc2Vec implementation. You can check out some of the source code here: https://github.com/jmportilla/Reddit2Vec

Re: Using Doc2Vec to Suggest SubReddits

#12

Post by jmportilla »

Yadi wrote: post #4

Awesome seeing someone use the reddit dataset :)! Wouldn't a w2v as a recommender for the user might have been better? Taking user's comments/likes/subreddits as a feature.

I think your thinking of just a classic collaborative filtering recommendation system.A simple w2v system would take into account all words, then have to be filtered by words that are equal to subreddits. Although, I may have misunderstood your suggestion.

Re: Using Doc2Vec to Suggest SubReddits

#14

Post by utunga »

jmportilla wrote: post #11
utunga wrote: post #5

Hi! Great work. I guess my question is - do you use 'averaging' of word vectors or the Chinese Restaurant process - to get to sub reddit vectors. You describe the Chinese Restaurant process as a "more sophisticated method" that you "can" use, but in my experiments with word2vec and reddit ( https://github.com/utunga/gensimred ) I quickly discovered that simple averaging just does not work. Averaging has this awful 'r…

I used the gensim Doc2Vec implementation. You can check out some of the source code here: https://github.com/jmportilla/Reddit2Vec

Hi... Thanks for that. Awesome and much appreciated.
Post reply on HN