Live data from Hacker News

How we built Tagger News: machine learning on a tight schedule

varianceexplained.org

1–9 of 9 posts

Re: How we built Tagger News: machine learning on a tight schedule

#2
Link to original HN submission: https://news.ycombinator.com/item?id=14337275

It's worth noting for future reference that in terms of supervised learning of labels given a text document input, fasttext (https://github.com/facebookresearch/fastText) is leagues ahead of conventional approaches in both accuracy and training speed, and there is a Python interface (https://github.com/salestock/fastText.py) for use with Django/Flask (unfortunately, recent fasttext changes have broken the interface for now).

Re: How we built Tagger News: machine learning on a tight schedule

#3

Link to original HN submission: https://news.ycombinator.com/item?id=14337275 It's worth noting for future reference that in terms of supervised learning of labels given a text document input, fasttext ( https://github.com/facebookresearch/fastText ) is leagues ahead of conventional approaches in both accuracy and training speed, and there is a Python interface ( https://github.com/salestock/fastText.py ) for use wit…

Can you suggest any unsupervised learning? I want to take a body of text associated with users and come up with keywords/topics with each user. Thanks! :)

Re: How we built Tagger News: machine learning on a tight schedule

#4
post #3

Link to original HN submission: https://news.ycombinator.com/item?id=14337275 It's worth noting for future reference that in terms of supervised learning of labels given a text document input, fasttext ( https://github.com/facebookresearch/fastText ) is leagues ahead of conventional approaches in both accuracy and training speed, and there is a Python interface ( https://github.com/salestock/fastText.py ) for use wit…

Can you suggest any unsupervised learning? I want to take a body of text associated with users and come up with keywords/topics with each user. Thanks! :)

Some fairly widely-used techniques include LSI, LDA, and word2vec or doc2vec. There a lot of different techniques out there! I'm one of the creators of Tagger News, and we used LDA with python's Gensim package. Here's a good tutorial: https://radimrehurek.com/gensim/tut2.html

Re: How we built Tagger News: machine learning on a tight schedule

#5
post #4
post #3

Earlier quoted context omitted.

Can you suggest any unsupervised learning? I want to take a body of text associated with users and come up with keywords/topics with each user. Thanks! :)

Some fairly widely-used techniques include LSI, LDA, and word2vec or doc2vec. There a lot of different techniques out there! I'm one of the creators of Tagger News, and we used LDA with python's Gensim package. Here's a good tutorial: https://radimrehurek.com/gensim/tut2.html

Note that fasttext is the next generation of word2vec/doc2vec, and shares many of the same creators.

Re: How we built Tagger News: machine learning on a tight schedule

#6

Link to original HN submission: https://news.ycombinator.com/item?id=14337275 It's worth noting for future reference that in terms of supervised learning of labels given a text document input, fasttext ( https://github.com/facebookresearch/fastText ) is leagues ahead of conventional approaches in both accuracy and training speed, and there is a Python interface ( https://github.com/salestock/fastText.py ) for use wit…

How does fasttext compare to vowpal wabbit?

Re: How we built Tagger News: machine learning on a tight schedule

#7

Link to original HN submission: https://news.ycombinator.com/item?id=14337275 It's worth noting for future reference that in terms of supervised learning of labels given a text document input, fasttext ( https://github.com/facebookresearch/fastText ) is leagues ahead of conventional approaches in both accuracy and training speed, and there is a Python interface ( https://github.com/salestock/fastText.py ) for use wit…

How does fasttext compare to vowpal wabbit?

Basically the same [1,2].

[1]: https://twitter.com/yoavgo/status/751178795323908096

[2]: https://nlpers.blogspot.com/2016/08/fast-easy-baseline-text-...

Re: How we built Tagger News: machine learning on a tight schedule

#9

Link to original HN submission: https://news.ycombinator.com/item?id=14337275 It's worth noting for future reference that in terms of supervised learning of labels given a text document input, fasttext ( https://github.com/facebookresearch/fastText ) is leagues ahead of conventional approaches in both accuracy and training speed, and there is a Python interface ( https://github.com/salestock/fastText.py ) for use wit…

How does fasttext compare to vowpal wabbit?

Vowpal wabbit is approx. 4-8x faster than gensim but the accuracy will be less compared to gensim.