Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

An algorithm for generating automatic hashtags

blog.swayy.co

Post reply on HN
Print view View original

21–30 of 35 posts

Re: An algorithm for generating automatic hashtags

#21

Post by AnSavvides »

shlomib wrote: post #12
AnSavvides wrote: post #2

Although very basic, this is really nice - the wonders of NLTK! You explain your algorithm in very simple terms so kudos for that. It might be a good idea to put this in a GitHub repository rather than a simple gist maybe? I am sure there will be plenty of people (including myself) interested in contributing, it's much easier doing it on a repository rather than a gist :)

Good idea! Actually I'm thinking about creating some open source “social-NLP” python package. What do you think?

That would be really cool!

Re: An algorithm for generating automatic hashtags

#24

Post by sp332 »

Udo wrote: post #16

I think we - and to some degree the Twitter platform itself - are using hash tags redundantly, and this algorithm is just a manifestation of this redundancy that is killing data quality. These pathological tweets do tend to look like the example sentence provided, maybe even more extreme: #Swayy #Launches Into Public #Beta To Curate #Content For Your #SocialMedia Audience Now, all of these words would be reachable wi…

#Content means you're talking about content, and it's not just a word you used in passing. Similarly, #launches adds your tweet to the conversation people are having about launches, instead of making people sort through missile launches, some guy who launches into a story, and misspelled lunches to get to relevant tweets.

Re: An algorithm for generating automatic hashtags

#25

Post by sp332 »

shlomib wrote: post #9
joosters wrote: post #6

A strange example. Does the author really think hashtagifying the word 'content' has improved the tweet in some way? Do they expect people to be searching Twitter for #content and getting some useful results?

https://twitter.com/search?q=%23Content

Contrast with the un-hashtagged version: https://twitter.com/search?q=content

Re: An algorithm for generating automatic hashtags

#26

Post by shlomib »

louyang wrote: post #23

A friend and I cofounded another content curator also, we do tagging but in a different fashion: http://wintria.com Nice article also, I don't think you guys take enough advantage of the article body though.

Obviously this is NOT the algorithm we use in our product (Swayy)...

Re: An algorithm for generating automatic hashtags

#27

Post by louyang »

shlomib wrote: post #26
louyang wrote: post #23

A friend and I cofounded another content curator also, we do tagging but in a different fashion: http://wintria.com Nice article also, I don't think you guys take enough advantage of the article body though.

Obviously this is NOT the algorithm we use in our product (Swayy)...

I didn't say it was, what was that remark about?

Re: An algorithm for generating automatic hashtags

#30

Post by AznHisoka »

AznHisoka wrote: post #7

For those people who are interested in topic/article classification and NLP, Twitter can a gold-mine, especially hashtags. If you gather the hashtags for a million articles, you pretty much have a co-location database. Now you can mine that data and see which hashtags are common if you have "Google Panda" in your title for instance, or which hash tags are commonly used with #seo. Hashtags are basically structured sem…

Of course, the applications of this go beyond hashtags. You can apply this towards topic classification of content.
Post reply on HN