Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: HN Text Analytics – Check what’s trending on Hacker News

hn.textalytics.io

Post reply on HN
Print view View original

1–10 of 10 posts

Re: Show HN: HN Text Analytics – Check what’s trending on Hacker News

#5

Post by shervinafshar »

If the intention is topic identification, trend monitoring, or sentiment analysis, I would expect a service like this to be able to drop the stopwords or at least report them separately. At the moment, by switching to aggregate data from the last sixty days, these entries are reported which I don't think should be: "all" (10.43%), "only" (6.92%), "because" (9.5%), "when" (7.88%), "even" (7.07%), "has" (10.72%), "which" (10.05%), etc.

Re: Show HN: HN Text Analytics – Check what’s trending on Hacker News

#6

Post by jacktucker »

shervinafshar wrote: post #5

If the intention is topic identification, trend monitoring, or sentiment analysis, I would expect a service like this to be able to drop the stopwords or at least report them separately. At the moment, by switching to aggregate data from the last sixty days, these entries are reported which I don't think should be: "all" (10.43%), "only" (6.92%), "because" (9.5%), "when" (7.88%), "even" (7.07%), "has" (10.72%), "whic…

Totally agree. Currently, the algorithm fails at times to drop stopwords which are not significant when trying to understand topics or trends. Should be able to quickly remove stopwords specifically since they are in a standard list. Thank you for the feedback.
Post reply on HN