Live data from Hacker News

Show HN: HN Trends - like Google Trends, but for Hacker News

hntrends.jerodsanto.net

31–40 of 110 posts

Re: Show HN: HN Trends - like Google Trends, but for Hacker News

#32

These trends are fairly interesting... http://hntrends.jerodsanto.net/?q=pg http://hntrends.jerodsanto.net/?q=y+combinator http://hntrends.jerodsanto.net/?q=pg%2C+tptacek%2C+patio11%2... http://hntrends.jerodsanto.net/?q=2007%2C+2008%2C+2009%2C+20... http://hntrends.jerodsanto.net/?q=android%2C+iphone vs. http://www.google.com/trends?q=android%2C+iphone&ctab=0&... http://hntrends.jerodsanto.net/?q=show+hn%2C+ask+hn%2…

I was surprised to learn that the search API returns hits on usernames when they appear outside of the post/comment content.

I'm looking now to see if there's an easy way to filter around it. I've also been emailing with one of the ThriftDB guys and I'll ask him as well.

If not, it'd be very difficult to filter those out because I'm not currently (nor would I want to) retrieving all the matching items, just the number of hits.

Re: Show HN: HN Trends - like Google Trends, but for Hacker News

#33

These trends are fairly interesting... http://hntrends.jerodsanto.net/?q=pg http://hntrends.jerodsanto.net/?q=y+combinator http://hntrends.jerodsanto.net/?q=pg%2C+tptacek%2C+patio11%2... http://hntrends.jerodsanto.net/?q=2007%2C+2008%2C+2009%2C+20... http://hntrends.jerodsanto.net/?q=android%2C+iphone vs. http://www.google.com/trends?q=android%2C+iphone&ctab=0&... http://hntrends.jerodsanto.net/?q=show+hn%2C+ask+hn%2…

I was surprised to learn that the search API returns hits on usernames when they appear outside of the post/comment content. I'm looking now to see if there's an easy way to filter around it. I've also been emailing with one of the ThriftDB guys and I'll ask him as well. If not, it'd be very difficult to filter those out because I'm not currently (nor would I want to) retrieving all the matching items, just the numbe…

Oh yes, I forgot you were using the HNSearch API. By the way, I hope you win the API Contest (don't they decide tomorrow?). You for sure get my vote!

Re: Show HN: HN Trends - like Google Trends, but for Hacker News

#34

Earlier quoted context omitted.

I was surprised to learn that the search API returns hits on usernames when they appear outside of the post/comment content. I'm looking now to see if there's an easy way to filter around it. I've also been emailing with one of the ThriftDB guys and I'll ask him as well. If not, it'd be very difficult to filter those out because I'm not currently (nor would I want to) retrieving all the matching items, just the numbe…

Oh yes, I forgot you were using the HNSearch API. By the way, I hope you win the API Contest (don't they decide tomorrow?). You for sure get my vote!

Awesome, thanks! The voting starts tomorrow. Do come back and participate ;)

Re: Show HN: HN Trends - like Google Trends, but for Hacker News

#35

http://hntrends.jerodsanto.net/?q=ruby%2Cpython http://hntrends.jerodsanto.net/?q=rails%2Cdjango Interesting that Ruby stays below Python but Rails stays well above Django.

There are similar metrics for job openings. It seems plausible that Python is becoming an all-purpose language while the focus for Rails / Ruby is on web apps. If true, this would be reminiscent of Perl v. PHP.

Re: Show HN: HN Trends - like Google Trends, but for Hacker News

#36
post #15

Earlier quoted context omitted.

Came to say exactly this. The chart seems to start (by default anyway) at the beginning of 2007. I'm guessing the user-base and thus activity of HN has increased considerably since then. So yes it would be good to be able to re-normalise in some way. By the number of registered users would probably be the simplest. By number of comments posted would be another, by number of submissions or even number of words would a…

It uses submission titles AND comments. How would you suggest going about normalization?

In that case I would do it by number of submissions (posts) + number of comments for each period (3 months I think, looking at your graphs?). I would normalised all quarters to the last complete quarter.

So if say in q1 2011 there were 1m posts + comments, and in q1 2007 10k, multiply the count for q1 2007 by 100.

It would be truly great to have this normalisation optional, e.g option to normalise by comment+post count and maybe also normalise by number of users (could be an interesting comparison). And perhaps have them super-imposed on each other!

Re: Show HN: HN Trends - like Google Trends, but for Hacker News

#38
post #28

Earlier quoted context omitted.

Strange, I didn't expect the search API to return results for a name that's in the by-line of a comment, but it sure does: http://www.hnsearch.com/search#request/comments&q=pvilch... This is something I should definitely work around in the future. Thanks for bring it to my attention!

You can exclude authors by setting the weight to 0 in your API call: &weights[username]=0.0

Perfect, will do. Thanks!
Post reply on HN