Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: GitHub News, using a peak detection algorithm to detect trending repos

gitlogs.com

Post reply on HN
Print view View original

1–10 of 32 posts

Re: Show HN: GitHub News, using a peak detection algorithm to detect trending repos

#2

Post by zthomas »

Developer here, I subscribe to Github's official weekly newsletter and various other ones but always found that they did a poor job at highlighting what's trending. The "top trending" repos always seem to be most established projects like Bootstrap or ReactJs.

I'm using a peak detection algorithm to find which repos are spiking in traffic and rank the uptrend based on a normalized growth curve. This filters out all the well established repos and actually uncovers new trends and launches. Hope you guys find it useful!

Some notable features, there's also a better interface to search topics on github as well as a curated topics section: http://www.gitlogs.com/resource-guides http://www.gitlogs.com/search

Appreciate any feedback,

Re: Show HN: GitHub News, using a peak detection algorithm to detect trending repos

#5

Post by zthomas »

rmason wrote: post #3

If this allowed you to filter by language it would be infinitely more interesting.

You can do that in the search function right now, in the future I'll add it to the news section as well. http://www.gitlogs.com/most_popular?from=2016-03-03&language...

Re: Show HN: GitHub News, using a peak detection algorithm to detect trending repos

#7

Post by ecesena »

I can recommend you to "split" your stream of repos in multiple streams [1], and then create a function to merge multiple streams into a single one.

This way you can gain: 1. detect spikes in less popular streams, and decide via the merging function how to compare them to spikes in popular streams. 2. personalization, where each user can potentially get its own stream combining the categories she's interested in.

[1] e.g., by language as also suggested elsewhere, by "category" if you can come up with some definition, potentially by source (e.g. big company) as well.

Re: Show HN: GitHub News, using a peak detection algorithm to detect trending repos

#9

Post by zthomas »

Etheryte wrote: post #8

Cool concept, would love to see graphs over weekly/monthly timespans or something like that.

Thanks, I actually did build something like that. My original inspiration was Google Trends (thus the UI) but the data wasn't very useful, traffic on github is very spiky, even on a log graph it didn't look good.

Re: Show HN: GitHub News, using a peak detection algorithm to detect trending repos

#10

Post by dc2 »

Rate Limit Reached:

You have reached the Github anonymous user limit, please login with your Github account to continue.

Oof. I was just scrolling down the front page.

---

Edit: After I signed in, I got a bit lower, then got the same message again (telling me to sign in)!

Make / break suggestion: File the stats on a local server. Don't expect the user to query Github or you're going to drop fans fast.

Post reply on HN