Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: GitHub News, using a peak detection algorithm to detect trending repos

gitlogs.com

Post reply on HN
Print view View original

11–20 of 32 posts

Re: Show HN: GitHub News, using a peak detection algorithm to detect trending repos

#12

Post by zthomas »

dc2 wrote: post #10

Rate Limit Reached: You have reached the Github anonymous user limit, please login with your Github account to continue. Oof. I was just scrolling down the front page. --- Edit: After I signed in, I got a bit lower, then got the same message again (telling me to sign in)! Make / break suggestion: File the stats on a local server. Don't expect the user to query Github or you're going to drop fans fast.

Hi DC2, actually I do cache some of the results, first 10 days and top 50 repos per day. I think I didn't expect people to scroll as far as they did. I'll up that cache later

Re: Show HN: GitHub News, using a peak detection algorithm to detect trending repos

#13

Post by dc2 »

zthomas wrote: post #12
dc2 wrote: post #10

Rate Limit Reached: You have reached the Github anonymous user limit, please login with your Github account to continue. Oof. I was just scrolling down the front page. --- Edit: After I signed in, I got a bit lower, then got the same message again (telling me to sign in)! Make / break suggestion: File the stats on a local server. Don't expect the user to query Github or you're going to drop fans fast.

Hi DC2, actually I do cache some of the results, first 10 days and top 50 repos per day. I think I didn't expect people to scroll as far as they did. I'll up that cache later

Thanks! I was trying to find my repo, which trended about 15 days ago :)

Otherwise, it looks really good, and the algorithm results are refreshing.

Re: Show HN: GitHub News, using a peak detection algorithm to detect trending repos

#16

Post by zthomas »

skeletonjelly wrote: post #14

gitlogs Where git = github Looks great though! Already found something sweet. Another feature request, can you add an up/down trend indicator? Can I ask which peak detection algorithm you used?

Right now if a repo is trending down (from the moving average) it will have a negative score and won't be showed at all.

The algorithm basically looks at the moving average, the new watchers gained and the number of total watchers. It'll calculate the the rate of change in new watchers and compare that against what it expects given the lifecycle of where the repo is at. So a brand new repo adding 150 stars per day will beat out an established repo that adds 250 stars per day.

Re: Show HN: GitHub News, using a peak detection algorithm to detect trending repos

#17

Post by kovacs »

zthomas wrote: post #2

Developer here, I subscribe to Github's official weekly newsletter and various other ones but always found that they did a poor job at highlighting what's trending. The "top trending" repos always seem to be most established projects like Bootstrap or ReactJs. I'm using a peak detection algorithm to find which repos are spiking in traffic and rank the uptrend based on a normalized growth curve. This filters out all t…

This is awesome. I had the same desire and even told folks at GitHub that improving this report is low hanging fruit. It's been on my list of ideas to hack on for awhile :-)

Ideally you (well, really I :-P) also want star/follow activity from people you follow bundled in any update that's also reporting the projects discovered by your peak detection algorithm over that same period of time. There'd likely be some overlap in the report but you could indicate that in your report. This also gives you more incentive to login with GitHub which is a little lacking right now.

Anyway, thanks for doing this and great job :-)

Re: Show HN: GitHub News, using a peak detection algorithm to detect trending repos

#19

Post by zthomas »

kovacs wrote: post #17
zthomas wrote: post #2

Developer here, I subscribe to Github's official weekly newsletter and various other ones but always found that they did a poor job at highlighting what's trending. The "top trending" repos always seem to be most established projects like Bootstrap or ReactJs. I'm using a peak detection algorithm to find which repos are spiking in traffic and rank the uptrend based on a normalized growth curve. This filters out all t…

This is awesome. I had the same desire and even told folks at GitHub that improving this report is low hanging fruit. It's been on my list of ideas to hack on for awhile :-) Ideally you (well, really I :-P) also want star/follow activity from people you follow bundled in any update that's also reporting the projects discovered by your peak detection algorithm over that same period of time. There'd likely be some over…

Thanks for the feedback, the first thing on my list is definitely more personalization. I just wanted to get it out there and see if people liked it first.

Re: Show HN: GitHub News, using a peak detection algorithm to detect trending repos

#20

Post by zthomas »

guessmyname wrote: post #18

Why does not this works with localStorage disabled?

Hey thanks for the tip, it took me a while to find it but apparently react-router 1.x had an issue https://github.com/reactjs/react-router/issues/1661 and I had to upgrade to react-router 2.x I'll push out a fix soon
Post reply on HN