Live data from Hacker News

Find out how many users/repos Github has by a simple search

github.com

11–20 of 30 posts

Re: Find out how many users/repos Github has by a simple search

#13

So now you could scrape the name of every GitHub user and their email if it is public.

Oh they rate limit and only allow access to the first 100 pages of results. Well that is that idea out of the window :P You could probably get around 7000 of them max, barely a scratch.

Re: Find out how many users/repos Github has by a simple search

#14

Sorting by "Least recently joined" is interesting. The GitHub team are all there, naturally, but I'm intrigued what "tater" is about. Yehuda Katz is famously user ID 4 but tater shows up as user 611789 through the API. Other than that, the first 10 pages or so are a real who's who of the Ruby scene in 2007-2008 :-)

Is a dog.

https://github.com/blog/794-tater-is-a-githubber

Re: Find out how many users/repos Github has by a simple search

#15
post #2

In case this gets broken anytime soon, I see: Repositories: 4,236,263 Code: 962,748,183 Issues: 5,952,195 Users: 4,472,663

At this time (4:48 AM EST, 2013-10-11), minutes after Hacker News changed the parent comment's timestamp from "1 hour ago" to "2 hours ago", these are the updated values: Repositories: 4,236,957 Code: 962,598,538 Issues: 5,953,084 Users: 4,473,412 So in a space of time probably equal to either 1.5 hours or 2 hours, the numbers changed by these amounts: Repositories: +694 Code: -149,645 Issues: +889 Users: +749

Repositories: 4,237,352

Code: 962,617,133

Issues: 5,953,624

Users: 4,473,778

Re: Find out how many users/repos Github has by a simple search

#18

So now you could scrape the name of every GitHub user and their email if it is public.

Oh they rate limit and only allow access to the first 100 pages of results. Well that is that idea out of the window :P You could probably get around 7000 of them max, barely a scratch.

It'd take you about 48 days :) When I checked that ID of the most recent user was 5663608. The github API will give you 5000 hits an hour if you authenticate your requests. You'd have a load of "not founds" but working up from 1 to 5663608 would get you every public user (no private accounts or banned / deleted).

5663608 / 5000 = just under 48 days worth of non stop API harrasment... maybe that explains why github keeps going down, someone is already trying this out :P

Re: Find out how many users/repos Github has by a simple search

#19
post #15

Earlier quoted context omitted.

At this time (4:48 AM EST, 2013-10-11), minutes after Hacker News changed the parent comment's timestamp from "1 hour ago" to "2 hours ago", these are the updated values: Repositories: 4,236,957 Code: 962,598,538 Issues: 5,953,084 Users: 4,473,412 So in a space of time probably equal to either 1.5 hours or 2 hours, the numbers changed by these amounts: Repositories: +694 Code: -149,645 Issues: +889 Users: +749

Repositories: 4,237,352 Code: 962,617,133 Issues: 5,953,624 Users: 4,473,778

Repositories: 4,237,870


Code: 962,651,473


Issues: 5,954,482


Users: 4,474,320

Post reply on HN