Live data from Hacker News

Show HN: Ghuser.io – Complete GitHub profiles

github.com

21–30 of 52 posts

Re: Show HN: Ghuser.io – Complete GitHub profiles

#21

Earlier quoted context omitted.

Isn't 200 requests in an hour ... just three requests per minute? What is this service doing?

Maybe it's cloning all GitHub repos of a user to compute activity?

We don't clone repos. Instead we use GitHub's API to get activity info.

E.g. https://api.github.com/repos/aurelienlourot/ghuser.io/contri...

Re: Show HN: Ghuser.io – Complete GitHub profiles

#22

Earlier quoted context omitted.

Isn't 200 requests in an hour ... just three requests per minute? What is this service doing?

GitHub's API does't provide the exhaustive list of all your contributions. Instead we crawl GitHub's website which is slow. Details at https://github.com/AurelienLourot/github-contribs#how-does-i... We are in talks with GitHub and they know that we are crawling GitHub.

> Instead we crawl GitHub's website which is computationally expensive

I'm surprised to hear that you're bottlenecking on CPU time. Could you verify that my understanding is correct? I would've thought your bottleneck would be networking and connectivity as you have to wait for GitHub to process all of the requests.

Re: Show HN: Ghuser.io – Complete GitHub profiles

#23
Could you make this work for gitlab, bitbucket and maybe even just regular old git repos as well?

It would also be really cool if we could pull out basic private repo info as well (with the user's permission). E.g. Worked on X private repos covering 60% Go, 20% Javascript etc.

I am also a bit confused as to why you would build this if you don't work at github?

Re: Show HN: Ghuser.io – Complete GitHub profiles

#24

Earlier quoted context omitted.

GitHub's API does't provide the exhaustive list of all your contributions. Instead we crawl GitHub's website which is slow. Details at https://github.com/AurelienLourot/github-contribs#how-does-i... We are in talks with GitHub and they know that we are crawling GitHub.

> Instead we crawl GitHub's website which is computationally expensive I'm surprised to hear that you're bottlenecking on CPU time. Could you verify that my understanding is correct? I would've thought your bottleneck would be networking and connectivity as you have to wait for GitHub to process all of the requests.

Looks like they're hitting a GitHub rate limit, rather than bottlenecking on CPU.

Re: Show HN: Ghuser.io – Complete GitHub profiles

#26
post #2

OP here. The idea came because on your GitHub profile: - I can't see all your code contributions since the beginning of time at a glance. - For each of your pinned repos, I can't tell at the first glance whether you just fixed a typo or you wrote 90% of it. ghuser.io tries to close this gap. You can show off with your entire GitHub "portfolio" and it gets refreshed every day. And hopefully this is temporary. The best…

I'm the guy fixing the typos in everybody's README :)

Re: Show HN: Ghuser.io – Complete GitHub profiles

#27
post #2

OP here. The idea came because on your GitHub profile: - I can't see all your code contributions since the beginning of time at a glance. - For each of your pinned repos, I can't tell at the first glance whether you just fixed a typo or you wrote 90% of it. ghuser.io tries to close this gap. You can show off with your entire GitHub "portfolio" and it gets refreshed every day. And hopefully this is temporary. The best…

I'm the guy fixing the typos in everybody's README :)

Hehe :) And this is really useful, I hope my message didn't make it sound like the opposite. (Unfortunately our readme is probably full of typos!)

Re: Show HN: Ghuser.io – Complete GitHub profiles

#28

Could you make this work for gitlab, bitbucket and maybe even just regular old git repos as well? It would also be really cool if we could pull out basic private repo info as well (with the user's permission). E.g. Worked on X private repos covering 60% Go, 20% Javascript etc. I am also a bit confused as to why you would build this if you don't work at github?

> Could you make this work for gitlab, bitbucket and maybe even just regular old git repos as well?"

Yes totally. Although we currently think that the best for the community is GitHub improving their GitHub profiles making ghuser.io obsolete. Right now we'd rather do this with GitHub and not against GitHub. But we don't know how much GitHub is willing to help us. (We need changes to the GitHub APIs for ghuser.io to be scalable.)

> private repo

Yea we could do that as well. Give permission to our public key and we're good to go.

> why you would build this if you don't work at github?

Because Aurelien (OP) wanted/needed that so he just built it.

To the both of us it's basically a fun experiment.

Also for me it's cool because we use the web framework Reframe (https://github.com/reframejs/reframe) which I'm currently building.

Re: Show HN: Ghuser.io – Complete GitHub profiles

#29

Earlier quoted context omitted.

GitHub's API does't provide the exhaustive list of all your contributions. Instead we crawl GitHub's website which is slow. Details at https://github.com/AurelienLourot/github-contribs#how-does-i... We are in talks with GitHub and they know that we are crawling GitHub.

> Instead we crawl GitHub's website which is computationally expensive I'm surprised to hear that you're bottlenecking on CPU time. Could you verify that my understanding is correct? I would've thought your bottleneck would be networking and connectivity as you have to wait for GitHub to process all of the requests.

You're right. I edited my answer.

The GitHub's unofficial API we are using is slow and per IP rate limited. We spin up several servers to have several IPs to circumvent the rate limit.

(GitHub knows that we do that and we are in contact with them.)

Re: Show HN: Ghuser.io – Complete GitHub profiles

#30
post #2

OP here. The idea came because on your GitHub profile: - I can't see all your code contributions since the beginning of time at a glance. - For each of your pinned repos, I can't tell at the first glance whether you just fixed a typo or you wrote 90% of it. ghuser.io tries to close this gap. You can show off with your entire GitHub "portfolio" and it gets refreshed every day. And hopefully this is temporary. The best…

I'm the guy fixing the typos in everybody's README :)

damn it, you've been quicker at it, again...
Post reply on HN