Live data from Hacker News

Getting 10TB of GitHub logs and extracting details of all users and repositories

trickest.com

11–20 of 61 posts

Re: Getting 10TB of GitHub logs and extracting details of all users and repositories

#11
post #9
post #8

Earlier quoted context omitted.

I have a GitHub account under my real name, but recently I've started using GitHub under a couple of other names instead. There's so much stuff you do in public on GitHub that I want to avoid people doing exactly this kind of analysis on. I wish using multiple identities was at least some level of foolproof though. I have to be careful to configure my local copies of repos to use the correct username, masked email, a…

Private repos are still off limits for this sort of analysis correct?

Microsoft owns github so draw your own conclusions on whether that's true and how long it will last if it is.

Re: Getting 10TB of GitHub logs and extracting details of all users and repositories

#12
post #11
post #9

Earlier quoted context omitted.

Private repos are still off limits for this sort of analysis correct?

Microsoft owns github so draw your own conclusions on whether that's true and how long it will last if it is.

[flagged]

Re: Getting 10TB of GitHub logs and extracting details of all users and repositories

#14
post #9
post #8

Earlier quoted context omitted.

I have a GitHub account under my real name, but recently I've started using GitHub under a couple of other names instead. There's so much stuff you do in public on GitHub that I want to avoid people doing exactly this kind of analysis on. I wish using multiple identities was at least some level of foolproof though. I have to be careful to configure my local copies of repos to use the correct username, masked email, a…

Private repos are still off limits for this sort of analysis correct?

They should be, but those aren't a solution for anything where you want to share, collaborate, or even just ask questions on.

Re: Getting 10TB of GitHub logs and extracting details of all users and repositories

#15
post #7
post #2

[flagged]

IMHO it's in the guidelines "Please don't complain about tangential annoyances—e.g. article or website formats, name collisions, or back-button breakage. They're too common to be interesting." https://news.ycombinator.com/newsguidelines.html

did not know about this part of the guidelines, thanks.

a while back I was thinking about creating an extension that deals with this issue but I've heard some browsers are already working on that.

Re: Getting 10TB of GitHub logs and extracting details of all users and repositories

#16
post #8

I'm a big fan of neat statistical analyses, but when I look at the archive site https://www.gharchive.org/ , the overwhelming feeling I have is "creeped out". Taking periodic snapshots of repositories and their issues and wikis sounds good, but do we really need a log of every time someone watches an issue, and every commit message being irrevocably set on public record? That level of details on individual activity s…

I have a GitHub account under my real name, but recently I've started using GitHub under a couple of other names instead. There's so much stuff you do in public on GitHub that I want to avoid people doing exactly this kind of analysis on. I wish using multiple identities was at least some level of foolproof though. I have to be careful to configure my local copies of repos to use the correct username, masked email, a…

You can have includeIf sections in your .gitconfig that applies only to things within a certain directory. So you if you create top level directories in your $HOME for your various identities, all you need to do is to make sure you are cloning into and working within the appropriate directory hierarchy.

Re: Getting 10TB of GitHub logs and extracting details of all users and repositories

#17
post #8

I'm a big fan of neat statistical analyses, but when I look at the archive site https://www.gharchive.org/ , the overwhelming feeling I have is "creeped out". Taking periodic snapshots of repositories and their issues and wikis sounds good, but do we really need a log of every time someone watches an issue, and every commit message being irrevocably set on public record? That level of details on individual activity s…

I have a GitHub account under my real name, but recently I've started using GitHub under a couple of other names instead. There's so much stuff you do in public on GitHub that I want to avoid people doing exactly this kind of analysis on. I wish using multiple identities was at least some level of foolproof though. I have to be careful to configure my local copies of repos to use the correct username, masked email, a…

note that this is technically against their TOS if not using paid accounts:

> One person or legal entity may maintain no more than one free Account (if you choose to control a machine account as well, that's fine, but it can only be used for running a machine)

https://docs.github.com/en/site-policy/github-terms/github-t...

Re: Getting 10TB of GitHub logs and extracting details of all users and repositories

#18

I'm a big fan of neat statistical analyses, but when I look at the archive site https://www.gharchive.org/ , the overwhelming feeling I have is "creeped out". Taking periodic snapshots of repositories and their issues and wikis sounds good, but do we really need a log of every time someone watches an issue, and every commit message being irrevocably set on public record? That level of details on individual activity s…

Since people can't behave and come up with "business models" like this, sites will have to become subscription-only.

Re: Getting 10TB of GitHub logs and extracting details of all users and repositories

#19

I'm a big fan of neat statistical analyses, but when I look at the archive site https://www.gharchive.org/ , the overwhelming feeling I have is "creeped out". Taking periodic snapshots of repositories and their issues and wikis sounds good, but do we really need a log of every time someone watches an issue, and every commit message being irrevocably set on public record? That level of details on individual activity s…

Is this even GDPR compliant ?

Re: Getting 10TB of GitHub logs and extracting details of all users and repositories

#20
post #17
post #8

Earlier quoted context omitted.

I have a GitHub account under my real name, but recently I've started using GitHub under a couple of other names instead. There's so much stuff you do in public on GitHub that I want to avoid people doing exactly this kind of analysis on. I wish using multiple identities was at least some level of foolproof though. I have to be careful to configure my local copies of repos to use the correct username, masked email, a…

note that this is technically against their TOS if not using paid accounts: > One person or legal entity may maintain no more than one free Account (if you choose to control a machine account as well, that's fine, but it can only be used for running a machine) https://docs.github.com/en/site-policy/github-terms/github-t...

internet would be better with total anonymity.
Post reply on HN