Earlier quoted context omitted.
why use the API? why not just use git to get the code? All you need the API for is repository discovery
I'm gonna guess that Microsoft GitHub (tm) would shut you down pretty quickly if you tried to clone tens or hundreds of thousands of repos in a short window of time, b/c of course that's sketchy/abusive use of their infrastructure, right? But of course if the data is already sitting in object storage inside your cloud environment and all you have to do is run some MapReduce jobs to get at it... Hence: unfair, anticom…
ArchiveTeam has a distributed Github archive project[0]. It's unclear what the status is right now. It seems like a worthwhile idea.
[0] https://wiki.archiveteam.org/index.php/GitHub#Archive_Team_p...