Live data from Hacker News

YouTube-DL Gitlab Backup Repository

gitlab.com

11–20 of 37 posts

Re: YouTube-DL Gitlab Backup Repository

#11
post #6
post #4

Curious in general how often Youtube breaks things on their end, i.e. how long roughly this specific version of youtube-dl is expected to keep working without any active development?

git pull the repo, cd into it, and do `git log --follow -- youtube_dl/extractor/youtube.py`.

Thanks. That would indicate roughly 2 months or so...

Re: YouTube-DL Gitlab Backup Repository

#12
post #8
post #3

Gitlab is not immune to DMCA notices either since it's a US company. The RIAA probably won't try to take it down unless the youtube-dl development is actually relocated there or they become aware of it somehow. You'd have to host it in a country where DMCA can safely be ignored (anonymously of course), e.g. the Netherlands or Russia, if you want it to stay up reliably.

Gitee.com is a popular Chinese alternative. I'm pretty sure it'd be safe there.

China has extremely strict anti-scraping laws [1] so pointing out that youtube-dl is a tool that can be used to illegally scrape copyrighted data is likely to have the same effect as a DMCA takedown request with the same justification.

[1] a collection of cases: https://github.com/HiddenStrawberry/Crawler_Illegal_Cases_In...

Re: YouTube-DL Gitlab Backup Repository

#13
While this situation is a reason to look more closely at GitLab due to the ability to host your own instance, why not also look at a solution like Fossile: DVCS, wiki, and issue tracker all in a cross-platform, single executable file?

https://fossil-scm.org/home/doc/trunk/www/index.wiki

Re: YouTube-DL Gitlab Backup Repository

#14
post #13

While this situation is a reason to look more closely at GitLab due to the ability to host your own instance, why not also look at a solution like Fossile: DVCS, wiki, and issue tracker all in a cross-platform, single executable file? https://fossil-scm.org/home/doc/trunk/www/index.wiki

Also created by the same person as SQLite. The repo itself is a SQLite database. It's an alternative to git, not just to GitHub:

https://www.fossil-scm.org/home/doc/trunk/www/fossil-v-git.w...

Re: YouTube-DL Gitlab Backup Repository

#15
post #8

Earlier quoted context omitted.

Gitee.com is a popular Chinese alternative. I'm pretty sure it'd be safe there.

I don't think so. Youtube-DL can rip some popular Chinese VOD websites such as Bilibili and iQIYI, thus will first be "subjectable" to the Chinese equivalent of DMCA. Worse, these companies are often backed/protected by powerful figures (often under the umbrella of some influential state members) and under such power, these kind of "threats" will be eradicated very efficiently, especially with Bilibili which is parti…

It's hilarious how people on this site reacts at the mere mention of China on any topic. Everyone is apparently an expert.

Gitee has hosted a youtube-dl mirror for years.

https://gitee.com/mirrors/youtube-dlg

Re: YouTube-DL Gitlab Backup Repository

#16
post #11
post #6

Earlier quoted context omitted.

git pull the repo, cd into it, and do `git log --follow -- youtube_dl/extractor/youtube.py`.

Thanks. That would indicate roughly 2 months or so...

I use youtube-dl fairly infrequently... maybe once a month or so. Nearly every time I used it it would not download the video I wanted - so I'd do a "youtube-dl -u", then it would work.

Just spreading the repo around isn't going to help for very long.

Re: YouTube-DL Gitlab Backup Repository

#17
post #10

How do you verify this isn't malicious? Who is running this repo?

Compare the sha commit hashes of the top commit against the hashes from the old "true" repo. If they match the repo (and the history) has not been changed. Subsequent commits can be manually audited.

Re: YouTube-DL Gitlab Backup Repository

#19
post #18

I made a read-only backup on IPFS in the likely case it gets DMCA'd. git clone https://ipfs.io/ipfs/QmVJ6BtoavbWRJwWH8JmTd5Bf6i3zEzsecnBKTM...

Does it includes issues and open PRs? I think this is the most concerning part about Github: when you move somewhere else you lose important parts of the history of the project (that document known bugs, how features came to be, etc), unless you specifically step up and use some import tool.

There are Git-backed distributed issue trackers like Git-bug https://github.com/MichaelMure/git-bug (and probably other tools) that should be more used.

One could perhaps convert Github issues to git-bug and store on a branch of this IPFS Git repository.

Re: YouTube-DL Gitlab Backup Repository

#20
post #12
post #8

Earlier quoted context omitted.

Gitee.com is a popular Chinese alternative. I'm pretty sure it'd be safe there.

China has extremely strict anti-scraping laws [1] so pointing out that youtube-dl is a tool that can be used to illegally scrape copyrighted data is likely to have the same effect as a DMCA takedown request with the same justification. [1] a collection of cases: https://github.com/HiddenStrawberry/Crawler_Illegal_Cases_In...

> China has extremely strict anti-scraping laws

It might be the case, but the repo you linked doesn't support that claim very well, and the cases cited are largely irrelevant to the case at hand.

"Forbidden area #1: providing scraping-related services to criminal organizations". Three cases listed. The first is one programmer's personal account of being arrested, which is very scant on why; the only info I can glean: "I developed some sort of ML API which is then used by a criminal enterprise against some influential company for god knows what purpose". Hard to draw any conclusion from that. The second case is ML-based CAPTCHA bypass for credential stuffing against Tencent QQ, emphasis on credential stuffing. The third case is some sort of black hat SEO campaign against Baidu, the scraping part (if any?) doesn't seem central to the conviction.

"Forbidden area #2: scraping and sale of personal info". Common sense, irrelevant.

"Forbidden area #3: commercial use of unlicensed business data" and the following untitled category list three cases, all of which are mass scraping operations either from a business competitor or that seriously affects site operations (through aggressive scraping).

AFAIK there are a lot of low hanging fruits in the Chinese piracy scene not yet targeted, and there are enough small-time commercial operations involving copyrighted media products begging to be taken down, it's highly unlikely anyone will bother to target some high-barrier-of-entry tool mostly facilitating the download of otherwise public videos.

Post reply on HN