Live data from Hacker News

Yt-dlp: Upcoming new requirements for YouTube downloads

github.com

521–530 of 635 posts

Re: Yt-dlp: Upcoming new requirements for YouTube downloads

#521

Earlier quoted context omitted.

fortunately it is now easier than ever to do small-scale scraping, the kind yt-dlp does. I can literally just go write a script that uses headless firefox + mitmproxy in about an hour or two of fiddling, and as long as I then don't go try to run it from 100 VPS's and scrape their entire website in a huge blast, I can typically archive whatever content I actually care about. Basically no matter what protection mechani…

> fortunately it is now easier than ever to do small-scale scraping, the kind yt-dlp does. this is absolutely not the case. I've been web scraping since 00s and you could just curl any html or selenium the browser for simple automation but now it's incredibly complex and expensive even with modern tools like playwright and all of the monthly "undetectable" flavors of it. Headless browsers are laughably easy to detect…

+1

I made a web scraper in Perl a few years ago. It no longer works because I need a headless browser now or whatever it is called these days.

Web scraping is MUCH WORSE TODAY[1].

[1] I am not yelling, just emphasizing. :)

Re: Yt-dlp: Upcoming new requirements for YouTube downloads

#522

This is very related to a talk I did last year [1]. "Part 2: youtube-dl" starts at 18:21. It dips toes into an analysis about software that fundamentally depends on ongoing human labor to maintain (as compared to, e.g. zlib, which is effectively "done" for all intents and purposes). More concretely, the additional Deno dependency is quite problematic for my music player, especially after I did all that work to get a…

> introduce Rust as a build dependency

https://news.ycombinator.com/item?id=45314055

Just like git! This is the present and future. :(

Re: Yt-dlp: Upcoming new requirements for YouTube downloads

#523
post #4

Can anyone explain specifically what the YT code does that the existing python interpreter is unusable and apparently quickjs takes 20 minutes to run it? Is it just a lot of CPU-bound code and the modern JIT runtimes are simply that much faster, or is it doing some trickery that deno optimizes well?

YouTube is mining cry- I mean, running some unknown highly obfuscated CPU-demanding JS code on your machine - and using its results to decide whether to permit or deny video downloads. The enshittification will continue until user morale improves.

And at the same time we are against websites mining crypto. At this point they could do that, too...

Re: Yt-dlp: Upcoming new requirements for YouTube downloads

#524

TIL that you can run frontend Javascript with a package like Deno. I thought you need a proper headless browser for it.

I think you only need something like `jsdom` to have the core API available. The DOM itself is just a tree structure with special nodes. Most APIs are optional and you can provide stubs if you're targeting a specific websites. It's not POSIX level.

I would like to know more about this. I had some web scrapers in Perl but they no longer work. :(

Re: Yt-dlp: Upcoming new requirements for YouTube downloads

#525
post #94

Just the other day there was a story posted on hn[0][1] that said YouTube secretly wants downloaders to work. It's it's always been very apparent that YouTube are doing _just enough_ to stop downloads while also supporting a global audience of 3 billion users. If the world all had modern iPhones or Android devices you'd bet they'd straight up DRM all content [0] https://windowsread.me/p/best-youtube-downloaders [1] h…

That conspiracy theory never even made sense to me. Why would anyone think that a payment and ad-supported content platform secretly wants their content to be leaked through ad and payment free means?

I agree, all I can think of is that durely alot of commentary YouTubers rely on YouTube downloaders to use fair-use snippets of other people's videos in their commentary videos?

Re: Yt-dlp: Upcoming new requirements for YouTube downloads

#526
post #64
post #9

I’m a paying YouTube premium subscriber. Last weekend, I wanted to download something so I can watch it on my way in the train. The app got stuck at “waiting for download..” on my iPad. Same on iPhone. Restart did not work. I gave up after an hour (30 mins hands on trying stuff, 30 mins waiting for it to fix itself). Downloaded the video using yt-dlp, transferred it to my USB c flash drive, and watched it from that.…

I'm also a premium subscriber, and have struggled with the same issues on the iPad app. I try to keep some shows downloaded for my toddler, and the download feature never seems to work on the first try. I finally got so fed up, I bought a Samsung Galaxy Tab A7 off ebay for $50 and flashed it with LineageOS. I can now load whatever media I want onto the 1 TB sdcard I've installed in it. The 5 year old hardware plays v…

Use Tubular, which is basically NewPipe with Sponsorblock. (And has really nice Android Auto support which I learned after a while)

Re: Yt-dlp: Upcoming new requirements for YouTube downloads

#527

Days of just getting data off the web are coming to an end as everything requires a full browser running thousands of lines of obfuscated js code now. So instead of a website giving me that 1kb json that could be cached now I start a full browser stack and transmit 10 megabytes through 100 requests, messing up your analytics and security profile and everyone's a loser. Yay.

Not only that, but soon it will require age verification and device attestation. Just in case you're trying to watch something you're not supposed to.

Re: Yt-dlp: Upcoming new requirements for YouTube downloads

#528

The length Youtube have gone to make it impossible to download videos. At the same time, Tiktok allows anyone to download a video with just right click

Nah, the uploader can turn that off if they want, which they tend to do on any popular video. I've resorted to screen recording, but even that is blockable with the (bullshit, shouldn't exist). "can't screenshot this due to security" API that exists on mobile operating systems now

Re: Yt-dlp: Upcoming new requirements for YouTube downloads

#529

Earlier quoted context omitted.

NewPipe is incredible. If Google ever stops signing apps like that, I'll be switching to a Linux phone.

as soon as they have a map app that works with car play i'm switching to linux phone.

There are boxes you plug to your CarPlay enabled car that run Android. Run Google Maps on that and you're golden. No need to carry/connect your phone to the car anymore

Re: Yt-dlp: Upcoming new requirements for YouTube downloads

#530
post #9

I’m a paying YouTube premium subscriber. Last weekend, I wanted to download something so I can watch it on my way in the train. The app got stuck at “waiting for download..” on my iPad. Same on iPhone. Restart did not work. I gave up after an hour (30 mins hands on trying stuff, 30 mins waiting for it to fix itself). Downloaded the video using yt-dlp, transferred it to my USB c flash drive, and watched it from that.…

ReVanced and other alternatives exist. So long as they are broadcasting media to the public without an explicit login system, so as to take advantage of public access for exposure, it will remain perfectly legitimate and ethical to access the content through whatever browser or software you want. After they blitzed me with ads and started arbitrarily changing features and degrading the experience, I stopped paying th…

> ReVanced and other alternatives exist.

until next year, when google will require real name and address for dev of side loaded apps

Post reply on HN