Does this have the ability to bet set to "grab highest available resolution" instead of specifying one? A lot of the material I'd like to archive has material from well before and after Youtube started supporting HD resolutions.
Yark: Advanced and easy YouTube archiver now stable
21–30 of 148 posts
Re: Yark: Advanced and easy YouTube archiver now stable
#22How cool would it be if everyone had IPFS running in their browser, and everyone dedicated some time to filling it with a backup of the internet, including YouTube.
I did some napkin math. If 1 billion people each backed up 10gb, we’d almost have enough to store a copy of YouTube with zero data redundancy. Google is massive.
But most people have more free disk space than 10gb, and most people also have more than 1 device. I have 2 phones, 3 laptops, a desktop and a NAS, with some 40TB between them.
My workplace has a private cloud with some 70PB of storage, plus tape, and tons of desktops and laptops.
Re: Yark: Advanced and easy YouTube archiver now stable
#23How cool would it be if everyone had IPFS running in their browser, and everyone dedicated some time to filling it with a backup of the internet, including YouTube.
I did some napkin math. If 1 billion people each backed up 10gb, we’d almost have enough to store a copy of YouTube with zero data redundancy. Google is massive.
We're currently at around $0.02 per GB, so that would be $0.20 per person. A bargain.
(From a random source on the internet, [1])
[1] https://www.petercai.com/storage-prices-have-sort-of-stopped...
Re: Yark: Advanced and easy YouTube archiver now stable
#24Earlier quoted context omitted.
I did some napkin math. If 1 billion people each backed up 10gb, we’d almost have enough to store a copy of YouTube with zero data redundancy. Google is massive.
But most people have more free disk space than 10gb, and most people also have more than 1 device. I have 2 phones, 3 laptops, a desktop and a NAS, with some 40TB between them. My workplace has a private cloud with some 70PB of storage, plus tape, and tons of desktops and laptops.
a) i seriously doubt your "most" claim about free disk space. Maybe "most privileged white folks in rich countries" but not "most people"
b) just because i HAVE 10Gb of free disk space doesn't mean i'm going to offer it up for archiving of random internet crap
c) if it was on my phone it'd cost money and now we're very actively ignoring just how expensive it is to be online in 3rd world countries if you're not a rich expat.
> My workplace has a private cloud with some 70PB of storage, plus tape, and tons of desktops and laptops.
sure. HOw much of that do you think they'd be willing to contribute, for free to backing up random crap from people on the internet that may or may not be legal and could open them up to litigation because they're not an ISP / platform and thus not protected by the Shield laws?
Re: Yark: Advanced and easy YouTube archiver now stable
#25Does this have the ability to bet set to "grab highest available resolution" instead of specifying one? A lot of the material I'd like to archive has material from well before and after Youtube started supporting HD resolutions.
What if the highest available resolution does not have an audio stream?
Re: Yark: Advanced and easy YouTube archiver now stable
#26How cool would it be if everyone had IPFS running in their browser, and everyone dedicated some time to filling it with a backup of the internet, including YouTube.
I did some napkin math. If 1 billion people each backed up 10gb, we’d almost have enough to store a copy of YouTube with zero data redundancy. Google is massive.
wait, is the total number of videos on YouTube a known number? thats fascinating, i'd love to see your assumptions for napkin math
Re: Yark: Advanced and easy YouTube archiver now stable
#27does anyone have recs on how to run this on a continuous basis in the cloud? this obviously will take a lot more storage than like a normal heroku setup (not that I would use heroku). should i use Railway or Render or is that overkill compared to something else?
gasp can i run it as a github action???
Re: Yark: Advanced and easy YouTube archiver now stable
#28yt-dlp and a batch file that runs via Task Scheduler has been doing this for me for a couple of years now. I also grab the captions and throw that into a database so that I can search transcripts for a clip that I can remember but can't remember which video it's in. It was a fun weekend project.
How do you deal with file numbering?
I prefer the file prefixed with a number that indicates "air date". 01 being the first uploaded video. The default is by index and the top of the channel or playlist is number 01 which is the most recent.
Re: Yark: Advanced and easy YouTube archiver now stable
#29Does this have the ability to bet set to "grab highest available resolution" instead of specifying one? A lot of the material I'd like to archive has material from well before and after Youtube started supporting HD resolutions.
What if the highest available resolution does not have an audio stream?
grab the audio stream from something else and stitch them together with ffmpeg (like youtube-dl and others do)
Re: Yark: Advanced and easy YouTube archiver now stable
#30Bit of a noob question here. What's an archiver for? Is it a library for things you've watched and want to store outside of youtube? Or is this for storing content you've created / managing your own portfolio of content?
Personally, for me it's archiving. In case I want to go back to it. Videos just keep disappearing from YouTube because channels get deleted by YouTube, by their owners, videos get copystriked, geoblocked, privated, and so on. As I'm lazy as f### I didn't create anything as sophisticated as OP, but a simple 10 line PHP Script on my home server that just pretends being Kodi enough to fool yatse (android remote for Kodi…
Great, thanks for the insight!