Live data from Hacker News

Yark: Advanced and easy YouTube archiver now stable

github.com

31–40 of 148 posts

Re: Yark: Advanced and easy YouTube archiver now stable

#31

Bit of a noob question here. What's an archiver for? Is it a library for things you've watched and want to store outside of youtube? Or is this for storing content you've created / managing your own portfolio of content?

There are coded hints in the link, like: > Yark lets you continuously archive all videos and metadata for YouTube channels. You can also view your archive as a seamless offline website

Snarky and not answering the question, well done.

Re: Yark: Advanced and easy YouTube archiver now stable

#32

Does this have the ability to bet set to "grab highest available resolution" instead of specifying one? A lot of the material I'd like to archive has material from well before and after Youtube started supporting HD resolutions.

What if the highest available resolution does not have an audio stream?

Normally in modern adaptive streaming, every video variant is muxed into a separate stream without audio, and different audio variants are muxed into their own individual streams.

Re: Yark: Advanced and easy YouTube archiver now stable

#33

Does this have the ability to bet set to "grab highest available resolution" instead of specifying one? A lot of the material I'd like to archive has material from well before and after Youtube started supporting HD resolutions.

What if the highest available resolution does not have an audio stream?

Only some formats which I guess are to be used with older browsers contain both video and audio. In general, these days video and audio are delivered through separate streams on YouTube.

Re: Yark: Advanced and easy YouTube archiver now stable

#35

yt-dlp and a batch file that runs via Task Scheduler has been doing this for me for a couple of years now. I also grab the captions and throw that into a database so that I can search transcripts for a clip that I can remember but can't remember which video it's in. It was a fun weekend project.

How do you deal with file numbering? I prefer the file prefixed with a number that indicates "air date". 01 being the first uploaded video. The default is by index and the top of the channel or playlist is number 01 which is the most recent.

I just use the publish date in the format of YYYY-MM-DD at the beginning of the filename so that they sort properly.

Re: Yark: Advanced and easy YouTube archiver now stable

#36
Occasionally my personal/literature/academic/tech notes link to a youtube source, but when clicking on it I find the video has vanished with no way of knowing what it was or even what it was called (it's sometimes impossible to track down an identical/replacement source). I lost many valuable references that way.

Wayback machine solves for webpages, but nothing I'm aware of (short of youtube-dl-ing the video yourself and storing it somewhere openly, probably at risk of various infringements) solves this. Quite a lot of hassle for something rather simple.

It would be great to be able to immortalise them on a per-video basis, so if it's important enough, we can be sure that references made to the content will still be there in the future when needed.

Re: Yark: Advanced and easy YouTube archiver now stable

#38

yt-dlp and a batch file that runs via Task Scheduler has been doing this for me for a couple of years now. I also grab the captions and throw that into a database so that I can search transcripts for a clip that I can remember but can't remember which video it's in. It was a fun weekend project.

I run mine with cron and it puts files in a special folder for plex: https://github.com/nburns/utilities/blob/master/youtube.fish

Pulls from my watch later playlist which is quite handy

Re: Yark: Advanced and easy YouTube archiver now stable

#39
I'm a big fan of the historical information that Yark shows.

Arrimus 3D recently replacing a large chunk of their 3D modeling tutorials with religious content was a pretty big lightbulb moment for me that so much of the content I rely on - not just for the initial learning of a new skill, but as a continual reference when I forget something - is so fragile.

I immediately bought a NAS and began backing up everything that I gleam even the tiniest bit of learning from using a similar project, TubeArchivist[0]. Projects like this are really important for maintaining all of the great knowledge on the web.

[0] https://github.com/tubearchivist/tubearchivist

Re: Yark: Advanced and easy YouTube archiver now stable

#40
post #36

Occasionally my personal/literature/academic/tech notes link to a youtube source, but when clicking on it I find the video has vanished with no way of knowing what it was or even what it was called (it's sometimes impossible to track down an identical/replacement source). I lost many valuable references that way. Wayback machine solves for webpages, but nothing I'm aware of (short of youtube-dl-ing the video yourself…

I do not see how that becomes possible without the Internet archive effectively mirroring a large percentage of YouTube. I recall at one point, IA wanted to archive just the video metadata and realized even that would be technically challenging.
Post reply on HN