Live data from Hacker News

52% of YouTube videos live in 2010 have been deleted

datahorde.org

11–20 of 60 posts

Re: 52% of YouTube videos live in 2010 have been deleted

#11
post #4

Earlier quoted context omitted.

If you’re comfortable in the terminal the following works great for archiving: https://github.com/ytdl-org/youtube-dl

I had issues with youtube severely capping my download speeds using youtube-dl, but had success with https://github.com/yt-dlp/yt-dlp

Doh. This is what I initially wanted to link to in the comment. yt-dlp definitely is the better fork, and they seem to address YouTube breaking changes faster than youtube-dl.

Re: 52% of YouTube videos live in 2010 have been deleted

#12
Would love to crowdsource an effort to buy enough disk space to backup YouTube to the Internet Archive and have ArchiveTeam perform the archival op.

Assuming ~35PB of content stored at YT, should cost roughly $70M for IA to buy the necessary storage infra and maintain it into the future (their costs are ~$2/GB for perpetual storage).

Re: 52% of YouTube videos live in 2010 have been deleted

#13

It's probably time to start saving the videos you like if you haven't already. I still remember when Key and Peele's whole catalog (or a lot of it) was available on youtube back in 2015-2016. For a brief window of time. Some of my favourite songs with 10s of millions of views have been taken down. Many niche videos don't get reuploaded. No guarentees that youtube will keep your unique or exclusive videos publicly ava…

>I still remember when Key and Peele's whole catalog (or a lot of it) was available on youtube back in 2015-2016. For a brief window of time. Is there a lot of stuff missing on Comedy Central? I've discovered them on Youtube(I'm european), it seems like there is a tooon of content from them, is it just a small part of what they did?

Their show also included standup comedy/overarching plots in between the skits that are not available on YouTube

Re: 52% of YouTube videos live in 2010 have been deleted

#14
post #6

Twitter used to provide all Tweets to the Library of Congress for archival, until the library decided it wasn't worth the effort to continue adding that much data. I'm not sure who would be in a position to archive YouTube for the future. Does the Internet Archive make snapshots?

Natively, not to my knowledge. Tooling is available though.

https://github.com/bibanon/tubeup

Re: 52% of YouTube videos live in 2010 have been deleted

#15

Would love to crowdsource an effort to buy enough disk space to backup YouTube to the Internet Archive and have ArchiveTeam perform the archival op. Assuming ~35PB of content stored at YT, should cost roughly $70M for IA to buy the necessary storage infra and maintain it into the future (their costs are ~$2/GB for perpetual storage).

As of 2013, I calculated the YouTube catalog is ~375PB. It's probably closer to 1EB now, if not 2-5x that much.

http://www.autonomoussystem.net/2013/07/youtube-slowness.htm...

Re: 52% of YouTube videos live in 2010 have been deleted

#16

Would love to crowdsource an effort to buy enough disk space to backup YouTube to the Internet Archive and have ArchiveTeam perform the archival op. Assuming ~35PB of content stored at YT, should cost roughly $70M for IA to buy the necessary storage infra and maintain it into the future (their costs are ~$2/GB for perpetual storage).

As of 2013, I calculated the YouTube catalog is ~375PB. It's probably closer to 1EB now, if not 2-5x that much. http://www.autonomoussystem.net/2013/07/youtube-slowness.htm...

Sad trombone.

Re: 52% of YouTube videos live in 2010 have been deleted

#17

Would love to crowdsource an effort to buy enough disk space to backup YouTube to the Internet Archive and have ArchiveTeam perform the archival op. Assuming ~35PB of content stored at YT, should cost roughly $70M for IA to buy the necessary storage infra and maintain it into the future (their costs are ~$2/GB for perpetual storage).

Maybe someone should do a Kickstarter for it ;)

Re: 52% of YouTube videos live in 2010 have been deleted

#18
post #6

Twitter used to provide all Tweets to the Library of Congress for archival, until the library decided it wasn't worth the effort to continue adding that much data. I'm not sure who would be in a position to archive YouTube for the future. Does the Internet Archive make snapshots?

There was something of a brokered agreement between Archive Team/Twitter to upload a fraction of Tweets to the IA. That too, unfortunately, ceased some time last year. Either way you might want to take a look at https://archive.org/details/twitterstream

Re: 52% of YouTube videos live in 2010 have been deleted

#19

Would love to crowdsource an effort to buy enough disk space to backup YouTube to the Internet Archive and have ArchiveTeam perform the archival op. Assuming ~35PB of content stored at YT, should cost roughly $70M for IA to buy the necessary storage infra and maintain it into the future (their costs are ~$2/GB for perpetual storage).

If you've spent any time on YouTube, it's painfully obvious much of it is not worth archiving at all. Clearly if you had some critera to select videos that are worth preserving, this task would become a lot more doable.

But what could those criteria be?

You can't just select out all those fast-talking "influencers" that shill and lie their way through hours worth of video just because they're shit, because sometimes those videos have thousands of people that DO like them, making them perhaps interesting to a sociologist 300 years from now.

2000-year old Roman shopping lists, personal letters and obscene graffiti are intensely interesting to historians now, but would have been worthless to their owners even a couple of days later.

Post reply on HN