Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

52% of YouTube videos live in 2010 have been deleted

datahorde.org

Post reply on HN
Print view View original

31–40 of 60 posts

Re: 52% of YouTube videos live in 2010 have been deleted

#31

Post by sterlind »

virtuallynathan wrote: post #15
toomuchtodo wrote: post #12

Would love to crowdsource an effort to buy enough disk space to backup YouTube to the Internet Archive and have ArchiveTeam perform the archival op. Assuming ~35PB of content stored at YT, should cost roughly $70M for IA to buy the necessary storage infra and maintain it into the future (their costs are ~$2/GB for perpetual storage).

As of 2013, I calculated the YouTube catalog is ~375PB. It's probably closer to 1EB now, if not 2-5x that much. http://www.autonomoussystem.net/2013/07/youtube-slowness.htm...

would tape be cheaper? it'd be a lot more annoying to use, but at least you'd have a backup, even if you have to queue a request to access.

Re: 52% of YouTube videos live in 2010 have been deleted

#32

Post by the_biot »

themadprogramer wrote: post #27
the_biot wrote: post #19

Earlier quoted context omitted.

If you've spent any time on YouTube, it's painfully obvious much of it is not worth archiving at all. Clearly if you had some critera to select videos that are worth preserving, this task would become a lot more doable. But what could those criteria be? You can't just select out all those fast-talking "influencers" that shill and lie their way through hours worth of video just because they're shit, because sometimes…

You have to, however, also consider the multi-domainness of YouTube videos. Yeah sure, there's billions of hours of clips not one person can watch in a single life-time. But unlike your 2000-year old Roman shopping lists, we have footage of events that are anchored to a particular time-period. Or location. One of the most impressive things you can do is, try searching up a landmark. My personal favorite is the [Jumpi…

Like so many questions of this type, I think the Internet Archive is the answer. They are not a warehouse of stuff stored on media/formats that are forever becoming obsolete -- they store data, keyed by timestamp, sometimes with metadata. How they store it and serve it up is irrelevant, and they will upgrade as needed (I assume this is a continuous process).

If the IA didn't exist, we'd have to invent it.

I suspect if the IA ever decides to properly archive YouTube, they'll interface with the folks that run it directly. Archive Team is, to put it as diplomatically as I can, not a good organization.

Re: 52% of YouTube videos live in 2010 have been deleted

#33

Post by jjulius »

MrYellowP wrote: post #22
NetBeck wrote: post #20

YouTube is deleting pre-2010 videos, meanwhile anything is still possible at https://www.zombo.com

I've clicked that. There's a circle, with circles around, with something around one of these smaller circles. All of it is spinning. I've managed to click the spinny thingy and it turned into quadratic spinny thingy. That's all. What the fuck? Please explain!

How old are you? It's possible that you may be outside of the generation that would've appreciated it during it's peak.

Re: 52% of YouTube videos live in 2010 have been deleted

#34

Post by booi »

sterlind wrote: post #31
virtuallynathan wrote: post #15

Earlier quoted context omitted.

As of 2013, I calculated the YouTube catalog is ~375PB. It's probably closer to 1EB now, if not 2-5x that much. http://www.autonomoussystem.net/2013/07/youtube-slowness.htm...

would tape be cheaper? it'd be a lot more annoying to use, but at least you'd have a backup, even if you have to queue a request to access.

Tape (~$6/TB) is cheaper than archival storage (~$14/TB) but I'm not sure it's worth the cost of having another "offline" system that needs robots or humans in order to access for rebuilds, maintenance, verification etc.

I'm surprised by how magnetic storage continues to decline in price as densities continue to increase. I wonder where the end actually is.

Re: 52% of YouTube videos live in 2010 have been deleted

#35

Post by willcipriano »

MrYellowP wrote: post #22
NetBeck wrote: post #20

YouTube is deleting pre-2010 videos, meanwhile anything is still possible at https://www.zombo.com

I've clicked that. There's a circle, with circles around, with something around one of these smaller circles. All of it is spinning. I've managed to click the spinny thingy and it turned into quadratic spinny thingy. That's all. What the fuck? Please explain!

It's revolutionary tech, web 5.0 at least, not everyone understands.

Re: 52% of YouTube videos live in 2010 have been deleted

#36

Post by zucked »

whoomp12342 wrote: post #5

aka 52% of youtube from the era where it was fun have been deleted. badger badger badger badger mushROOM MUSSHROOOMM!!

That started as a flash animation, right? So. many. wasted. hours. watching flash animations. It's amazing how quickly flash disappeared after the dominos were set in motion.

Re: 52% of YouTube videos live in 2010 have been deleted

#37

Post by themadprogramer »

the_biot wrote: post #32
themadprogramer wrote: post #27

Earlier quoted context omitted.

You have to, however, also consider the multi-domainness of YouTube videos. Yeah sure, there's billions of hours of clips not one person can watch in a single life-time. But unlike your 2000-year old Roman shopping lists, we have footage of events that are anchored to a particular time-period. Or location. One of the most impressive things you can do is, try searching up a landmark. My personal favorite is the [Jumpi…

Like so many questions of this type, I think the Internet Archive is the answer. They are not a warehouse of stuff stored on media/formats that are forever becoming obsolete -- they store data, keyed by timestamp, sometimes with metadata. How they store it and serve it up is irrelevant, and they will upgrade as needed (I assume this is a continuous process). If the IA didn't exist, we'd have to invent it. I suspect i…

> If the IA didn't exist, we'd have to invent it.

You know, a part of the original company vision for YouTube prior to the Google acquisition was really something akin to the IA, in that they did pride themselves with hosting footage of the Indian Ocean Earthquake:

https://www.youtube.com/results?search_query=Indian+Ocean+ea...

Now, acting as diplomatically as I possibly can, I can say that your suggestions of the IA and YouTube interfacing together were at a previous point in time a continuous process. But a number of factors have made direct cooperation between the IA and Google (thereby YouTube) come to a screeching halt.

At this current point in time, we stand at a historical crossroad. And I'm only here to just act as a humble messenger ;)

Re: 52% of YouTube videos live in 2010 have been deleted

#38

Post by themadprogramer »

zucked wrote: post #36
whoomp12342 wrote: post #5

aka 52% of youtube from the era where it was fun have been deleted. badger badger badger badger mushROOM MUSSHROOOMM!!

That started as a flash animation, right? So. many. wasted. hours. watching flash animations. It's amazing how quickly flash disappeared after the dominos were set in motion.

I guess you can say that it FADED LIKE A FLASH :}

Re: 52% of YouTube videos live in 2010 have been deleted

#39

Post by crmd »

booi wrote: post #34
sterlind wrote: post #31

Earlier quoted context omitted.

would tape be cheaper? it'd be a lot more annoying to use, but at least you'd have a backup, even if you have to queue a request to access.

Tape (~$6/TB) is cheaper than archival storage (~$14/TB) but I'm not sure it's worth the cost of having another "offline" system that needs robots or humans in order to access for rebuilds, maintenance, verification etc. I'm surprised by how magnetic storage continues to decline in price as densities continue to increase. I wonder where the end actually is.

You might be surprised to see the scale of LTO tape consumption by FAANG companies.

Re: 52% of YouTube videos live in 2010 have been deleted

#40

Post by yunohn »

barrysteve wrote: post #3

It's probably time to start saving the videos you like if you haven't already. I still remember when Key and Peele's whole catalog (or a lot of it) was available on youtube back in 2015-2016. For a brief window of time. Some of my favourite songs with 10s of millions of views have been taken down. Many niche videos don't get reuploaded. No guarentees that youtube will keep your unique or exclusive videos publicly ava…

> No guarentees that youtube will keep your unique or exclusive videos publicly available. Every video is fair game for deletion at any moment.

TFA is about reuploads and other kinds of user content, that was not kosher in the first place. These may be deleted by YouTube.

Your examples are about IP and content ownership changing leading to video being removed by the channels themselves. That’s a different problem, not solvable by YT.

Post reply on HN