Live data from Hacker News

Archivists are uploading hundreds of random VHS tapes to the internet

vice.com

51–60 of 129 posts

Re: Archivists are uploading hundreds of random VHS tapes to the internet

#51

Earlier quoted context omitted.

Do what archivists do - copy. The challenge is keeping things accessible. Only copying does that for electronic media. That includes getting things like photos printed.

How many times can you copy digital media before it degrades beyond error correction? I don't know the error rate per copied bit. I think this is an excellent place for neural networks. They can preserve vast amounts of data compactly for many data types because they statistically compress high level abstract data which can then be used to fill in regions with high error rate, although if you did that at a large scal…

> How many times can you copy digital media before it degrades beyond error correction? I don't know the error rate per copied bit.

I am not sure I understand. Isn’t the error rate zero? And wouldn’t you be using checksums to verify perfect copies?

Re: Archivists are uploading hundreds of random VHS tapes to the internet

#54
My father left me several hundred 6 hour VHS tapes. I had no idea what was on them because he'd kept an index, but it was mostly missing.

There was a lot of interesting random stuff on them, mostly from the 80's. The bits of stuff he recorded is like a peek inside his brain :-)

Re: Archivists are uploading hundreds of random VHS tapes to the internet

#55

Earlier quoted context omitted.

If you want data to survive you've always needed to copy it. Digital storage just makes that easier to do in bulk. Copying Bibles was a full time task for huge teams of monks but you can (and should) make backups routinely on a daily or weekly basis with barely a thought.

The LOCKSS project is an approach used in university networks around the world to preserve research data for the long term. https://www.lockss.org/ The big issue isn't the technology, it's the vast amounts of data that are being created at this point. Storage is cheap, but the labor that goes into managing the longevity of datasets isn't: it's essentially continually keeping your infrastructure up-to-date whilst also…

> The downside of that is that your ability to find a specific picture from 5 years ago is entirely restricted to the extent that you were able to organize and add specific metadata to that picture.

I disagree with the premise that we should spend time manually organizing and tagging our pictures all that much.

The metadata that the phone adds to pictures – time stamp and GPS coordinates – is already sufficient in a lot of cases for finding pictures that I look for.

And where that metadata is insufficient, improved search powered by machine learning will come to the rescue. And not just tomorrow but even today.

Just the other day, a few weeks back, I was standing in the kitchen that I share with two other people and I wondered to myself whether the kitchen knife in the dishwasher was mine (I’d bought a new one a few days prior but couldn’t remember what it looked like). I take a lot of picture of random stuff and mundane things, most of which I never bother to organize or tag or anything. I pull up my phone, search my photo library for “knife” and lo and behold, I did take a picture of it when I bought it and my phone has recognized the object in the photo to be a knife so it was able to find it for me.

Important files and photos I do organize. Specifically for three reasons:

1. Ease of access.

2. Grouping related data together.

3. Tying photos and other data to abstract concepts like ideas for possible games or products.

So I am not advocating no organization or tagging at all.

But I think a lot of people are unaware or at least haven’t really incorporated the distinction between information that is already present in the data, and information that must be manually added. So they spend a lot of time manually creating folder structures that encode information which could already be automatically derived from the data itself.

As for messages in closed apps, I just screenshot them. And I am relying on OCR technology to be or become good enough to refind those messages in the future. That way, if the platform itself is gone by then or the messages are not on the platform itself or hard to find on the platform itself for whatever reason.

So far I haven’t even needed to use OCR. Because if I look for a message I often have other memories of where I was, when it was or something else that happened around that time. So I just jump back in time in my photo stream and either find the screenshot right away or I find pictures near-by in time and spend a tiny amount of time looking forwards and/or backwards in time and I find the screenshot.

I do wish though, that iOS would automatically tag screenshots with the name of the app that the screenshot was taken in. And I think it would be cool if the screenshots were stored as SVG with pure text and vector shapes plus embedded bitmaps, so that the whole potentially needing robust OCR in the future thing could be side-stepped.

Re: Archivists are uploading hundreds of random VHS tapes to the internet

#56

How does one archive data for long term storage in 2020? From what little I've read, all of the media accessable to the layman has an archive lifetime of less than 30 years before physical degradation- NAND, tape, disc, whatever. That makes for a brittle civilization when the vast majority of our knowledge is stored on media and would be unrecoverable just 3 decades after a global calamity.

Do what I do - copy it forward every couple years onto new media.

My oldest files are from 1977 - proof:

https://github.com/DigitalMars/Empire-for-PDP-10

My files have gone from magtape to 8" floppy to various 5.25" floppy to 3.5 floppy to zip drives to cdroms to dvdroms, then to hard disks of ever-increasing size.

(My old hard drives are completely unreadable now.)

I'm sorry I never kept my punch card decks. I'm sure there was nothing but crap on them, but it would be fun to see what kind of crap it was.

Re: Archivists are uploading hundreds of random VHS tapes to the internet

#58

There would be all sorts of weird stuff on them. Young people probably would not know that watching VHS tapes anything could happen because they got reused. So you'd be watching a movie and halfway through it would suddenly switch over to a shuttle launch or a music video or a documentary or something cause someone decided to record something else at that point. I once recorded a three hour British detective show. I…

> I watched it for three hours and it got to the final scene to reveal whodunnit and the tape ran out.

I felt this, hard. So many things I recorded ended up like that, or worse, turned into my mom's soap operas - Santa Barbara, in specific. Ugh.

Re: Archivists are uploading hundreds of random VHS tapes to the internet

#59

How does one archive data for long term storage in 2020? From what little I've read, all of the media accessable to the layman has an archive lifetime of less than 30 years before physical degradation- NAND, tape, disc, whatever. That makes for a brittle civilization when the vast majority of our knowledge is stored on media and would be unrecoverable just 3 decades after a global calamity.

Do what I do - copy it forward every couple years onto new media. My oldest files are from 1977 - proof: https://github.com/DigitalMars/Empire-for-PDP-10 My files have gone from magtape to 8" floppy to various 5.25" floppy to 3.5 floppy to zip drives to cdroms to dvdroms, then to hard disks of ever-increasing size. (My old hard drives are completely unreadable now.) I'm sorry I never kept my punch card decks. I'm sur…

Fortran always seems like such an odd looking language to a modern developer like myself, who's learned a fair share of languages.

I want to sit down and figure it out one day given how prominent it was (and still is for many critical systems).

Re: Archivists are uploading hundreds of random VHS tapes to the internet

#60

How does one archive data for long term storage in 2020? From what little I've read, all of the media accessable to the layman has an archive lifetime of less than 30 years before physical degradation- NAND, tape, disc, whatever. That makes for a brittle civilization when the vast majority of our knowledge is stored on media and would be unrecoverable just 3 decades after a global calamity.

Not particularly user friendly, yet, but Arweave [0] was built specifically for this use case.

0. https://www.arweave.org/archiving.html

Post reply on HN