Live data from Hacker News

Fujifilm Created a Magnetic Tape That Can Store 580 Terabytes

petapixel.com

211–220 of 335 posts

Re: Fujifilm Created a Magnetic Tape That Can Store 580 Terabytes

#211
post #197

Earlier quoted context omitted.

When I was working in vfx we employed a guy who's sole job was to fly back and forth from LA to Melbourne with pelican cases full of hard drives. It was faster and more secure since we were working on air gapped networks.

Hopefully this was cabin baggage and not something left unattended for minutes on the baggage belt

If it could be checked, then it could have been shipped. I would assume hand carry.

Re: Fujifilm Created a Magnetic Tape That Can Store 580 Terabytes

#212
post #118

Earlier quoted context omitted.

> That was a link to an obsolete LTO-2 drive. If you’re using LTO-8, which is the current generation, you’d get a 10-pack of 12TB tapes for around $500. Noticeably cheaper per byte than hard drives. But it looks like the cheapest drive on Newegg for that is $3,299.00: https://www.newegg.com/p/2BM-0046-00001 > In other words, if you have more than about 120 TB of data, then it is cheaper to buy a tape drive. I think a…

You don't even need the absolute latest drives to get reasonable storage volumes. Some careful shopping can net you an LTO-5 (1.5TB native capacity) library unit (one that can be upgraded to newer generations) for under $500, with new tapes $10-15 each. The nice thing about LTO as a format is its relative predictability and ease of acquiring the parts, even the very obsolete ones. It's all SCSI or SAS, most of the in…

> You don't even need the absolute latest drives to get reasonable storage volumes. Some careful shopping can net you an LTO-5 (1.5TB native capacity) library unit (one that can be upgraded to newer generations) for under $500, with new tapes $10-15 each.

That's still... pretty terrible. If we compare you costs for a tape drive against a 14TB easystore @ $190[1], the break-even point is around 72TB. I don't know about you, but that's of data you have to store for it to be worth it. Even at 150TB you're only looking at around ~25% (~$500) in savings compared to hard drive, which I don't think is much when you factor in how much of a hassle tape drives are to work with.

[1] https://slickdeals.net/f/14587381-14tb-wd-easystore-external...

[2] https://www.wolframalpha.com/input/?i=solve+y+%3D+500+%2B+%2...

Re: Fujifilm Created a Magnetic Tape That Can Store 580 Terabytes

#213
post #209

Earlier quoted context omitted.

Maybe if they’re flying first class? Otherwise that sounds like a nightmare that would require an insanely high paycheck.

>Otherwise that sounds like a nightmare that would require an insanely high paycheck. If the courier in question is 6'2" that might be the case, but I suspect if the person was much smaller and is a heavy sleeper, that it wouldn't be too bad.

He was a writer, and seemed to enjoy the job

Re: Fujifilm Created a Magnetic Tape That Can Store 580 Terabytes

#214

Earlier quoted context omitted.

When I was working in vfx we employed a guy who's sole job was to fly back and forth from LA to Melbourne with pelican cases full of hard drives. It was faster and more secure since we were working on air gapped networks.

That feels like a dream job for a temporary amount of time. And very effective too. I assume the VFX studio is in Melbourne?

Yeah one location in LA and another in Melbourne so that we had 24 hour coverage.

Re: Fujifilm Created a Magnetic Tape That Can Store 580 Terabytes

#215
post #203
post #194

Earlier quoted context omitted.

Use https://en.wikipedia.org/wiki/Parchive and add as much redundancy as you like. A lot cheaper to over-provision, than to create the uber-archive medium.

That's a good idea regardless of the medium, but if your flash disk becomes completely unreadable in 15 years, PAR doesn't help you much, does it?

Then don't use flash (or at least not MLC).

Use an M-Disc with 3x PAR redundancy.

Or RAID 1 enterprise magnetic HD with 3x PAR.

Or all of the above :-)

Are you trying to archive TBs or MBs? Likely the next most important consideration is a stable place for storage.

Re: Fujifilm Created a Magnetic Tape That Can Store 580 Terabytes

#216
post #197

Earlier quoted context omitted.

Hopefully this was cabin baggage and not something left unattended for minutes on the baggage belt

Unattended for 14+ hours you mean. A baggage handler on the departing side could be bribed to steal it and you would have half a day of unfettered access before the courier on the plane even knew it was missing. Of course you don’t check it if it’s that critical.

Transport security wasn't as big a concern as consistent delivery.

Network volitility is a huge problem when transferring huge files.

Re: Fujifilm Created a Magnetic Tape That Can Store 580 Terabytes

#217
post #212

Earlier quoted context omitted.

You don't even need the absolute latest drives to get reasonable storage volumes. Some careful shopping can net you an LTO-5 (1.5TB native capacity) library unit (one that can be upgraded to newer generations) for under $500, with new tapes $10-15 each. The nice thing about LTO as a format is its relative predictability and ease of acquiring the parts, even the very obsolete ones. It's all SCSI or SAS, most of the in…

> You don't even need the absolute latest drives to get reasonable storage volumes. Some careful shopping can net you an LTO-5 (1.5TB native capacity) library unit (one that can be upgraded to newer generations) for under $500, with new tapes $10-15 each. That's still... pretty terrible. If we compare you costs for a tape drive against a 14TB easystore @ $190[1], the break-even point is around 72TB. I don't know abou…

It's not a fair comparison to put up hard drives (integrated mechanics) against tape drives (seprated mechanics). They do not solve the same problem and have different longevity profiles. If I'm spending $500 on tape storage, it's because I want something that will last a long time, something that portable hard drives tend to have issues with.

LTO5 onward supports LTFS, which exposes the tape to the OS as if it were any other removable storage, with the one proviso that deleting files doesn't reclaim space unless the entire tape is wiped.

Re: Fujifilm Created a Magnetic Tape That Can Store 580 Terabytes

#218
post #191

Earlier quoted context omitted.

If nobody is "inheriting" your data (or rather—nobody cares enough to keep your data around), it seems kind of moot to ensure it hangs around. That is, if I put stuff in an S3 bucket and pre-pay for 100 years, if nobody is around to download it in 100 years then why bother? If you wanted to make a sort of digital time capsule and didn't care who discovered it, your next best bet would probably be the Internet Archive…

I absolutely take inheritance into account when having backups lasting for a hundred years, but regardless of how uninteresting my data looks, we don't know if today's boring data would be invaluable for science in the future. We show slippers from 5000 years ago in museums today and they're invaluable. Consider the person who owned it, walking on a national treasure, unaware. Maybe, they didn't even like the slipper…

I was thinking that DNA is a pretty robust storage medium. Perhaps we could use it in coming years to store data for long term survival.

Though considering these comments and the advent of mRNA/CRISPR, perhaps we could store data for future generations in our own DNA. That'd be fascinating if you could read journals or even audio/video of your ancestors from your biological inheritance from them. What if we could engineer an extra chromosome to do just that, then let them remix and recombine segments of memories so everyone's would be unique.

Re: Fujifilm Created a Magnetic Tape That Can Store 580 Terabytes

#219
post #136

I'm more interested in the lifetime of the medium. Durable backup media for consumers is still a holy grail as I understand. M-DISC didn't hold up to their 1000 year lifetime promise. Archival-grade DVD's are also not good enough as I understand. Syylex went bankrupt. I want a consumer-grade backup medium that can provide at least a 100 years of lifetime. That said, I was able to recover 90% of the voice recordings m…

That's probably not going to happen. Tapes have high longevities and you can buy used LTO drives on eBay for a few hundred bucks, but the biggest issue in 100 years is going to be finding a device to read the tape, and finding an adapter to hook it to the USB-H 12 quantum optical port on your motherboard.

A better way would be to use something like that to store it for a decade or two, then copy the data onto whatever the newer version of archive medium is (LTO drives can typically read the last one or two versions as well). Rinse and repeat every decade, and it also lets you test if there has been any bitrot.

Re: Fujifilm Created a Magnetic Tape That Can Store 580 Terabytes

#220
post #191

Earlier quoted context omitted.

I absolutely take inheritance into account when having backups lasting for a hundred years, but regardless of how uninteresting my data looks, we don't know if today's boring data would be invaluable for science in the future. We show slippers from 5000 years ago in museums today and they're invaluable. Consider the person who owned it, walking on a national treasure, unaware. Maybe, they didn't even like the slipper…

I was thinking that DNA is a pretty robust storage medium. Perhaps we could use it in coming years to store data for long term survival. Though considering these comments and the advent of mRNA/CRISPR, perhaps we could store data for future generations in our own DNA. That'd be fascinating if you could read journals or even audio/video of your ancestors from your biological inheritance from them. What if we could eng…

Or if you really want your data to survive, engineer it into a virus for your local species of cockroaches! Getting the data back could be gross, but it'll survive nuclear holocaust. ;)
Post reply on HN