Live data from Hacker News

An Australian researcher has worked out how to store 1000TB on a CD

sciencealert.com.au

61–70 of 139 posts

Re: An Australian researcher has worked out how to store 1000TB on a CD

#63
post #55
post #33

Earlier quoted context omitted.

"the internet" is a more fragile medium than a disk, that's why. High-density, cheap, persistent data storage is critical to make sure that most of the cultural expressions of the last few generations don't vanish into a black hole sooner than later. It's our version of ancient Babylon's cuneiforms etched in wet clay. Just imagine how much crap Jason Scott could fit into a storage container with these. A lot of crap.…

I'm skeptical that this won't be extremely fragile, physically. With details that small, the slightest scratch could erase large swaths of data.

Multiple copies on the disk, or multiple disks could take care of that? Surely, some kind of error correction is possible to take that into account.

Re: An Australian researcher has worked out how to store 1000TB on a CD

#64

Earlier quoted context omitted.

If you mail a single disk (nevermind a box full of discs) to your friend, and it arrives in 3 days, you have achieved about 31.6 Gbps. If you mail a USPS flat rate box with 100 discs, you have achieved 3160 Gbps. You cannot buy a three thousand Gbps internet connection.

you have to read the data off the disk though, and that won't be 3160 Gbps

What other medium are you going to store the data on? What are you reading it onto?

You would read from that plastic disc just like a CD or DVD, i.e. as you consume the content. This makes the throughput of any link in this chain irrelevant. (I guess except the read speed of the plastic disc)

Re: An Australian researcher has worked out how to store 1000TB on a CD

#66
post #58

Earlier quoted context omitted.

As of a couple of years ago, the entire content of The Pirate Bay[0] was under 100MB[1]. Think about that for a moment - it's the index for one of the largest collections of publicly available content in the history of humanity, and it fits in my wallet 80 times over[2]. [0] Not the P2P content that people download - just the main site itself, containing all of the magnet links, etc. TPB's 'content' is literally just…

Why would you want that? The magnet links alone are rather useless. The whole site can be crawled within 2-3 days easily. There are ~1.2 million torrents indexed, lets just assume that a single magnet-link plus some metadata is 0,5-1kB... so that would be an total of ~1GB data.

> Why would you want that? The magnet links alone are rather useless. The whole site can be crawled within 2-3 days easily.

But the entire site archive is already available as a torrent indexed on TPB - why bother crawling? That's what I'm referring to - search "pirate bay archive" on TPB and you'll find it.

The magnet links are not useless, because they are able to query the rest of the metadata from a tracker and/or DHT.

I'm thinking about this from the perspective of 'minimal amount of information needed in order to reproduce TPB', not 'how much information does TPB index (which is obviously much larger).

(Remember that TPB no longer even operates its own tracker, so if TPB itself were taken offline, the magnet links would still work fine).

Re: An Australian researcher has worked out how to store 1000TB on a CD

#67
post #52

Earlier quoted context omitted.

Netflix would put the entire catalog in your home, encrypted, and the only data they would have to transfer would be for the control plane (billing, recommendations, etc) and encryption keys to auth you. Totally side-steps last mile monopolies as well. Don't want to work with us? We'll drop an LTE chipset in as well for the admin stuff. Redbox In Your Home.

This is how Doom/Quake was distributed on CD - first episode free, call iD for the unlock code.

...or just to say aardwolf.

Re: An Australian researcher has worked out how to store 1000TB on a CD

#68

> With the $18,000 fellowship, Gan will collaborate with industry and researchers around the world to work on new breakthroughs for data storage devices, and also see how his existing research can be used on a larger scale to rapidly improve the capacity of optics-based information technologies. $18K seems like a drop in the bucket for powering this kind of research. Dr. Gan needs someone to introduce him to Kickstar…

Given Australia salary scales, this may be a typo, 180,000 would sound normal.

Re: An Australian researcher has worked out how to store 1000TB on a CD

#69
post #51

A big problem with spinning disks is that storage grows inversely with the area of the dots, while reading and writing speed grow inversely with the diameter of the dots. If you store 100 times as much data, all else being equal, time to write a full disk will be ten times as large. Ways around that are increasing rotation speed (been there, done that. There is little to gain here without making the disk a lot strong…

A 50GB Blueray disk can be written in 12 Minutes with a home burner but a few seconds in mass production. Scaling that up this would be (1,000,000 / 50) = 20,000 times the space but take sqrt(20,000) * 12min = 28 hours to write at home.

However, assuming you can R/W at the same rate that's 10GB / second speed which might be tough for a home PC to pull off anytime soon.

PS: I suspect if this where ever out into production they would change the form factor to enable even faster R/W speeds and a significantly reduced capacity.

Re: An Australian researcher has worked out how to store 1000TB on a CD

#70

I see where they mention writing the data, but does anyone see how/if they are reading the data? From his other pubs [1], it looks like a two-photon process is involved as part of writing in deep-subdiffraction limit for lithography. Will be fun to try and reverse that. [1] http://www.swinburne.edu.au/engineering/cmp/profile.php?memb... Edit: Paper that this PR refers to is here: http://www.nature.com/ncomms/2013/130…

PDF link: http://www.nature.com/ncomms/2013/130619/ncomms3061/pdf/ncom...

This is pretty cool stuff. Reading through the paper now.

Post reply on HN