Live data from Hacker News

C14 – Cheap, secure long term cloud storage

online.net

41–50 of 110 posts

Re: C14 – Cheap, secure long term cloud storage

#41
post #18

Earlier quoted context omitted.

You're right about their cross-rack RAID-like stack, but didn't Backblaze switch to ext4 in the meantime?

possibly... cant see anything about it on storage pod 6 [1] but i do remember mentioning a file system, i just though it was XFS... [1]: https://www.backblaze.com/blog/open-source-data-storage-serv...

https://www.backblaze.com/pod.html says ext4.

https://www.backblaze.com/blog/vault-cloud-storage-architect...

    Each of the drives in a Vault has a standard Linux file system,
    ext4, on it. This is where the shards are stored. There are
    fancier file systems out there, but we don’t need them for
    Vaults. All that is needed is a way to write files to disk, and
    read them back. Ext4 is good at handling power failure on a
    single drive cleanly, without losing any files. It’s also good at
    storing lots of files on a single drive, and providing efficient
    access to them.
They have since migrated to ext4, but judging by their job description they might still have JFS in use. https://www.backblaze.com/blog/seeking-data-protectors/

    Diagnose and repair file system problems with JFS and ext4 and debug
    other system problems
https://www.backblaze.com/blog/petabytes-on-a-budget-v2-0rev...

    We upgraded the Linux 64-bit OS from Debian 4 to Debian 5, but we
    no longer use JFS as the file system. We selected JFS years ago
    for its ability to accommodate large volumes and low CPU usage,
    and it worked well. However, ext4 has since matured in both
    reliability and performance, and we realized that with a little
    additional effort we could get all the benefits and live within
    the unfortunate 16 terabyte volume limitation of ext4. One of the
    required changes to work around ext4’s constraints was to add
    LVM (Logical Volume Manager) above the RAID 6 but below the file
    system. In our particular application (which features more writes
    than reads), ext4’s performance was a clear winner over ext3,
    JFS, and XFS.

Re: C14 – Cheap, secure long term cloud storage

#42
post #19

tl;dr: a cheap data archival solution; upload is free, storage is cheap (€0.002 / GB / mo), download is somewhat less cheap (€0.01 / GB) and not instant; rsync / sftp IS supported for upload, but an API call is needed to complete the operation. Seems great for redundant regular backups that you hope to never restore from, but would like to keep just in case. (EDITED: previously incorrectly stated that rsync and sftp…

> send [...] using FTP, SFTP, Rsync or SCP, and upload and download are both free, operations (archiving/unarchiving?, et al) are not Unless they changed it in the space of 16 minutes, I think you might of wanted to give a closer look for making your tl;dr

Oops! Thank you; fixed.

Re: C14 – Cheap, secure long term cloud storage

#44

>> Your important data are encrypted AES-256 and replicated many times then stored in our 25 meters deep underground fallout shelter, located in Paris, with no known natural, technological and military risks. So, only one location.

Yeah, it's pretty silly to say "no military risk" about any single location. Yes, France is as geopolitically stable location as there is on Earth, but it's also part of NATO and NATO has rivals, like Russia and China, with whom they may go to war with in the future. France has been invaded in the past, and may be again.

If you're really concerned about possibilities like that, you should be storing your data redundantly such that it's unlikely that all the locations would be on the same side of a war. France is a good choice for one location; now choose one non-NATO superpower (China?) and one unaligned nation (Brazil? India? Egypt?).

You want to be reasonably certain that at least one location would be either neutral or the victor in any war. Only then can you say you're as close to 'no military risk' as you can get.

Re: C14 – Cheap, secure long term cloud storage

#45
post #12

Very interesting. Aside from the slight inconvenience of not being able to use standard tools like ftp, scp and rsync... Amazon Cloud Drive's $60 a year plan ( https://www.amazon.co.uk/clouddrive/ ) is still significantly cheaper for storing more than ~2.5TB. It's also free of charges per operation and such like. Amazon Cloud Drive doesn't seem to have any SLAs regarding uptime and redundancy though... I'm not sure i…

Isn't Amazon drive limited to Windows and OSX?

The use of standards (rsync, sftp, etc...) makes C14 very attractive.

Re: C14 – Cheap, secure long term cloud storage

#48
post #16

Earlier quoted context omitted.

sounds similar to backblaze... though they use XFS (IIRC) for their file system, but do the RAID type stuff themselves...

Nope, with Backblaze you have instant access to an individual file. Here you need to unarchive your safe, which can take up to a few hours (depending on the size of the vault), and only then you have access to the content of the safe. No way to retrieve only 1 file, or have instant access.

Wait, this isn't random access (live) storage ?

How do you rsync (or borg, duplicity, whatever) to a dataset that has to be checked out ? I can imagine some ways of doing that, but am curious ...

Re: C14 – Cheap, secure long term cloud storage

#50
post #11

How does it compare against Amazon Cloud Drive that has unlimited storage for USD ~60/year?

Whoah. I had no idea about this. That's massively cheaper than Google and Dropbox. Is there some catch about max download size limits per day or something?
Post reply on HN