Live data from Hacker News

How I encrypt my data in the cloud

robertclarke.com

91–100 of 100 posts

Re: How I encrypt my data in the cloud

#91
I'm considering a Cloudberry Labs (freeware/personal) + BB B2 combination for encrypted cloud backups and would like to hear opinions specifically on the Cloudberry part. I love the command-line suggestions in this comment thread but need something that "just works" as a Windows service for my wife's pc.

Re: How I encrypt my data in the cloud

#92

Earlier quoted context omitted.

You can also use sshfs in combination with borg to eliminate the need for the server to support borg.

That doesn't work as well because borg needs fast local access to the files in order to do deduplication etc. If you use SSHFS, it's going to be much slower, IIRC.

You're right. It does have an impact on performance. I haven't done a comparison, but the performance is still acceptable in my experience. It depends on the use case, but the local cache that borg maintains helps a lot in simple cases, because any unchanged files simply get skipped.

Re: How I encrypt my data in the cloud

#93

Earlier quoted context omitted.

That doesn't work as well because borg needs fast local access to the files in order to do deduplication etc. If you use SSHFS, it's going to be much slower, IIRC.

You're right. It does have an impact on performance. I haven't done a comparison, but the performance is still acceptable in my experience. It depends on the use case, but the local cache that borg maintains helps a lot in simple cases, because any unchanged files simply get skipped.

Ah, that's great news. It means you can use things like B2 as well.

Re: How I encrypt my data in the cloud

#94

I found it extraordinary difficult to build your own encrypted cloud. Options: 1. Truecrypt container. CON: Upload takes to long 2. ecryptfs CON Always had problems getting it to work. AFAIK it is not under current development anymore. 3. Run a FS in a mounted contaner (Filesystem in a FILE). Slow. Not very stable. Under no circumstance use ext4 or something like it, if you really want to try this, use ZFS to avoid d…

That is why I like ZFS: Its send/recv function can do block level syncing, so while the first upload will take a while, subsequent syncs will be much smaller. Of course, unless you stand up your own VM with a ZFS partition, there are few cloud options for ZFS.

"... there are few cloud options for ZFS."

There is exactly one. You can ZFS send/recv to and from an rsync.net account that is enabled to do that:

https://arstechnica.com/information-technology/2015/12/rsync...

https://www.rsync.net/products/zfsintro.html

OR you can get a plain old rsync.net account and do a "dumb" sync to it and just configure ZFS snapshots on any schedule you like.

Ask about the "HN Discount".

Re: How I encrypt my data in the cloud

#95

I found it extraordinary difficult to build your own encrypted cloud. Options: 1. Truecrypt container. CON: Upload takes to long 2. ecryptfs CON Always had problems getting it to work. AFAIK it is not under current development anymore. 3. Run a FS in a mounted contaner (Filesystem in a FILE). Slow. Not very stable. Under no circumstance use ext4 or something like it, if you really want to try this, use ZFS to avoid d…

"I found it extraordinary difficult to build your own encrypted cloud."

I am happy to report that this has been (recently) solved:

https://www.stavros.io/posts/holy-grail-backups/

"(the) holy grail of backups"

Re: How I encrypt my data in the cloud

#96
post #37

I just do Backblaze with a client-side key. Cheap and effective. I do wish they had a Linux daemon client. I'd pay more for that.

FYI, to restore your files with Backblaze, you'll have to give them your key. They then decrypt your files and leave them in an unencrypted zip file on their servers for you to download.

And also: their app is closed source, so I'm kind of already trusting them with my encryption key.

Re: How I encrypt my data in the cloud

#97
post #43

I wouldn't trust a closed-source tool like Boxcryptor for encryption of sensitive data. Cryptomator looks interesting, though it's still a relatively new tool, and I'd be hesitant to rely on it. For my personal backups I use a combination of tar, pixz, and GnuPG. There's no fancy deduplication, and it's definitely not efficient, but it's relatively simple and I can restore individual files with ease. I run a variatio…

Wasabi does have some not-entirely-true advertising on their web site though. If you don't download (which you typically don't if you're doing backups), all cloud providers are cheaper than Wasabi on per-TB-mo basis. Google Coldline or Amazon Glacier, for example, are $4 TB-mo (and Google is about to roll out $1.23 TB-mo "archive" option). Azure seems to have "archive" option for $1 TB-mo (LRS Archive option, advertises the same "11 nines", tho the price is so low, there's got to be a catch)

The Wasabi offering seems to be equivalent to the "hot" storage options, which, I agree, is crazy expensive in the cloud if you do a lot of egress.

Re: How I encrypt my data in the cloud

#99
post #97
post #43

I wouldn't trust a closed-source tool like Boxcryptor for encryption of sensitive data. Cryptomator looks interesting, though it's still a relatively new tool, and I'd be hesitant to rely on it. For my personal backups I use a combination of tar, pixz, and GnuPG. There's no fancy deduplication, and it's definitely not efficient, but it's relatively simple and I can restore individual files with ease. I run a variatio…

Wasabi does have some not-entirely-true advertising on their web site though. If you don't download (which you typically don't if you're doing backups), all cloud providers are cheaper than Wasabi on per-TB-mo basis. Google Coldline or Amazon Glacier, for example, are $4 TB-mo (and Google is about to roll out $1.23 TB-mo "archive" option). Azure seems to have "archive" option for $1 TB-mo (LRS Archive option, adverti…

Indeed, Wasabi is not cheap for long-term archiving of large amounts of data. It's also potentially more expensive for short-term storage because of their 90 day minimum retention period, which they explain well in their FAQ.

But they're a great fit for my personal use case of well below 1TB of rarely accessed data, while also providing peace of mind that recovery is not an issue, so I'm OK with paying more for that. Plus, it feels good betting on an underdog. :)

Re: How I encrypt my data in the cloud

#100

Earlier quoted context omitted.

if you encrypt in a way that enables the service to do dedupe, you are either reusing IVs and encryption keys across items (bad) and leaking information that two items are the same item.

You must not reuse IV between different blocks, but that does not stop you from using the same IV for the same block. Yes, you leak information about matching blocks - it's up to your use case whether you care about it.

Yes, sorry I was imprecise. I meant reusing IVs for equal blocks only, to be able to see duplicate data.
Post reply on HN