I Nearly Lost All of My Data

Post by sreitshamer » Sun, Jan 20, 2019, 11:56 PM UTC

Youden wrote: post #196

sreitshamer wrote: post #193

Earlier quoted context omitted.

Have you looked at Arq[1]? It deduplicates, encrypts, compresses, backs up to most major cloud providers and SFTP and Minio, is available for macOS and Windows. We've been improving it for 10 years. The data format is open and documented[2]. (Note: I work on Arq) [1] https://www.arqbackup.com [2] https://www.arqbackup.com/arq_data_format.txt

You've probably heard this before but there are a lot of people who'd be interested in a cross-platform (NAS/Linux/BSD/Raspberry Pi) version with a command-line or web interface. As is it's really best for workstations rather than the NAS/servers a lot of people who care about their data use (not just basement-dwelling data hoarders but also professionals like photographers and videographers).

Post by vonseel » Mon, Jan 21, 2019, 2:35 AM UTC

derekp7 wrote: post #13

The best solution I found as an alternative to an off-site copy is to set up a USB drive and something like a Raspberry Pi in my car. When I pull into the garage, the house server senses it and syncs new data to it. This can be supplemented further by having it auto sync to a computer in your office whenever you pull into work. Add in some monitoring so you can get a phone alert if any of the synced copies are more t…

Post by vonseel » Mon, Jan 21, 2019, 2:45 AM UTC

cptskippy wrote: post #221

bastawhiz wrote: post #218

My first thought is "why don't you keep a backup?" I really don't know what the moral of this story is beyond "don't keep one copy of all your data, especially in the same physical location." Online storage is cheap. Bandwidth is cheap. There's a multitude of solutions in the comments if a consumer solution like Dropbox or Google Drive isn't good enough for you.

> Bandwidth is cheap. Most ISPs in the US now have a 1TB datacap and charge ridiculous rates for overages.

Post by pimeys » Mon, Jan 21, 2019, 6:41 AM UTC

vonseel wrote: post #244

pimeys wrote: post #185

Earlier quoted context omitted.

This is the reason I upgraded our Synology with a self-built NAS with six disks, a low-power Atom CPU and a really really good PSU connected to a UPS unit for extra security. Never save money with your NAS power solution.

Which OS and file system did you choose? I recently did similar with an old server and Freenas, but I am still not sure if I have a safe (enough) system overall. I chose RAIDZ2 with 4 4TB WD Red drives, ECC RAM, seems to be working well so far.

Post by jacobush » Mon, Jan 21, 2019, 8:14 AM UTC

2Ccltvcm wrote: post #9

jacobush wrote: post #3

I have looked and looked since 1998, tried rsync, RAIDs, striped drives, ATA over Ethernet, lvm, ZFS, all sorts of things. What finally clicked for me, is https://www.greyhole.net It's like magic. Decide how much redundancy you want. Then just add drives to it. It balances files automatically across drives. You can have remote drives in the mix. What it is not good at, is many small files. But for my use, media files…

It's a really tough sell for most people when you tell them they need to have at least two copies of their data if they care about it. The vast majority of people will rather "take their chances." Usually that means another $100-500 bucks for most people.