Live data from Hacker News

Backups Aren't Simple

filipovski.net

161–170 of 213 posts

Re: Backups Aren't Simple

#161
post #119

> “There are two types of people: those who have suffered a catastrophic loss of data, and those who will.” When I was a teenager, I was the reason for data loss for my dad, twice. Both times it was because I was re-partitioning a hard drive to install linux. You would think that taught me a lesson about backups, instead it reminds me every now and again to be grateful for an awesome dad and aspire to handle situatio…

[dead]

Re: Backups Aren't Simple

#162

> There are two types of people: those who have suffered a catastrophic loss of data, and those who will. This is an empirical claim, but is it grounded in reality? 99% of people don't backup, and that's probably the right choice because the risk is low, they can't meaningfully improve their restoration rate themselves and they don't care enough about their data to classify its loss as catastrophic. When a person hea…

Let's say SSDs have an annualized failure rate of 1%. (The real figures are from 0.5% for more reliable ones, 1.5% for less reliable ones). The annualized failure rate for HDDs is a bit higher, but let's give it 1% anyway. Over 40 years (even with changing disks, upgrading PCs, etc.), the chances of you ending up with your data intact is 0.99^40=0.67. May not seem too bad, but this is just a hardware failure of your…

~30 years old here, and I can confirm I risked and suffered data loss multiple times. I remember when I still was at my parents house during university I had in mind to build a NAS to properly host the family's photo archive (main reason was bit rot protection, which we experienced, but I was planning for a proper backup as well). But I kept procrastinating. Then, I risked losing it due to a distraction. After spending one week to recover it, building a proper solution to host and backup it became top of my list.

Re: Backups Aren't Simple

#163
post #135
post #134

For my small library photos, keepass passwords, etc around 30gb, I use syncthing, which will backup on my pc, on my parents pc (they live in another country), on my sisters pc and on my phone. They also use this triangular mode to backup their stuff. Syncthing is setup to only sync through tailscale or home routers network.

sync is not backup Also why you sync through LAN only?

It's tailscale or local LAN. syncthing allows you to specify multiple addresses for the same peer

> tailscale or home routers network

Re: Backups Aren't Simple

#164
post #145
post #142

Bit rot was mentioned in the article, but then no solution was offered. I also haven't found a good solution, unfortunately. If you only have a couple of Terabytes you could create check sums of everything and then verify regularly, but I feel this approach doesn't scale very well if you have lots of data.

If you have lots of data, I would suggest using a filesystem designed for this, like ZFS or BTRFS. You would still have to spend in storage though, as ultimately protecting from bit rot requires redundancy.

I do use btrfs, but I don't really understand how to use it to protect against bit rot. I tried to look into it at some point, but got overwhelmed. Did invest in two backup copies, one of them off site, though.

However, looking at prices, I can see one of those backups just being dismantled to be used as more storage.

Re: Backups Aren't Simple

#165

A bit of a tangent, but the linked rsnapshot tool is about 7k lines of perl code. The COPYING file is 20 years old and it's still maintained, the last change was 6 months ago. I'm feeling really old. [1]: https://github.com/rsnapshot/rsnapshot/blob/master/rsnapshot...

Yes, rsnapshot is excellent, I'm glad the article mentioned it. I use it for my weekly backups. So wonderfully simple. I wish the config file weren't quite so strict about syntax, but I only need to change it about twice a decade so no big deal.

Re: Backups Aren't Simple

#166

I really like ZFS snapshots with offsite pull-mode sync using Jim Salter's sanoid/syncoid [1]. ZFS is the base for all OS/filesystems on top of it. If you have a good system for organizing ZFS datasets, and separating ephemeral from persistent data (e.g. [2]), then this is 90% of the backup requirements already fullfilled. [1]: https://github.com/jimsalterjrs/sanoid [2]: https://du.nkel.dev/blog/2026-05-16_rootless_d…

[dead]

Re: Backups Aren't Simple

#167
I'm adding this to my list of things that should be simple but aren't. It already contains "Sending a 1GB file to a friend without seeing advertisements" and "Making a mixtape for my friends who are on a different streaming service".

Re: Backups Aren't Simple

#168
post #76

Earlier quoted context omitted.

There's plenty of backup services and cloud solutions. The article mentions Borg and Restic, others like Backblaze are more consumer friendly. Which needs do you have that aren't met by any of these tools?

> backup services and cloud solutions online backup should not be your primary method of backup, you're one billing, identity theft, financial issue, or health issue away from getting your backup nuked do you have PBS clout? if not good luck https://arstechnica.com/information-technology/2026/08/pbs-s...

PBS's situation is entirely PBS fault. If you've got 50TB of data to backup it's either worth $300 to $400 a month to you to do it properly with a reputable vendor along with on-site storage, or ... just accept you'll lose it.

It was such a tremendously silly decision I almost wonder if it wasn't a politically motivated decision. Maybe the provider that went under had some relative DEI points versus Backblaze or AWS. Just bizarre.

But I wouldn't extrapolate anything out from their situation.

Re: Backups Aren't Simple

#169
post #119

> “There are two types of people: those who have suffered a catastrophic loss of data, and those who will.” When I was a teenager, I was the reason for data loss for my dad, twice. Both times it was because I was re-partitioning a hard drive to install linux. You would think that taught me a lesson about backups, instead it reminds me every now and again to be grateful for an awesome dad and aspire to handle situatio…

Same! I decided to reinstall Windows and MBR to GPT conversion (surprisingly!) wiped the whole disk. 10 years of family photos gone. Good thing we had all important ones printed.
Post reply on HN