Live data from Hacker News

I Nearly Lost All of My Data

kevq.uk

161–170 of 262 posts

Re: I Nearly Lost All of My Data

#162

Kudos to Synology for having a process to recover on a Linux box if the Synology box craps the bed. I was reading this story thinking "this is a good lesson on why you don't buy an expensive SAN, unless you can afford to buy two". But, the other lesson is: Backups. Sounds like backups were shut off 6 months prior. The other lesson is: Monitoring. Backups were going to the USB drive, but it that stopped working at som…

The nice thing about Synology storage stuff is that it's a nice GUI (seriously, they're about the only company I can think of that's doing appliance management right) on top of standard and battle-tested open source tools. This was one of the reasons I was okay with paying their prices. Even if the device completely craps the bed, I'll be able to hook the drives containing absolutely normal LVM/btrfs volumes up to an…

It’s nice for running Docker in too and give a beginner a fairly gentle introduction. The boxes are also really nice in that you have a range of configuration options that lets you get what you need. Don’t put big Seagate drives in it if it’s near where you sleep though as they make a bit of noise as they grind.

Re: I Nearly Lost All of My Data

#163

It's a common scenario, unfortunately. Synology RAID is nice. External USB on the same power circuit is not a good idea. Actually, I'd look at least into a surge protector. But it's quite possible to have those blow up and still fry your hardware. I'd run some batteries in the basement and run my Synology (or similar) off of those. Additionally, the USB Backup of backups should be in the garage or the attic, if at al…

The issue is probably the Synology PSU and nothing else. This is the third Synology NAS breaking down with intact disks I hear about this month, and it seems to be quite a common issue.[0]

[0] https://www.youtube.com/watch?v=K7ly8zde3dE

Re: I Nearly Lost All of My Data

#164

I currently have way to much data lying around for any metered cloud storage to be economical, so I'm currently subscribing to both Backblaze and Crashplan for their unlimited storage backup plans. Crashplan killed off their consumer plan a while ago, so I ended up moving to their business plan at double the price. In my case even at that price it was still worth it considering the amount of storage I'm using. Anyone…

Your question - about data and transit volumes, and costs - would be answerable if you provided some actual numbers.

Re: I Nearly Lost All of My Data

#165

It's a common scenario, unfortunately. Synology RAID is nice. External USB on the same power circuit is not a good idea. Actually, I'd look at least into a surge protector. But it's quite possible to have those blow up and still fry your hardware. I'd run some batteries in the basement and run my Synology (or similar) off of those. Additionally, the USB Backup of backups should be in the garage or the attic, if at al…

The usb backup backup really, really cannot be at the same site. I'm not saying you have to stick it in the cloud but it's got to physically somewhere else.

Re: I Nearly Lost All of My Data

#166

Earlier quoted context omitted.

Does the RaspberryPi have enough CPU for disk encryption?

Not OP, it'd be neat if it just uses FTP (or rsync) to transmit data which is already encrypted from the uploading-side...

With encrypted upload, you usually get a destination authentication thrown in for free, i.e. you're uploading to the right server :-)

Re: I Nearly Lost All of My Data

#167
post #99
post #28

Many years ago I watched someone stuff the DVDRW (remember them?) which contained all his stuff into a work PC’s pioneer slot loader drive to get some music off it. We stood there and the drive went bzzt, clang, bzzt, clang then sped up way faster than it was supposed to go. This was followed by a large bang and bits of DVDRW coming flying out and then a crunching noise. From this I learned about single points of fai…

But define 'plain file system' - is that NTFS? ext4? ZFS? FAT32? HFS? UFS? ISO9660? TAR? cpio? Some of these are more complicated than others, and all of them have catastrophic failure modes...

I use NTFS.

The catastrophic failure modes are present only through hardware and misuse issues on a mature file system.

Re: I Nearly Lost All of My Data

#168
post #28

Many years ago I watched someone stuff the DVDRW (remember them?) which contained all his stuff into a work PC’s pioneer slot loader drive to get some music off it. We stood there and the drive went bzzt, clang, bzzt, clang then sped up way faster than it was supposed to go. This was followed by a large bang and bits of DVDRW coming flying out and then a crunching noise. From this I learned about single points of fai…

> A plain file system you can just copy your shit back from is the closest thing to a guarantee. These days, I'd suggest using a file system with some form of file checksum metadata. If one values the integrity of their data, bit rot is a thing.

Very true. alternatively SHA sum all your data per directory. That’s easy enough to write scripts to validate

Re: I Nearly Lost All of My Data

#170
M Discs brother, they are cleared to last 1000+ years. Long after most people's cloud backups have turned to dust, my most treasured data will endure due to my use of these discs (which may well be unreadable from a hardware standpoint in 3019. But shit, hope they keep the schematics around.
Post reply on HN