A data corruption bug in OpenZFS? • Hacker News Board

Re: A data corruption bug in OpenZFS?

#111

Post by mekster » Wed, Dec 27, 2023, 2:29 PM UTC

MenhirMike wrote: post #3

Periodic reminder to check if your backups are working, and if you can also restore them. It doesn't matter which file system or operating system you use, make sure to backup your stuff. In a way that's immune to ransomware as well, so not just a RAID-1/5/Z or another form of hot/warm storage (RAID is not a backup, it's an uptime/availability mechanism) but cold storage. (I snapshot and tar that snapshot every night,…

The periodic reminder is to at least use 2 different implementations to make backups than rely on 1 such as Borg.

Re: A data corruption bug in OpenZFS?

#112

Post by ktm5j » Thu, Dec 28, 2023, 1:44 AM UTC

frankjr wrote: post #67

lupusreal wrote: post #61

Is anybody using bcachefs yet?

I'm keeping an eye on it but it's not there yet e.g. https://github.com/koverstreet/bcachefs/issues/619#issuecomm...

Well, to be fair they tried and failed to reproduce the corruption that was reported. While I agree that I'm not ready to dive into bcachefs, I'm not exactly swayed by this bug report.

Re: A data corruption bug in OpenZFS?

#113

Post by grepfru_it » Thu, Dec 28, 2023, 1:58 AM UTC

linuxdude314 wrote: post #84

grepfru_it wrote: post #35

Earlier quoted context omitted.

LTO5. The cost of my LTO5 system is the cost of downloading all of my data once from a remote cloud provider. It's a nobrainer

As someone who used to admin a 30PB+ LTO library I love me some tape, but unfortunately it’s not that simple of a value proposition. Bit rot is less of a thing with LTO, but still a thing.. I.e. you will at some point need to update your LTO system and it’s storage media. The robot I owned was the library storage for movie frames at a major motion picture studio. We would upgrade every other release, so while I was t…

Well I store two sets of offsite tapes. One at my colo site and one in a climate controlled storage facility. I rotate my tapes weekly and the inbound tapes get restored and compared against the disk backup.

I also ran IT departments for the last 30 years, so you probably shouldn’t use me as the scapegoat :)

Re: A data corruption bug in OpenZFS?

#114

Post by grepfru_it » Thu, Dec 28, 2023, 2:00 AM UTC

dist-epoch wrote: post #39

grepfru_it wrote: post #34

Earlier quoted context omitted.

LTO. I bought an LTO-5 system to backup 6TB of critical data and 12TB of nice-to-have data. LTO-6 is better if you can afford it. Downside to tape backup is you need throughput, or the ability to do disk-disk backups

For 20 TB LTO seems too expensive. 20 TB of SSD costs about $1000. Or you could get a 20 TB hard drive for $300.

Drive failure and managing those drives are hidden costs you are not considering.

I have had multiple hard drives fail and been left stranded. Tape fails but not nearly as often as disks

LTO6 and LTO7 are not expensive for 20TB

Re: A data corruption bug in OpenZFS?

#115

Post by rincebrain » Fri, Dec 29, 2023, 5:15 AM UTC

LanzVonL wrote: post #87

rincebrain wrote: post #79

Earlier quoted context omitted.

Who on earth is trying to bully Linus into anything? Where have you seen that?

He did go away for a vacation-style treatment a few years ago after offending Intel. Like a re-education camp.

He did go away, yes, but that's not really related to the premise of people trying to convince him to merge a large wad of code undera license that is not GPLv2 and is not strictly less restrictive than GPLv2 into the Linux codebase.