Live data from Hacker News

ZFS on Linux: Unlistable and disappearing files

github.com

101–110 of 168 posts

Re: ZFS on Linux: Unlistable and disappearing files

#101

So this is not a "ZFS bug", but a "ZFS on Linux" bug. The actual ZFS on systems which have had ZFS for decades is not affected at all.

> The actual ZFS on systems which have had ZFS for decades is not affected at all.

ZFS hasn't existed "for decades".

Re: ZFS on Linux: Unlistable and disappearing files

#102
post #12

Earlier quoted context omitted.

The OP appears to speak German natively. In German they are much more hyphen happy than English. It's probably the most common error I see among German speakers typing English.

Exactly this. In German the headline would just have been: "Linuxzfsdatenverlustfehler gedfunden!" Getting this stuff right in English is hard. (Pun intended) Sry!

> gedfunden

One of those days, eh?

(You spent all the attention on that first word ;-)

Re: ZFS on Linux: Unlistable and disappearing files

#103
post #9

We are working on it. We know what patch introduced the regression and 0.7.8 is going out soon to revert it. Until then, users should downgrade to 0.7.6 if they have not already. The Gentoo and EPEL maintainers have pulled the affected releases from the repositories (technically masked on Gentoo). Ubuntu was never affected. The regression makes it so that creating a new file could fail with ENOSPC after which files c…

This is a good reminder for everyone that snapshots are not backups. Also, thank you for all of the hard work on ZoL!

“This is a good reminder for everyone that snapshots are not backups.”

Were this not ZFS, I would agree with you, however, since zfs rollback will revert to previous state and if the snapshot is on a redundant vdev, there is no difference between that and losing your backup due to a damaged tape.

In fact, zfs snapshots are exactly how time machine on illumos based operating systems is implemented.

Re: ZFS on Linux: Unlistable and disappearing files

#104
post #78

Probably obvious, but hooray for open source software! What a fantastic response to the bug.

Imagine if this had happened to Apple, everyone and his dog would be rolling over each other villifying them.

Apple's file systems HAVE had some serious bugs, as you probably know. I haven't noticed that they've been getting all that much press. What press they've been getting is very negative, though, and quite right too.

Re: ZFS on Linux: Unlistable and disappearing files

#105
post #44

Earlier quoted context omitted.

This is a good reminder for everyone that snapshots are not backups. Also, thank you for all of the hard work on ZoL!

You are welcome. I should clarify the snapshots remark. The problem with how this interacts with snapshots is that the snapshots containing orphaned files cannot be repaired by software without BPR. They can only be listed by software for deletion by the administrator. Also, for the dataset’s tip, the future tool to repair it can only put the orphaned files into a lost+found directory without the original file names.

lost+found is an incorrect approach for ZFS. If you feel you have to regress to what was 40 years ago and was a bad solution, then the misfeature causing it needs to be engineered instead of hacked together, or better yet not implemented at all. If you have to break from mainstream ZFS and regress that violently, it’s the wrong approach.

Re: ZFS on Linux: Unlistable and disappearing files

#106
post #101

So this is not a "ZFS bug", but a "ZFS on Linux" bug. The actual ZFS on systems which have had ZFS for decades is not affected at all.

> The actual ZFS on systems which have had ZFS for decades is not affected at all. ZFS hasn't existed "for decades".

One and a half decades can probably be seen as "decades", but you are right, this was some kind of an exaggeration.

Re: ZFS on Linux: Unlistable and disappearing files

#107
post #101

So this is not a "ZFS bug", but a "ZFS on Linux" bug. The actual ZFS on systems which have had ZFS for decades is not affected at all.

> The actual ZFS on systems which have had ZFS for decades is not affected at all. ZFS hasn't existed "for decades".

It has existed since 2002, and was officially put back into onnv on 31.10.2005, and made available in Solaris 10 update 2 at the end of June 2006. So, it has existed for at least one decade and more.

Re: ZFS on Linux: Unlistable and disappearing files

#108
post #78

Probably obvious, but hooray for open source software! What a fantastic response to the bug.

Since when is introducing a major regression into something as critical as a filing system a hooray for open source? Only on GNU/Linux... and nobody thinks twice about it or bats an eyelash; instead, the scrambling to contain the regression is greeted with a hooray. It’s mentality like this which makes me want to never touch a computer again.

Re: ZFS on Linux: Unlistable and disappearing files

#109
post #36
post #25

Earlier quoted context omitted.

I have been running ZFS on macOS (OS X), illumos and Solaris for a good 7 years or so now. A major part of the reason I switched over fully, despite some warts, was that I experienced actual and significant data rot from stuff I was carrying forward under XFS (IRIX), HFS, etc. I don't consider my personal stuff to go back that long, but I still have things from 1993 or so that matter to me. I did a review around 2009…

It sounds like you are suggesting that checksums and other integrity features obviate the need to back up your important files.

I don't understand how you could have possibly gotten that, particularly given that I very explicitly finished with "that ZFS or the like are far better primitives for a data storage scheme then older FS". Primitives. Other components are still important. But backups in no way whatsoever inherently provide integrity, that's not the threat scenario they deal with. A non-verifying backup (quite typical, especially historically) will cheerfully and unquestioningly backup corrupted data, and can become corrupted itself over time. When you're considering data maintenance over the course of not just years but decades, "oh just backup" isn't at all enough without an integrity story to go with it.

Now of course it is possible to build levels of verification higher up the stack, but the problem with a lot of the ones available to general user is that they either leave holes in various places or they're just plain too much of a PITA (and "PITA" here includes a significant enough level of slow down) or both. It's much easier to do a good job if the FS itself is reasonably trustable and has verification and basic repair built in. FWIW I do use tools like par2 for cold or cool backups of ZFS dumps to targets like tape or Glacier now, but it's still a big help to my sanity to have as much of that dealt with at a low, automated level for hot/warm systems where convenience is critical.

Re: ZFS on Linux: Unlistable and disappearing files

#110
post #78

Probably obvious, but hooray for open source software! What a fantastic response to the bug.

Imagine if this had happened to Apple, everyone and his dog would be rolling over each other villifying them.

I paid good money to Apple so something like that would not happen, so yeah I’d be villifying them. You bet!
Post reply on HN