Live data from Hacker News

ZFS fans, rejoice – RAIDz expansion will be a thing soon

arstechnica.com

101–110 of 198 posts

Re: ZFS fans, rejoice – RAIDz expansion will be a thing soon

#101
post #73
post #63

Earlier quoted context omitted.

But the main thing of an fs is to preserve your files...btrfs can't even check the most important point.

The checksumming helps to spot faulty hardware, that's a step above most other filesystems and often smart info too.

Checksums don't help against bugs. You are much less likely to lose your whole disk with ext4 or ZFS than BTRFS.

Re: ZFS fans, rejoice – RAIDz expansion will be a thing soon

#102
post #68
post #41

Earlier quoted context omitted.

What about if you were just starting today, with 0 knowledge about basically anything related to storage and how to do it right? That's my case, I'm learning before setting up a cheap home lab and a NAS, and I'm wondering if biting into ZFS is just the best option that I have given today's ecosystem.

I would still go with a collection of composable tools rather than something monolithic as ZFS, and to avoid the learning curve. But again, for personal use. If you're planning to use ZFS in a professional setting it might be good to experiment with it at home.

As mentioned in the sibling comment, one thing I like is having systems that don't require me to supervise, fix things, etc. In part that's why I've been alwas a user of ext4, it just works.

But I've recently found bitrotin some of my data files and now that I happened to be learning about how to build a NAS, I wanted to make the jump to some FS that helps me with that task.

Could you mention which tools you would use to replace ZFS? Think of checksumming, snapshotting, and to a lesser degree, replication/RAID.

Re: ZFS fans, rejoice – RAIDz expansion will be a thing soon

#103
post #63
post #32

Earlier quoted context omitted.

btrfs does have some advantages over zfs - no data duplicated between page cache and arc - no upgrade problems on rolling distros - balance allows restructuring the array - offline dedup, no need for huge dedup tables - ability to turn off checksumming for specific files - O_DIRECT support - reflink copy - fiemap - easy to resize

But the main thing of an fs is to preserve your files...btrfs can't even check the most important point.

I see this a lot but have never had problems with BTRFS and I’ve used it both on my larger disks (2+tb) and my root (250gb ssd) across multiple computers for the last four years.

Re: ZFS fans, rejoice – RAIDz expansion will be a thing soon

#104
post #2

I'll believe it when I see it, why anyone uses BTRFs (UnRaid or any other form of software raid that isn't ZFS) is still beyond me. At least when we're not talking SSD's ;) ZFS is incredible, curious to mess around with these new features!

I just put two 8TB drives into btrfs because it's a home server, I can't provision things up front. One day I may put a third 8TB drive and turn this RAID1 into RAID5. btrfs lets me do that, zfs doesn't, simple as. One day I may switch the whole thing to bcachefs, which I've donated and am looking forwards to. For the moment, btrfs will have to do. EDIT: downvoted by... the filesystem brigade?

There are a large group of people who really dislike BTRFS. I think they were probably burned by it at some point but I’ve never had trouble and I’ve been using it since it became the default on fedora.

Re: ZFS fans, rejoice – RAIDz expansion will be a thing soon

#105
> Data newly written to the ten-disk RAIDz2 has a nominal storage efficiency of 80 percent—eight of every ten sectors are data—but the old expanded data is still written in six-wide stripes, so it still has the old 67 percent storage efficiency.

This makes this feature quite ‘meh’. The whole goal is capacity expansion and you won’t be able to use the new capacity unless you rewrite all existing data, as I understand it.

This feature is mostly relevant for home enthusiasts and I think it doesn’t really bring the desired behavior this user group wants and needs.

> Undergoing a live reshaping can be pretty painful, especially on nearly full arrays; it's entirely possible that such a task might require a week or more, with array performance limited to a quarter or less of normal the entire time.

Not an issue for home users as they often don’t have large work loads thus this process is fast and convenient. Even if it would take two days.

Re: ZFS fans, rejoice – RAIDz expansion will be a thing soon

#106
post #53

this might sound like a troll comment but its coming from someone with almost zero experience with raid. What is the purpose of ZFS in 2021 if we have hardware RAID and linux software RAID? BTRFS does RAID too. Why would people choose ZFS in 2021 if both Oracle and Open Source users have 2 competing ZFS? are they interoperable?

I can't speak with much experience, but what I have gleamed is. - You generally want to avoid hardware raid, if the card dies you'll likely need to source a compatible replacement vs. grabbing another SATA/was expander and reconstructing the array. - zfs handles the stack all the way from drives to filesystem, allowing them to work together (i.e filesystem usage info can better dictate what gets moved around tiered s…

My understanding is that hardware RAID is mainly a thing in the Windows world, because apparently its software RAID implementation is garbage

Re: ZFS fans, rejoice – RAIDz expansion will be a thing soon

#108
post #82

The article is a great example of all the somewhat surprising peculiarities in ZFS. For example, the conversion will keep the stripe width and block size, meaning your throughput of existing data won't improve. So it's not quite a full re-balance. Other fun things are the flexible block sizes and their relation to the size you're writing and compression ... Chris Siebenmann has written quite a bit about it ( https://…

> The article is a great example of all the somewhat surprising peculiarities in ZFS. For example, the conversion will keep the stripe width and block size, meaning your throughput of existing data won't improve. So it's not quite a full re-balance. This is generally in-line with other ZFS operations. For example, changing compression policies will not rewrite existing data and only new data is affected. It simplifie…

[deleted]

Re: ZFS fans, rejoice – RAIDz expansion will be a thing soon

#109
post #51

Earlier quoted context omitted.

ZFS likes RAM and uses it to get better performance (and don't think about using dedup without huge ram), but you don't need it and can change the defaults. ECC tends to attract zealots after a perfect error-free existence which ECC does tend towards but doesn't deliver, it just reduces errors. I personally don't care about a tiny amount of bit rot (zfs will prevent most of this) and rebooting my storage machine now…

Does rebooting help with soft errors in non-ECC RAM? I would have thought bit flips would be transient in nature, but I'm not really familiar.

Running ZFS (FreeNAS/TrueNAS) on 2 home made NAS devices for years and years, I can say it is rock solid without ever using ECC RAM due to lack of choices. I can bet there were many soft-errors in all these years, but so far I never had problems that could not be recovered; the biggest issue ever was destroying the boot USB storage in months, but that was partially solved lately, I moved to fixed drives as boot drive and later I moved to virtualization for boot disk and OS, so the problem completely went away.

Re: ZFS fans, rejoice – RAIDz expansion will be a thing soon

#110

Earlier quoted context omitted.

> why anyone uses BTRFs (UnRaid or any other form of software raid that isn't ZFS) is still beyond me. BTRFS can do after-the-fact deduplication (with much better performance than ZFS dedup) and copy-on-write files. And you can turn snapshots into editable file systems.

I think cloning a zfs snapshot into a writeable filesystem matches at least the functionality of btrfs writeable snapshots, but I could be ignorant about some use-cases.

Let's say you want to clear out part of a snapshot of /home, but keep the rest.

So you clone it and delete some files. All good so far, but the snapshot is still wasting space and needs to be deleted.

But to make this happen, your clone has to stop being copy-on-write. All the data that exists in both /home and the clone will now be duplicated.

And you could say "plan ahead more", but even if you split up your drive into many filesystems, now you have the problem that you can't move files between these different directories without making extra copies.

Post reply on HN