Live data from Hacker News

Btrfs in Linux 6.2 brings performance improvements, better RAID 5/6 reliability

phoronix.com

171–180 of 231 posts

Re: Btrfs in Linux 6.2 brings performance improvements, better RAID 5/6 reliability

#171
post #115

I'm still waiting for bcachefs upstreaming.

Yeah, looks like that one is actually designed to do what it does, not just "somehow implemented". The BTRFS bugs fixed in every kernel release for how many years now? are horrific and show that BTRFS is crawling with corner cases.

Re: Btrfs in Linux 6.2 brings performance improvements, better RAID 5/6 reliability

#172
post #10
post #4

Wonder if this will make it into Synology DSM 7.2. Seems unlikely based on the timing.

Unlikely, I am on DSM 7.1 and it is 4.4.180+, although I know heavily patched. I have read DSM 7.2 will land 5.10.

I don't think Synology ever update their kernel with DSM. So the kernel you get when you buy it will be the one that last for its life time.

But I do hope there will be model, especially entry model that comes with 5.10.

Synology's Linux timeline is simply too slow.

Re: Btrfs in Linux 6.2 brings performance improvements, better RAID 5/6 reliability

#173
post #122
post #86

Earlier quoted context omitted.

The way I used to do it (back then getting grub/initrd raid aware wasn't really doable - not sure about now) with mdadm was to use RAID1 on the boot volume such that a disk from a broken mirror was still usable by itself. Other volumes were RAID 5 or 10 etc.

How would a mirrored boot work in practice? Normally the first bootable partition gets loaded if it’s corrupt, it would keep failing at the same bad sectors. Would it randomly pick one of the bootable disks? That way you have an n-1/n chance of avoiding the bad disk?

"How would a mirrored boot work in practice?"

The same way it has worked for the past 30+ years: the firmware boots from first designated boot device; if that device isn't bootable, it moves on to the next one. The next one boots since it's part of a mirror and has all the necessary data to do so, and in the rare case where the device is "half bootable" one would simply intervene and select the next good bootable device manually.

Re: Btrfs in Linux 6.2 brings performance improvements, better RAID 5/6 reliability

#174
post #49

But is the RAID handling remotely sane yet? See https://arstechnica.com/gadgets/2021/09/examining-btrfs-linu... It has gems such as: * It won't boot on a degraded array by default, requiring manual action to mount it * It won't complain if one of the disks is stale * It won't resilver automatically if a disk is re-added to the array I think the first is the killer. RAID is a High Availability measure. Your system is…

Regarding resilvering, I am amazed by ZFS' capability of quickly bringing a stale mirror back into synchronization. I have used the FUSE port of ZFS to write only one member of a mirroset, then upon mounting both members elsewhere, the stale mirror was very quickly resilvered, so ZFS was able to determine only the blocks needing to be refreshed. In btrfs, I understand that this requires a rebalance, which will read/w…

No post body was provided.

Re: Btrfs in Linux 6.2 brings performance improvements, better RAID 5/6 reliability

#175

Earlier quoted context omitted.

Is there a zfs native way to create raid0 disks now? On Linux I usually set up a linear mapping with dmsetup, and then point zfs to that. But this hides the native disks from zfs. I've done that a couple times to make a bunch of mismatched disk fit into zfs's requirement that all are of the same size. The ability to work with a mix of disk sizes is one advantage of btrfs - if you remember to be extra careful on a dis…

> Is there a zfs native way to create raid0 disks now? zpool create swimming disk1 disk2 … That has worked for over 15 years.

This does not create a RAID 0 / stripe, but it is close.

Re: Btrfs in Linux 6.2 brings performance improvements, better RAID 5/6 reliability

#176

Earlier quoted context omitted.

The list of bugs and counter-intuitive design decisions in BTRFS RAID should make anyone pause before ever considering it as a viable filesystem for anything . It's like people justifying MySQL saying that it's okay for it to lose or corrupt data, and that transactional integrity doesn't matter as much as people say it does. Yeah, maybe if you're website is a blog. But anyone storing real data should run away screami…

I've had more issues with my ZFS arrays than the BTRFS ones. The Linux implementation is pretty awful, with it demanding that it uses the absolute `/dev/sdx` reference even if you try to build it using serials or other unchaging reference. Replace a disk and then after the next restart it fails to bring up the RAID because `sdf` points to a different disk. At least BTRFS uses internal UUIDs so can bring up the arrays…

Uh, using /dev/disk/by-id to assemble a zfs array is pretty standard for zol. I never use device names and shuffling disks has never required any manual intervention on my part. Was this a very old ZoL?

Re: Btrfs in Linux 6.2 brings performance improvements, better RAID 5/6 reliability

#177

But is the RAID handling remotely sane yet? See https://arstechnica.com/gadgets/2021/09/examining-btrfs-linu... It has gems such as: * It won't boot on a degraded array by default, requiring manual action to mount it * It won't complain if one of the disks is stale * It won't resilver automatically if a disk is re-added to the array I think the first is the killer. RAID is a High Availability measure. Your system is…

Remember that DM is still there for you even if you use btrfs.

Every discussion about btrfs immediately escalates to how the btrfs RAID support develops. But btrfs is useful on its own without that mode.

Should you wish to put a btrfs file system on software RAID (DM), you can still do that. The btrfs RAID modes are something else, where you cut the DM driver out of the picture. That's not going to be as well tested as plain old DM, even if it works, and it doesn't offer any functionality beyond plain DM RAID.

If the use case is storing real data, you want the data storage layer to be as well tested as possible. There's also more to software RAID than the block device. You want a mature resilvering daemon on a well tested schedule, and you need working monitoring to alert you of issues. RAID without monitoring will only delay the inevitable.

Re: Btrfs in Linux 6.2 brings performance improvements, better RAID 5/6 reliability

#178
post #115

I'm still waiting for bcachefs upstreaming.

Yeah, looks like that one is actually designed to do what it does, not just "somehow implemented". The BTRFS bugs fixed in every kernel release for how many years now? are horrific and show that BTRFS is crawling with corner cases.

Are you saying that complex software getting bug fixes is an indication of something? I don't see how it's a bad thing that btrfs has been squashing bugs and corner cases.

Re: Btrfs in Linux 6.2 brings performance improvements, better RAID 5/6 reliability

#180

Earlier quoted context omitted.

> That's the only purpose for it. That's not the only purpose for it. There's three reasons I can think of that you might set up a RAID array: * You want better uptime. (your use case) * You want to protect from data loss. (my assumption was that this is the most common use case, but I could be wrong. This also helps with uptime because there's nothing worse for uptime than having to restore lost data from a cold bac…

RAID 0 should be called AID, since it’s not really RAID.

The '0' says it exactly: the amount of data you are left with, once one of the drives fails.
Post reply on HN