Live data from Hacker News

OpenZFS 2.0

github.com

91–100 of 151 posts

Re: OpenZFS 2.0

#91

Has there been any progress on the zfs on linux Linus disagreement front since this article? https://arstechnica.com/gadgets/2020/01/linus-torvalds-zfs-s...

zfs on linux available as root partition since 20.04. Working quite well I might add!

It always worked, the question is how much work they have to do to work around a kernel that dislikes them.

Re: OpenZFS 2.0

#92
post #79

Earlier quoted context omitted.

zfs on linux available as root partition since 20.04. Working quite well I might add!

It's still a big pain if you like to keep your kernel relatively up to date. I switched to btrfs; it just working is worth the few extra warts over ZFS.

> It's still a big pain if you like to keep your kernel relatively up to date.

Replacing a core system component with an out-of-repo version is always going to hurt, yes.

> I switched to btrfs; it just working is worth the few extra warts over ZFS.

I'm not sure I'd call "catastrophic failure and data loss" a "wart". In all my years of distro hopping, I've had 3 root filesystems become unbootable: 1 F2FS system early on, which I actually did manage to fsck out of, and 2 on an openSUSE tubleweed system using BTRFS as root.

Re: OpenZFS 2.0

#93
post #79

Earlier quoted context omitted.

It's still a big pain if you like to keep your kernel relatively up to date. I switched to btrfs; it just working is worth the few extra warts over ZFS.

> It's still a big pain if you like to keep your kernel relatively up to date. Replacing a core system component with an out-of-repo version is always going to hurt, yes. > I switched to btrfs; it just working is worth the few extra warts over ZFS. I'm not sure I'd call "catastrophic failure and data loss" a "wart". In all my years of distro hopping, I've had 3 root filesystems become unbootable: 1 F2FS system early…

>and 2 on an openSUSE tubleweed system using BTRFS as root.

How long ago was that? and have you been using other fully checksummed filesystems (like ZFS) on that hardware since then? I'm asking because if you're using btrfs without any raid features (or with simple RAID modes like 1/0) for the past several years and it breaks, if you dig deep enough into the problem, often the hardware is found to be at fault.

And ext4 or xfs either don't find corruption at all (if it's data corruption), or have better error recovery if the FS's own metadata got trashed (which is a strong argument in favor of them, I agree, but I wouldn't trust such a filesystem anyway and would restore from backups right away).

Edit: it's a strong argument for storing data on them which is checksummed by some higher component in your software stack, like the database. Otherwise, you're just asking for silent data bitrot.

Re: OpenZFS 2.0

#94
post #79

Earlier quoted context omitted.

zfs on linux available as root partition since 20.04. Working quite well I might add!

It's still a big pain if you like to keep your kernel relatively up to date. I switched to btrfs; it just working is worth the few extra warts over ZFS.

Adding on, I've been using ZFS as my root partition on Arch with the latest kernel and zfs-dkms and have never had a problem.

Re: OpenZFS 2.0

#95

This is huge! And very exciting :D One thing I am wondering about is this: > Redacted zfs send/receive - Redacted streams allow users to send subsets of their data to a target system. This allows users to save space by not replicating unimportant data within a given dataset or to selectively exclude sensitive information. #7958 Let’s say I have a dataset tank/music-video-project-2020-12 or something and it is like 40…

That's a protocol problem, use a protocol such as rsync. You don't need to use redacted sends/recvs.

rsync has it's own issues if the connection has high latency though - zfs send was originally developed by a Sun engineer who wanted to speed up large transfers to servers in China, if I recall correctly.

Re: OpenZFS 2.0

#97
post #67
post #47

Earlier quoted context omitted.

>in the future XFS (when they have full check-summing). Is this actually planned?

YES! Step by step and keep XFS as stable as it is (the most trustworthy linux FS of them all)

During my last >15 years of Linux usage, I had exactly the two filesystems you are advocating for here crashing on me: - XFS, long time ago, had a bug that made it lose files silently - BTRFS twice, most recently about a year ago in a super simple setup (no raid or any other fanciness). I wasn't able to recover it, after a while I at least got it to mount as ro and copied the contents away

These were all on Gentoo, so with relatively recent tools and vanilla kernels.

The only filesystems that I never had problems with were ext4 and reiserfs.

Re: OpenZFS 2.0

#98

Has there been any progress on the zfs on linux Linus disagreement front since this article? https://arstechnica.com/gadgets/2020/01/linus-torvalds-zfs-s...

zfs on linux available as root partition since 20.04. Working quite well I might add!

That’s Ubuntu-specific where they provide their own kernel bundled with ZFS. It was working fine before 20.04 as well in the same way it does for other distros. Has nothing to do with the comment you’re replying to.

Re: OpenZFS 2.0

#99
post #84
post #78

Earlier quoted context omitted.

Why ZFS encryption vs unencrypted ZFS atop LUKS?

I wanted to say "as someone who tends to follow the unix philosophy" and realized the irony of saying that regarding ZFS... That said, I generally agree with you in that do one thing and do it well is a laudable design goal. However, I also am very excited about encrypted ZFS for one main reason: backups. Okay two. Snapshots and backups! ZFS is absolutely amazing to use as a home NAS that does daily (or more) snapsho…

Regarding "unix philosophy" and ZFS... it's actually very compliant with it, despite uninformed claims from early public release about "blatant layering violations".

It's just that majority of users never have reason to see more than tiny signs of the layers hidden behind (mostly) 2 command line tools, and for various reasons those layers are compiled into one one module.

But the clean layered design is how LustreZFS happened :)

Re: OpenZFS 2.0

#100
post #82

Earlier quoted context omitted.

Because traditionally, programs do one thing well. And in my experience LUKS works great.

If you're using ZFS, you're already okay with some level of ignoring that; ZFS is a inherently huge layering violation. It's a filesystem and a volume manager with encryption and compression, its own user access system (zfs allow), and its own NFS implementation.

Umm, that's untrue.

It's a very cleanly layered system, it just doesn't bother end user with details (as implementor, you can play with them, thus LustreZFS): there's separate SPA (block), DMU (OSD) and ZPL (FS) & ZVOL (emulated block device) layers.

Compression and encryption are integrated at DMU level because that's a logical place for them.

NFS actually calls OS nfs server.

Post reply on HN