Live data from Hacker News

Bcachefs: “the COW filesystem for Linux that won't eat your data”

bcachefs.org

81–90 of 110 posts

Re: Bcachefs: “the COW filesystem for Linux that won't eat your data”

#81
post #40
post #21

I've been using btrfs since about 2011, and I've stopped using ext4 / xfs / zfs everwhere since about 2014. From 2012-2014 it was mostly breakage every other month. From 2014-2016, it was semi-annual issues. For the last ~18 months I have had ~30 machines running btrfs with no issues, some servers, some personal computers. The release notes are boring, the bugs are boring, and to me its definitely in a state I would…

Me too. I love it, but only with raid-1 or no raid. btrfs as a filesystem will be dead within the next 12 months unless they fix raid-5 and raid-6.

I think RAID 5/6 will be dead before btrfs.

Re: Bcachefs: “the COW filesystem for Linux that won't eat your data”

#82
post #60

Earlier quoted context omitted.

ZFS is not GPL? I dunno, I like feeling safe when I do kernel upgrades knowing even if for whatever reason my ZFS module doesn't compile/work under the new kernel, I won't be left without a root FS. I have been running BTRFS for 5 years with very little issues, and enjoy not having to compile a new dkms module with every kernel.

ZFS with DKMS is a disaster, at least in my experience. Honestly, I can't recommend ZoL unless you're running a distro with relatively stable kernel releases that don't change substantially or that happens to be supported by ZoL with binary packages. ZoL on Arch was... trying at times. It worked great, but my paranoia meant that I ended up adding the kernel to IgnorePkg to force manual kernel updates (mostly for my o…

I have been running ZFS on Arch Linux for a little over two years across four drives, and doing weekly updates. Haven't ran into any issues yet.

Re: Bcachefs: “the COW filesystem for Linux that won't eat your data”

#83
post #52

Earlier quoted context omitted.

Well, there are other reasons; you want to write code that operates on the data, and neither the code nor the data fits on a single machine - you have to target an abstraction which spans machines. Block storage is too low-level an abstraction. That isn't to say that using high performance block storage isn't still a win even when the redundancy is multiplied at a higher level. The higher level redundancy is also abo…

Block storage can be network-abstracted. Even virtual memory for that matter. Now ancient concept: https://en.wikipedia.org/wiki/Distributed_shared_memory

Of course. Most production monoliths are deployed on networked block storage - aka SAN - and NUMA is already structurally distributed memory, even on a single box. But it's not the right paradigm to scale well, no more than chatty RPC that pretends the network doesn't exist is the right way to design a distributed system.

Re: Bcachefs: “the COW filesystem for Linux that won't eat your data”

#84

Chris Mason and the btrfs team are clearly talented. But the initial excitement of btrfs has sadly dissipated and its promise as the next generation Linux fs remains unrealised. It now feels a bit jaded and the momentum is spent. I suspect many have lost patience with the promise of COW and unfortunately for bcachefs this history will cast a shadow on its development and potential. Database performance remains proble…

I don't think COW in general is a big issue for databases. You can get pretty good performance for ZFS (very stable and consistent behavior), for example. The COW is not free, of course, but you get interesting features in return, and if you need them (e.g. snapshots), it's usually much better than LVM + non-COW filesystem.

The fact that some COW filesystem perform poorly does not mean all COW filesystems do.

Re: Bcachefs: “the COW filesystem for Linux that won't eat your data”

#85
post #15

Earlier quoted context omitted.

At first glance, the status page of btrfs look horrible: https://btrfs.wiki.kernel.org/index.php/Status The problem areas are mostly RAID and exotic features. RAID can be handled by a different layer and most users don't really need the exotic features. Judging from the media silence in the last months I'd say either people stopped using btrfs or it just about works good enough for everbody.

when the RAID is handled by a different layer you lose some very important integrity features

RAID 5/6 in btrfs doesn't have data integrity features so you're back to square 1 on this regard.

Re: Bcachefs: “the COW filesystem for Linux that won't eat your data”

#86
post #21

I've been using btrfs since about 2011, and I've stopped using ext4 / xfs / zfs everwhere since about 2014. From 2012-2014 it was mostly breakage every other month. From 2014-2016, it was semi-annual issues. For the last ~18 months I have had ~30 machines running btrfs with no issues, some servers, some personal computers. The release notes are boring, the bugs are boring, and to me its definitely in a state I would…

What kind of workloads are you using it for?

Re: Bcachefs: “the COW filesystem for Linux that won't eat your data”

#87
post #60

Earlier quoted context omitted.

ZFS is not GPL? I dunno, I like feeling safe when I do kernel upgrades knowing even if for whatever reason my ZFS module doesn't compile/work under the new kernel, I won't be left without a root FS. I have been running BTRFS for 5 years with very little issues, and enjoy not having to compile a new dkms module with every kernel.

ZFS with DKMS is a disaster, at least in my experience. Honestly, I can't recommend ZoL unless you're running a distro with relatively stable kernel releases that don't change substantially or that happens to be supported by ZoL with binary packages. ZoL on Arch was... trying at times. It worked great, but my paranoia meant that I ended up adding the kernel to IgnorePkg to force manual kernel updates (mostly for my o…

Arch Linux has a LTS kernel available in official repo. Why not using that?

Re: Bcachefs: “the COW filesystem for Linux that won't eat your data”

#88
post #54

To press this point: If you think we need an alternate effort and/or competition to build an advanced, native filesystem for Linux (I do), please consider a subscription on Patreon ( https://www.patreon.com/bcachefs ). Kent has a long history of shipping sophisticated, high-quality code.

Sent some money that way. I'd like to have a working ZFS like filesystem in the kernel.

Re: Bcachefs: “the COW filesystem for Linux that won't eat your data”

#89
post #30

Earlier quoted context omitted.

I think Chris Mason is open with that raid support is not really stable yet, right? Status page says so: https://btrfs.wiki.kernel.org/index.php/Status

As far as I know they consider RAID0, 1, and 10 to be stable. Last time I used it rebuilds were substantially slower than ZFS or mdraid. Rebuild performance seems to one of a few issues that BTRFS has had trouble solving. RAID 5 and 6 were declared stable last year, only to have that retracted when some fatal flaw was discovered that would apparently cause data loss if you needed to rebuild.

It's mostly true but the issues as far as I know are:

- RAID 1 with more than 2 disks is not what you think it is: the data will be mirrored but only once, no matter how many disks you have (meaning if you have a mirror with 3 disks, you only have 2 copies of your data). Because in BTRFS lingo, RAID 1 means '2 copies of the data' https://btrfs.wiki.kernel.org/index.php/FAQ#What_are_the_dif... which is not what people expect from RAID 1 with more than 2 disks

- RAID 1 always needs 2 disks to be working, if not you can't mount the thing... Well you can, but only once... https://btrfs.wiki.kernel.org/index.php/Gotchas#raid1_volume...

- RAID 10 inherits these special RAID 1 cases as a result

Most of that stuff is described here: https://btrfs.wiki.kernel.org/index.php/Status

So as they say on the status page: "mostly ok"

Re: Bcachefs: “the COW filesystem for Linux that won't eat your data”

#90

Here's a funny story. At one point bcache development was funded by a startup (which I won't name here). They were using it as the local storage layer of a distributed storage product. I worked there for a year in 2014. Apparently they were not aware of the fact that bcache was a) GPLd code, or b) developed before the company existed, first as a hobby project and then at Google. After a couple of years, they noticed…

His Patreon page[1] shows he only receives $762 in donations a month, less than a third of what he needs to keep from eating into his personal savings. Sad given how much a modern filesystem would help Linux : ( [1]: https://www.patreon.com/bcachefs

> As far as I know, they're still actively violating the GPL

Maybe he can get extra money from a lawsuit?

Post reply on HN