Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: What distributed file system would you use in 2024?

news.ycombinator.com

Post reply on HN
Print view View original

1–10 of 15 posts

Ask HN: What distributed file system would you use in 2024?

#1

Post by pubg »

What distributed file system would you use for a greenfield homelab project today?

Requirements / desires:

* Reliable

* Performant

* Easy to setup and operate

Some options:

SeaweedFS - https://github.com/seaweedfs/seaweedfs

289 hits: https://hn.algolia.com/?dateRange=all&page=0&prefix=true&query=seaweedfs&sort=byPopularity&type=all

JuiceFS - https://github.com/juicedata/juicefs

2047 hits: https://hn.algolia.com/?dateRange=all&page=0&prefix=true&query=juicefs&sort=byPopularity&type=all

MooseFS - https://github.com/moosefs/moosefs

126 hits: https://hn.algolia.com/?dateRange=all&page=0&prefix=true&query=moosefs&sort=byPopularity&type=all

Do people still use Ceph or Gluster? I don't think they qualify as "easy to setup and operate".

Thanks!

Re: Ask HN: What distributed file system would you use in 2024?

#2

Post by pubg »

Clicky links:

SeaweedFS - https://github.com/seaweedfs/seaweedfs

289 hits: https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...

JuiceFS - https://github.com/juicedata/juicefs

2047 hits: https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...

MooseFS - https://github.com/moosefs/moosefs

126 hits: https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...

Re: Ask HN: What distributed file system would you use in 2024?

#4

Post by antongribok »

CephFS works great at home. I've got an all-Linux setup, and it works great on Laptops as they go to sleep and resume. Works great over Tailscale on a modile hotspot too.

My home cluster is running on some 7 Raspberry Pis currently, so it's not very performant, but the uptime over the past 2-3 years has been unbeatable.

With cephadm it's very easy to stand up, and upkeep has been basically zero.

Re: Ask HN: What distributed file system would you use in 2024?

#5

Post by hi-v-rocknroll »

HPSS or GPFS if you could get either. ;)

BeeGFS also locks away HA behind $$$.

Sure you could go with the Ceph easy button, but you could play around with Lustre+ZFS or pNFS. [0,1]

0. https://wiki.lustre.org/Managing_Lustre_with_the_ZFS_backend...

1. [2017, pdf] https://events.static.linuxfound.org/sites/events/files/slid...

Re: Ask HN: What distributed file system would you use in 2024?

#6

Post by tfolbrecht »

JuiceFS requires a backing object store like s3/minio that it “flushes” to persist data. If you want to run it distributed it uses a few other services.

I’d use object storage if I wanted simple in the replicated, jbod disk management and access control senses of simple. If I had to use file storage I’d use boring old sftp or smb on top of zfs on a NAS

Re: Ask HN: What distributed file system would you use in 2024?

#8

Post by JonChesterfield »

Based on documentation and reading various online things I was convinced to go with glusterfs. Then read some of the source code before rolling it out and reconsidered.

Ceph is probably solid but not simple.

Thus no distributed filesystem for me after all, one fast box running zfs instead. Couldn't convince myself that a ceph cluster would be more reliable in practice than the single box zfs with backups.

Re: Ask HN: What distributed file system would you use in 2024?

#10

Post by wmf »

zaphirplane wrote: post #9
wmf wrote: post #3

Rook is the easy to operate version of Ceph. I would definitely consider it since it's far more mature.

That’s a k8s operator for ceph. Don’t see how it’s more mature. Doesn’t it just use some version of ceph

I meant Ceph is more mature than the other filesystems mentioned.
Post reply on HN