Viewing profile — daviesliu

JuiceFS can be scaled to hundreds of PB by design, also is verified by thousands of users in production [1]. [1] https://juicefs.com/en/blog/company/2025-recap-artificial-in...

Founder of JuiceFS here, congrats to the Launch! I'm super excited to see more people doing creative things in the using-S3-as-file-system space. When we started JuiceFS back in 20…

This post said another topic: how to backup the metadata of JuiceFS in readable format (JSON) and restore it into an empty database.

The recover process is similar to what a database does after a crash, it loads the recent snapshot in disk and apply any newer transaction logs.

The S3 API allow user to specify the hash of content as HTTP header, it will be verified by the JuiceFS gateway and persisted into JuiceFS as ETag. With POSIX API or HDFS, there is…

JuiceFS relies on the object store to provide integrity for data. Besides that, JuiceFS stores the checksum of each object as tags in S3, and verifies that when downloading the obj…

The company may want the product to be difficult to use, so they can sell more support, that's not win-win for both sides.

Agreed, the all-in-one solution (Ceph) should be better, if you have to setup all the components. If you already have the infra (databases and object stores), then JuiceFS is the e…

JuiceFS is similar to HDFS/CephFS/Lustre, so it MUST has a component to manage metadata, similar to NameNode of HDFS or MDS of CephFS, this point of failure is the problem we have …

If you really expect a file system experience over GCS, please try JuiceFS [1], which scales to 10 billions of files pretty well with TiKV or FoundationDB as meta engine. PS, I'm f…

Usually the meta engine or object storage can scale horizontally by itself, JuiceFS is middleware to talk to these two services. To serve S3 request, you can setup multiple S3 gate…

Agreed, it's very hard, that's why GFS and HDFS had give up some parts of POSIX compatibility. Per CAP, it's addressed by different meta engines (CP system, Redis, MySQL, TiKV) and…

Atomic file/directory renames/moves is the fundamental feature of JuiceFS, which makes it truely a file system rather than a proxy to S3, please check the docs for all the compatib…

This is an experimental feature to do this, still working on it.

It's doable to run a MinIO gateway on top of CephFS mount point, but that will has performance issue, especially for multipart-upload and copy. That's why we put MinIO and JuiceFS …

Yes, JuiceFS uses the Apache 2 fork [1] directly (master branch), but also provide a full featured S3 gateway (gateway branch) under AGPL for people' choice. [1] https://github.com…

Yes, the data can be encrypted [1] by the client before sending to S3, but the metadata is not encrypted. [1] https://juicefs.com/docs/community/security/encrypt

The button to switch language is at the bottom of right-top menu, we will fix that.

Apache Ozone is not POSIX compatible, even with the File System Optimized format [1]. https://ozone.apache.org/docs/current/feature/prefixfso.html

99.99999999% reliability means you will not loss more than one byte in every 10 GB in a year. JuiceFS uses S3 as the underlying data storage, so S3 provides this durability SLA.

Yes, we picked the default one in docs, which should be NFS v3, will redo the test against NFS v4 and update the article, thanks!

Azure has Azure Files and Azrue NetApp Files, the later one is provided from NetApp. Azure Files was used in the article, maybe you are using NetApp Files? We will update the artic…

Juicedata Inc is a US company, was registered in Delaware. The founding team are Chinese. ps, I'm the founder of Juicedata.