Live data from Hacker News

An implementation of the NTFS filesystem in a Rust crate

github.com

41–50 of 54 posts

Re: An implementation of the NTFS filesystem in a Rust crate

#41

Earlier quoted context omitted.

Is ReFS real? Like does anyone really use it outside of Microsoft's labs?

The Windows 11 feature "Dev Drive" uses ReFS. https://learn.microsoft.com/en-us/windows/dev-drive/

Pretty cool, I'd never seen that before. Thanks

Re: An implementation of the NTFS filesystem in a Rust crate

#42
post #29

Earlier quoted context omitted.

Never using btrfs no matter how default it comes. Only filesystem I've had data loss with, 2 district occasions.

Would you mind noting how recent the data loss was?

Latest in the past year or so. All long after it was "stable".

Re: An implementation of the NTFS filesystem in a Rust crate

#43
post #42

Earlier quoted context omitted.

Would you mind noting how recent the data loss was?

Latest in the past year or so. All long after it was "stable".

Appreciate it. As someone who basically continues to use ZFS happily and didn't kick the tires because of the stability & ergonomics issues in the past, this is concerning to hear...

Looks like kicking the tires will remain somewhat in the future for me.

Re: An implementation of the NTFS filesystem in a Rust crate

#44
post #42

Earlier quoted context omitted.

Would you mind noting how recent the data loss was?

Latest in the past year or so. All long after it was "stable".

It's much stable after 6.4 kernel. Last year was not really stable yet. I faced too, problem is I didn't know we have to schedule a `btrfs scrub`. After kernel update and scrub, everything works smooth.

Re: An implementation of the NTFS filesystem in a Rust crate

#45
post #29

Earlier quoted context omitted.

My bet is that btrfs will replace ext4 in the nearish future. It's the default for Arch, which also comes default with filesystem snapshots before any system updates. It's pretty nice. I think it also supports some flavor of volumes or virtual partitions, but I don't have any real use for that kind of thing. The snapshots are really good though. Very fast and don't take up a ton of space, somehow.

Never using btrfs no matter how default it comes. Only filesystem I've had data loss with, 2 district occasions.

yeah, I managed to corrupt my btrfs on my laptop a few months ago (loose memory stick causing crash at bad time, apparently). I was able to recover almost everything with btrfs-restore (my latest backup was several weeks old then) but it was still not a pleasant experience...

Re: An implementation of the NTFS filesystem in a Rust crate

#46
post #29

Earlier quoted context omitted.

My bet is that btrfs will replace ext4 in the nearish future. It's the default for Arch, which also comes default with filesystem snapshots before any system updates. It's pretty nice. I think it also supports some flavor of volumes or virtual partitions, but I don't have any real use for that kind of thing. The snapshots are really good though. Very fast and don't take up a ton of space, somehow.

Never using btrfs no matter how default it comes. Only filesystem I've had data loss with, 2 district occasions.

Same, I can reliably break my NVMe RAID10 by simply pulling power

Not like, "hehe we need to sync", but "good luck repairing, enjoy probably formatting"

LVM/MD RAID, ZFS, etc all behave fine. Only BTRFS is this fragile.

Re: An implementation of the NTFS filesystem in a Rust crate

#47

Question for the experts! Has NTFS changed much in... 20 years? Linux filesystems seem to be evolving all the time (try to install any new distro today and check out how many filesystems you can pick from the dropdown...) Apple replaced one filesystem with another in just the past few years, with apparently some very advanced new features. But NTFS is just... NTFS? Does NTFS today look anything like how it looked in…

> Linux filesystems seem to be evolving all the time (try to install any new distro today and check out how many filesystems you can pick from the dropdown...) This sounds like evolution of options more than evolution of existing file systems Is ext4 still not most popular for most end users? Curious how much ext4 has changed vs NTFS past... ~20 years (ext4 went stable 2008 apparently)

ext2/3/4 are the same on-disk filesystem with features added, so could also compare the timeline from the 90's. NTFS and ext2 have the same year (1993) listed on WP as intro date.

Re: An implementation of the NTFS filesystem in a Rust crate

#48

Earlier quoted context omitted.

NTFS has gained support for a few features over the years, but it wasn't meant to evolve, much. Microsoft knew what they wanted from the filesystem and they wrote it to spec very early in its life. ReFS on Windows is where the changes are coming to. finally a 1st party filesystem which supports Copy on Write file cloning. a lot of core features of NTFS aren't supported on ReFS, so it's clearly not intended to be a re…

Windows recently got support for booting from ReFS volumes, so it seems like Microsoft has started working on it again and maybe does think a move away from NTFS is possible in the future.

until ReFS supports compression, encryption, quotas, OneDrive support, and whatever else is missing, NTFS isn't going anywhere.

they're gonna live side by side for 30+ years. they are meant for different uses.

Re: An implementation of the NTFS filesystem in a Rust crate

#49
post #3

This is pretty great. I've been wanting to make a simple utility that can scan an NTFS drive for a filename pattern; scanning the MFT is incredibly fast versus using the actual filesystem API calls to do so.

Sounds exactly like Everything ( https://www.voidtools.com/ ) - do check it out if you're not aware of this tool.

Everything is one of those things that are so obvious that it hurts it's not offered by default on operating systems (even Linux and Mac).

Why go the effort to index the files in a filesystem when the filesystem IS an index in itself? Just query it directly

Re: An implementation of the NTFS filesystem in a Rust crate

#50
Author here. Surprised to suddenly find my project from 2021 on Hacker News!

If you want to learn more about NTFS internals and my crate, check out the talk I gave at FOSDEM 2022: https://archive.fosdem.org/2022/schedule/event/misc_ntfs_rus...

Also I'm open to any questions here.

Post reply on HN