Any way to get commercial support for ZoL ?
In Praise of ZFS on Linux's ZED 'ZFS Event Daemon'
111–120 of 124 posts
Re: In Praise of ZFS on Linux's ZED 'ZFS Event Daemon'
#112Earlier quoted context omitted.
I would advice people to think about what they need. ZFS is fine, but it is overkill for most home applications and it has a pitfall related to extensibility. https://louwrentius.com/what-home-nas-builders-should-unders... https://louwrentius.com/the-hidden-cost-of-using-zfs-for-you... So it really depends on your needs. Statements as "ZFS is the best filesystem" are so meaningless. P.S. SSD caching often has no tang…
I use zfs in the home on one machine that runs nfsd and samba. I started doing that because I saw corruptions on magnetic disks at home. Some files were silently corrupted. I had no redundancy. I didn't know which files were "good" either. So now I have one multi disk machine running FreeBSD with zfs. Works well. Hardware isn't especially fancy. In the time since I have seen it catch hardware failures. I have seen it…
I've now seen two sata controller failures thanks to zfs. One on my own machine amd one on my parents. Both presented as if a drive failed but it was actually the port on the controller that failed. It'd start up fine but randomly reads (and probably writes) would just be corrupted and the disk would eventually stop talking. Changing disks wouldn't fix it, which is how I kmew it was the controller but replacing the controller made everything happy. It the resilvered with no issues.
Re: In Praise of ZFS on Linux's ZED 'ZFS Event Daemon'
#113Earlier quoted context omitted.
RAID-Z expansion is being worked on: https://github.com/openzfs/zfs/pull/8853 Last I checked BTRFS RAID5/6 was a dumpster fire and unusable in production. Have they actually open sourced the ability to fix bitrot detection with mdraid? If not, it's kind of irrelevant. So... once again down votes without response - BTRFS raid still isn't recommended and the file healing isn't compatible with MDRAID I assume and you ju…
If you're using RAID-Z on zfs, your comparison isn't fair. Rather than use RAID56 with btrfs, the equivalent would be to get 1 or 2 disk redundancy with raid1 or raid1c3.
Not really - RAIDZ is basically RAID5 without the write hole problem. ZFS equivalent to RAID1 is called 'mirror', and is... well, a mirror.
Re: In Praise of ZFS on Linux's ZED 'ZFS Event Daemon'
#114I'd love to switch to ZFS, but the RAM requirements are absurd. I don't have a separate storage server, and I'm not really to sacrifice 10GB of RAM (1GB/TB of storage if I'm to believe what I find through Google) on my home desktop just for it when the vast majority of my data could probably handle a rotted bit or two. I did briefly try ZFS on my laptop a year or so ago, and it ate up half of my RAM permanently. Sinc…
> I'd love to switch to ZFS, but the RAM requirements are absurd. I don't have a separate storage server, and I'm not really to sacrifice 10GB of RAM (1GB/TB of storage if I'm to believe what I find through Google) on my home desktop just for it when the vast majority of my data could probably handle a rotted bit or two. Please explain where this number comes from. I run ZFS on boxes with as little as 4GB of RAM, whi…
Its the recommemded setup if you want to use dedupe, aside from that it doesn't really meed more ram than any other fs.
Re: In Praise of ZFS on Linux's ZED 'ZFS Event Daemon'
#115I'd love to switch to ZFS, but the RAM requirements are absurd. I don't have a separate storage server, and I'm not really to sacrifice 10GB of RAM (1GB/TB of storage if I'm to believe what I find through Google) on my home desktop just for it when the vast majority of my data could probably handle a rotted bit or two. I did briefly try ZFS on my laptop a year or so ago, and it ate up half of my RAM permanently. Sinc…
That RAM is needed only when you run deduplication (you have to store the checksums of blocks that you deduplicate somewhere). If you don't, the RAM requirements are similar to other filesystems. On your home desktop, you don't have to run dedup. You will get still the bitrot protection.
Why wouldn't I want deduplication though? "You can use ZFS just fine, just turn off one of its most useful features." Really? And I'm being downvoted for it. Thanks, guys. You realize my home desktop is doubling as my storage, right? Which goes back to RAM requirements being an issue.
I hate the cargoculting on this fucking site.
Re: In Praise of ZFS on Linux's ZED 'ZFS Event Daemon'
#116I'd love to switch to ZFS, but the RAM requirements are absurd. I don't have a separate storage server, and I'm not really to sacrifice 10GB of RAM (1GB/TB of storage if I'm to believe what I find through Google) on my home desktop just for it when the vast majority of my data could probably handle a rotted bit or two. I did briefly try ZFS on my laptop a year or so ago, and it ate up half of my RAM permanently. Sinc…
That zfs needs so much RAM is a myth that can be easily refuted. Start a Linux VM with hardly any RAM and let zfs run on it. Works great. There are also sources for this since years: https://www.reddit.com/r/DataHoarder/comments/3s7vrd/so_you_...
Look at the comments. He has barely any files on that server. "Yeah, you can use ZFS with barely any RAM."
(if you don't have any files) Doesn't do me much good with my 10TB's of data.
Re: In Praise of ZFS on Linux's ZED 'ZFS Event Daemon'
#117Qnap will hopefully have an ZFS based Home NAS out soon.
Are there any simple to use tools that automatically compare same files from different source and tell if they are different. I have multiple copies of Data but not knowing which file is corrupted and working through it is a pain in the bottom.
Re: In Praise of ZFS on Linux's ZED 'ZFS Event Daemon'
#118Earlier quoted context omitted.
That RAM is needed only when you run deduplication (you have to store the checksums of blocks that you deduplicate somewhere). If you don't, the RAM requirements are similar to other filesystems. On your home desktop, you don't have to run dedup. You will get still the bitrot protection.
Why wouldn't I want deduplication though? "You can use ZFS just fine, just turn off one of its most useful features." Really? And I'm being downvoted for it. Thanks, guys. You realize my home desktop is doubling as my storage, right? Which goes back to RAM requirements being an issue. I hate the cargoculting on this fucking site.
> Why wouldn't I want deduplication though?
On a desktop?
Chances are, that you don't have many users saving the same or slightly modified version of a file on the same storage. For a single person, it doesn't make much sense.
> "You can use ZFS just fine, just turn off one of its most useful features."
ZFS has many useful features. They come with a price though, because there's no free computation (see also laws of thermodynamics). It is then a matter of deciding, which features you want or need, and are willing to pay the price for.
You obviously are not willing the pay the price for dedup (lvmvdo asks for similar price, so it is not ZFS-specific), so why are you complaining that you cannot use it? ZFS still has many more useful features.
You also have another option: add RAM to your desktop. It is cheap. Then you will be able to use that one feature.
> I hate the cargoculting on this fucking site.
Sigh. I'm actually btrfs fan, all my data are on a btrfs volume (at work, we do use ZFS though, so I do have the experience). But that doesn't mean I won't point out something that the other club does well.
Re: In Praise of ZFS on Linux's ZED 'ZFS Event Daemon'
#119Earlier quoted context omitted.
RAID-Z expansion is being worked on: https://github.com/openzfs/zfs/pull/8853 Last I checked BTRFS RAID5/6 was a dumpster fire and unusable in production. Have they actually open sourced the ability to fix bitrot detection with mdraid? If not, it's kind of irrelevant. So... once again down votes without response - BTRFS raid still isn't recommended and the file healing isn't compatible with MDRAID I assume and you ju…
If you're using RAID-Z on zfs, your comparison isn't fair. Rather than use RAID56 with btrfs, the equivalent would be to get 1 or 2 disk redundancy with raid1 or raid1c3.
RAID-Z is the equivalent of RAID-5. RAID-Z2 is the equivalent of RAID-6. RAID-Z3 would be the equivalent of RAID-7 (or whatever the standard is named for 3-disk parity).
This is strictly speaking to how it deals with data and parity, the implementations are obviously different.
RAID-1 would be a mirror in ZFS parlance.
Re: In Praise of ZFS on Linux's ZED 'ZFS Event Daemon'
#120Earlier quoted context omitted.
That RAM is needed only when you run deduplication (you have to store the checksums of blocks that you deduplicate somewhere). If you don't, the RAM requirements are similar to other filesystems. On your home desktop, you don't have to run dedup. You will get still the bitrot protection.
Why wouldn't I want deduplication though? "You can use ZFS just fine, just turn off one of its most useful features." Really? And I'm being downvoted for it. Thanks, guys. You realize my home desktop is doubling as my storage, right? Which goes back to RAM requirements being an issue. I hate the cargoculting on this fucking site.
No one agree that dedup is most useful feature on ZFS. It is generally considered as useless feature unless you have special datasets.