Live data from Hacker News

A modular, extensible DIY NAS

blog.georgovassilis.com

31–40 of 113 posts

Re: A modular, extensible DIY NAS

#31

> I hear and read conflicting testimonies about ZFS which supposedly handles data corruption better and will give it a try at some point. For now, I use md5sum to create and verify checksums of my backup .tar.gz archives and parchive to create error recovery files. I’ve written about parchive before and remain to this day a dedicated fan. I’m very surprised you went through the trouble of building such an amazing NAS…

Thanks. I haven't tried ZFS so far for historical reasons: the post describes the latest evolution of my NAS; in fact, there were several hardware versions before with the hard disks being transplanted (and later upgraded) from the previous to the next. The filesystem structures are over a decade old, having been upgraded from ext2 to ext3 and now ext4. The next thing I will try out is dm-integrity.

I bookmarked a ZFS-inspired storage system for preserving data integrity, and dm-integrity has a role there:

https://insanity.industries/post/preserving-data-integrity/

Hacker News discussion: https://news.ycombinator.com/item?id=24372662

Re: A modular, extensible DIY NAS

#32
A NAS seems like a nice way to consolidate my photoalbums and have redundancy in terms of physical storage. But that whole cloud thingy is something I don't need, heck, I don't want!

I would say that a good router is the way to go and I think I should replace the one my ISP has given me. Can anyone point me in the direction for a guide to a hardware router and appropriate firmware, so I can be sure to control what the NAS (or any other device within the network) can connect to on "the internet"?

Re: A modular, extensible DIY NAS

#33
Been building DIY NAS servers for 15 years for my personal use. ZFS with initially OpenSolaris, then FreeBSD. Typically 5 to 7 drives in raidz2.

I found it very strange the guy is happy with & measured 100 Mbps throughput over the network. Any 2+ drive NAS from the last 5 years should be able to saturate a 1Gbps link.

Re: A modular, extensible DIY NAS

#34
post #33

Been building DIY NAS servers for 15 years for my personal use. ZFS with initially OpenSolaris, then FreeBSD. Typically 5 to 7 drives in raidz2. I found it very strange the guy is happy with & measured 100 Mbps throughput over the network. Any 2+ drive NAS from the last 5 years should be able to saturate a 1Gbps link.

I think the OP means 100 MB/s and not 100 Mbps here

Re: A modular, extensible DIY NAS

#35
post #32

A NAS seems like a nice way to consolidate my photoalbums and have redundancy in terms of physical storage. But that whole cloud thingy is something I don't need, heck, I don't want! I would say that a good router is the way to go and I think I should replace the one my ISP has given me. Can anyone point me in the direction for a guide to a hardware router and appropriate firmware, so I can be sure to control what th…

Sounds like you’re looking for a router that supports OpenWRT

Re: A modular, extensible DIY NAS

#36
I've relied on hardware RAID over one hardware failure, for the first and last time.

We were running some services on a stack of older Dell servers with mostly identical hardware. The RAID controller and mainboard on one of them let the magic smoke out. We (a sysadmin team of three) promptly decided to move the RAID array to another unused server in the stack in order to avoid a lengthy reinstall and manual restoring of daily backups – this happened before the almost-one-click provisioning of devops and virtualization tools was the norm.

The other server lacked the RAID license dongle that was on a pin header on the mainboard, so we just tried to cannibalize it from the server corpse that barely had stopped smoking. The new mainboard promptly rejected the license because the service tag differed, and the only way to change it was to install Windows 95 or 98 and run the tag changer tool. In addition, we had to downgrade the controller firmware to match that of the old one. One nightlong unattended rebuild later, the server was up and running the next morning.

When we upgraded the server hardware a bit later, we migrated it over to mdraid and haven't had any problems with hardware failures since.

Moral of the story: If you are depending on certain hardware features, you need to have a cold spare available with identical hardware and firmware. If you cannot afford one, it's better to either use a software implementation, have a really good service contract with the vendor or just let a VM provider take care of your infrastructure.

Re: A modular, extensible DIY NAS

#37
I've been using Unraid - https://unraid.net/ - for the past few years now (after playing around with countless FreeNAS and custom setups).

I'm really impressed with how stable it is - never had any issues with it and no dataloss, even with a couple of hard drive failures along the way.

I know many of you will prefer to customise everything and take a deep dive into the way things are set up, but I really do enjoy the simplicity of Unraid.

Re: A modular, extensible DIY NAS

#38

I've relied on hardware RAID over one hardware failure, for the first and last time. We were running some services on a stack of older Dell servers with mostly identical hardware. The RAID controller and mainboard on one of them let the magic smoke out. We (a sysadmin team of three) promptly decided to move the RAID array to another unused server in the stack in order to avoid a lengthy reinstall and manual restoring…

> Moral of the story: If you are depending on certain hardware features, you need to have a cold spare available with identical hardware and firmware. If you cannot afford one, it's better to either use a software implementation, have a really good service contract with the vendor or just let a VM provider take care of your infrastructure.

+1 for this. Hardware raid absolutely has its place, but if you expect to be able to rebuild an array without restoring from a backup, you absolutely need to have spare parts that are tested in advance.

Also, RAID is not a backup. RAID provides high(er) availability. You need to have backups still!

Re: A modular, extensible DIY NAS

#40
So I had this QNAP TS451+ sitting and gathering dust after a move. I had no interest in dealing with the terrible QNAP OS on it and wanted to do something open source.

The only somewhat difficult part was preserving data from the old disks as QNAP has custom extensions to LVM or MDRAID which work nowhere else. So there were a few back and forth of removing a few disks from the pool, rebooting to a normal linux, formatting them without the custom garbage, booting back and copying over.

In the end I decided to go with NixOS as I've already used it on my laptop/desktop for about 5 years. I also wanted a modern CoW file system and went with bcachefs. Getting it working with NixOS takes some fiddling, especially if you also want encryption but it works. It now runs samba, matrix-synapse and soon maybe nextcloud. Not quite there yet with everything but quite happy that I went down this route.

The only thing missing from the HW side is an SSD, but the box has USB3 and UAS support so I might add an external one that bcachefs can use as a faster tier.

Post reply on HN