FreeNAS: Open Source Storage Operating System • Hacker News Board

Re: FreeNAS: Open Source Storage Operating System

#91

Post by eric_the_read » Thu, Aug 25, 2016, 9:45 PM UTC

qwertyuiop924 wrote: post #86

eric_the_read wrote: post #77

One thing that's been unclear to me with ZFS: How should I design a ZFS-based storage system for extensibility? From what I've read, it seems like you can't add devices to a pool once it's been created. I'd love to create a small-ish NAS right now to store, say, the top 10% of my blu-ray collection, and then incrementally upgrade it over time as I get funds.

https://jsosic.wordpress.com/2013/01/01/expanding-zfs-zpool-...

Yeah, I saw that before, but that isn't quite what I wanted, if I'm reading it right. That tells me how to replace all the drives in my array with new ones; I'd prefer to (for instance) start with 4x 4TB drives, and add new ones as my storage needs build up.

Re: FreeNAS: Open Source Storage Operating System

#92

Post by eric_the_read » Thu, Aug 25, 2016, 9:45 PM UTC

yoasif_ wrote: post #89

eric_the_read wrote: post #77

One thing that's been unclear to me with ZFS: How should I design a ZFS-based storage system for extensibility? From what I've read, it seems like you can't add devices to a pool once it's been created. I'd love to create a small-ish NAS right now to store, say, the top 10% of my blu-ray collection, and then incrementally upgrade it over time as I get funds.

The easiest way to do this is to use mirror vdevs, that way you can add disks two at a time. Of course, you miss out on RAIDZ functionality that way, but that's the simplest setup. I've gone ahead and actually created a new array using btrfs raid10 instead (with an eye towards a RAIDZ2/3 like configuration whenever the btrfs guys get around to fixing it); btrfs allows for online reshaping of the mirroring configurati…

Can you do btrfs with FreeNAS? I didn't think that was available.

Re: FreeNAS: Open Source Storage Operating System

#93

Post by eric_the_read » Thu, Aug 25, 2016, 9:48 PM UTC

snvzz wrote: post #80

eric_the_read wrote: post #77

One thing that's been unclear to me with ZFS: How should I design a ZFS-based storage system for extensibility? From what I've read, it seems like you can't add devices to a pool once it's been created. I'd love to create a small-ish NAS right now to store, say, the top 10% of my blu-ray collection, and then incrementally upgrade it over time as I get funds.

You can add vdev to pool anytime. Removing them is not as easy, so some planning is necessary.

For others, I found this, explaining the process: http://alp-notes.blogspot.com/2011/09/adding-vdev-to-raidz-p...

Downside is, you lose a significant chunk of storage (the author measured > 20%), but you can add new storage to a pool online.

Re: FreeNAS: Open Source Storage Operating System

#94

Post by justinsaccount » Thu, Aug 25, 2016, 9:59 PM UTC

benologist wrote: post #17

tobias3 wrote: post #10

Earlier quoted context omitted.

I cannot find the source code of DSM. Are you sure it is Open Source? If it isn't Open Source this is off-topic since there is a large number of other commercial NAS OS e.g. Thecus, SoftNAS, QNAP, Napp-It... Most of them tend to have an "app store" and some people building more or less working apps out of Open Source and free projects.

https://sourceforge.net/projects/dsgpl/files/Synology%20NAS%... I think it's in there, their account's got a lot of files so it might be elsewhere. Latest version isn't published yet.

Proeject description: "The open source projects that ship with Synology NAS."

This is not the same thing as "The full source code for all components that ship with Synology NAS"

xpenology is an illegal mashup of some open source components with a large amount of binary blobs installed on top of it.

https://www.cachem.fr/xpenology-mot-fin/

It's fine if you want to use it, but don't kid yourself that you are using open source software.

To save effort, the 1.5G braswell-source.txz file, contains:

attr-2.4.44 tzdata linux-3.10.x u-boot-mv-3.5.9 gvfs-1.x freetds-0.x wvstreams-4.6.x systemd faac-1.28 upstart-1.x e2fsprogs-1.42-virtual-glibc freetype-2.x bridge-utils-1.4 bluez-4.x php-apcu-4.x ipmitool-1.8.x libpng-1.2.x libharu-2.x libcap-2.x libffi-3.x libusb-0.1.12 lnxlibnet gnupg-2.x synodb sysfsutils-2.1.0 nut-2.6 compat-wireless taglib-1.9.x imagemagick-6.9.x iptables-1.4.x readline-6.x apache-2.2.x-virtual-npn postgresql-9.3.x iproute2-2.6.31 zlib-1.x gzip-1.x libsynosmtp libnih-1.x libsoup-2.x sqlite-3.8.x imap-2007f netatalk-3.x u-boot-mv-3.6.0 hostapd-1 open-iscsi-2.0-871 mdadm ntfs-3g krb5-1.12.x gmp-6.x libevent-2.x apparmor-2.9.x procps-3.2.6 libxmltok-1.2 quota-tools-3.17 libical-0.x irqbalance backports libsynosdk-virtual-gpl libproxy-0.4.x Freescale_QorIQ_boot util-linux-2.x miniupnp-1.x iproute2-3.2.0 alsa-driver parted mhash-0.x bdb-5.x gnutls-3.2.x libdaemon-0.14 xtables-addons-1.x php-5.5.x ctdb-2.5.x coreutils-8.x e2fsprogs-1.42 ncurses-5.x-virtual-64 lame-398 nbnsd libgphoto2-2.1.99 alsa-lib-1.0.25 apache-2.2.x mDNSResponder-258.13 mod-fastcgi-2.x cups-1.5.x libexif-0.6.x tar-1.x debsig-verify-0.x php-5.5.x-virtual-module urftopdf kmod-16 openssh-6.x usbip-0.1.7 libpng-1.6.x curl-7.x pth-2.x xz-5.x gd-2.x libassuan-2.x neon-0.x libgcrypt-1.6.x rsync-3.x bdb.1.85 mbedtls-1.x bzip2-1.x wireless-tools.29 nettle-2.x uthash-1.9.x nss-pam-ldapd-0.8.x ssmtp-2.x wvdial-1.x usb-modeswitch-1.2.x libsynocore-virtual-gpl samba-4.x openssl-fips-2.0.x libdbi-0.9.x uclibc0929 cups-bjnp pcre-8.x u-boot-mv-3.5.3 sg3-utils ppp-2.4.x libaio-0.x libnl-2.x vmtouch u-boot-armada-2011.12 popt-1.x fuse-2.x libxml2-2.x syslog-ng-3.5.x libdbi-drivers-0.9.x u-boot-mv-3.4.4 eventlog-0.2.x libjpeg-turbo-1.x dosfstools28 u-boot-1.3.3 wget-1.x libksba-1.x intelce-utilities ndisc6-1.x x264 python-2.7.x opencore-amr-0.1.2 boost-1.x linux-firmware openssl-1.0.x wireless-iw cifs-utils-5.x libgpg-error-1.x iscsitarget-0.4.17 rp-pppoe-3.x busybox-1.16.1 json-c-0.x libmcrypt-2.5.8 logrotate-3.x dbus-glib-0.x openldap-2.4.x flex-2.5.4 u-boot-mv-3.4.27 util-linux-2.x-virtual-64 avahi-0.6.x gdbm-1.x glib-networking-2.x net-snmp-5.x ncurses-5.x ntp-4.2.8 flashcache jsoncpp expat-2.x libssh2-1.4.x lftp-4.x glib-2.x dnsmasq-2.x icu-53.x cyrus-sasl-2.1.22 ffmpeg-2.0.x linux-pam dbus-1.6.x suphp-0.7.x

other than

synodb libsynosmtp libsynosdk-virtual-gpl libsynocore-virtual-gpl

which are likely related to their SDK, is all standard linux packages.

Re: FreeNAS: Open Source Storage Operating System

#95

Post by yoasif_ » Thu, Aug 25, 2016, 10:01 PM UTC

eric_the_read wrote: post #92

yoasif_ wrote: post #89

Earlier quoted context omitted.

The easiest way to do this is to use mirror vdevs, that way you can add disks two at a time. Of course, you miss out on RAIDZ functionality that way, but that's the simplest setup. I've gone ahead and actually created a new array using btrfs raid10 instead (with an eye towards a RAIDZ2/3 like configuration whenever the btrfs guys get around to fixing it); btrfs allows for online reshaping of the mirroring configurati…

Can you do btrfs with FreeNAS? I didn't think that was available.

No, you have to go with Linux. I'm using the latest Ubuntu server LTS (since ZFS is also included, and because I'm familiar with Ubuntu).

I don't have experience with FreeNAS unfortunately.

Re: FreeNAS: Open Source Storage Operating System

#96

Post by otterpro » Thu, Aug 25, 2016, 10:01 PM UTC

yoasif_ wrote: post #89

eric_the_read wrote: post #77

One thing that's been unclear to me with ZFS: How should I design a ZFS-based storage system for extensibility? From what I've read, it seems like you can't add devices to a pool once it's been created. I'd love to create a small-ish NAS right now to store, say, the top 10% of my blu-ray collection, and then incrementally upgrade it over time as I get funds.

The easiest way to do this is to use mirror vdevs, that way you can add disks two at a time. Of course, you miss out on RAIDZ functionality that way, but that's the simplest setup. I've gone ahead and actually created a new array using btrfs raid10 instead (with an eye towards a RAIDZ2/3 like configuration whenever the btrfs guys get around to fixing it); btrfs allows for online reshaping of the mirroring configurati…

I agree that mirror is the best (i.e. simple and easy) way to do it, and to avoid raid-greed (http://constantin.glez.de/blog/2010/01/home-server-raid-gree...). Mirror (vs Raid-Z) gives us better fault-tolerance and flexibility.

Re: FreeNAS: Open Source Storage Operating System

#97

Post by lima » Thu, Aug 25, 2016, 10:03 PM UTC

rsync wrote: post #61

A FreeNAS device has the ability to do native ZFS send/recv to rsync.net.[1] Always remember to ask about the "HN Readers Discount". [1] http://www.rsync.net/products/zfsintro.html [2] http://arstechnica.com/information-technology/2015/12/rsync-...

Is there any way to use this and encrypt your data?