832 TB – ZFS on Linux • Hacker News Board

832 TB – ZFS on Linux

#1

Post by beagle3 » Sat, Aug 05, 2017, 5:03 PM UTC

Re: 832 TB – ZFS on Linux

#2

Post by 4ad » Sat, Aug 05, 2017, 6:20 PM UTC

    you can run ZFS on Ubuntu [...] You could also build this on Solaris with necessary licensing if you wanted to that route but it’d be more expensive.

I find it bewildering the author didn't even consider illumos or FreeBSD, where ZFS is a first class citizen.

Re: 832 TB – ZFS on Linux

#3

Post by howeyc » Sat, Aug 05, 2017, 6:29 PM UTC

4ad wrote: post #2

you can run ZFS on Ubuntu [...] You could also build this on Solaris with necessary licensing if you wanted to that route but it’d be more expensive. I find it bewildering the author didn't even consider illumos or FreeBSD, where ZFS is a first class citizen.

I thought the same thing, they sort of answers in the comments.

Something about freenas saying no support and that the put together systems from iXsystems have lower drive bay counts.

My guess is they just prefer Linux. FreeBSD or illumos would definitely work.

Re: 832 TB – ZFS on Linux

#4

Post by twiss » Sat, Aug 05, 2017, 6:44 PM UTC

> I purchased these units through a vendor we like to use and they hooked us up, so I won’t be able to share my specific pricing. (...) If you build the systems out on there you’ll find that they come in around $35,000 (USD) each.

That devided by 52 x 8 = 416TB is 0.084$/GB. For comparison, the Backblaze Storage Pod 6.0 [1] claims 0.06$/GB for the version with the same hard drives. Although this version has a bunch of extra features like 2 x 800GB SSD's for ZFS SLOG, 8x more RAM for a total of 256GB, etc.

[1]: https://www.backblaze.com/blog/open-source-data-storage-serv...

Re: 832 TB – ZFS on Linux

#5

Post by qeternity » Sat, Aug 05, 2017, 6:48 PM UTC

4ad wrote: post #2

you can run ZFS on Ubuntu [...] You could also build this on Solaris with necessary licensing if you wanted to that route but it’d be more expensive. I find it bewildering the author didn't even consider illumos or FreeBSD, where ZFS is a first class citizen.

For someone not very up to date with all the various ZFS flavors, can you please explain this a bit?

Re: 832 TB – ZFS on Linux

#6

Post by seany » Sat, Aug 05, 2017, 6:58 PM UTC

4ad wrote: post #2

you can run ZFS on Ubuntu [...] You could also build this on Solaris with necessary licensing if you wanted to that route but it’d be more expensive. I find it bewildering the author didn't even consider illumos or FreeBSD, where ZFS is a first class citizen.

I run napp-it on omni-os at home and work with good results. It's not too hard to adapt your linux knowledge if you're not used to the solaris-ish userspace.

Re: 832 TB – ZFS on Linux

#7

Post by rsync » Sat, Aug 05, 2017, 7:05 PM UTC

"I ended up between the Supermicro SSG-6048R-E1CR60L or the SSG-6048R-E1CR90L – the E1CR60L is a 60-bay 4U chassis while the E1CR90L is a 90-bay 4U chassis. This nice part is that no matter which platform you choose Supermicro sells this only as a pre-configured machine – this means that their engineers are going to make sure that the hardware you choose to put in this is all from a known compatibility list. Basically, you cannot buy this chassis empty and jam your own parts in"

This is a major departure from the Supermicro business model and practices and basically broke all of our next generation expansion roadmaps.

This was not a technical decision - it is the same old economic decision that every large VAR/integrator/supplier has succumbed to for the last 30 years. They aren't the first ones to try this trick and they won't be the last.

We (rsync.net) are not playing ball, however. After 16 years of deploying solely on supermicro hardware (server chassis and JBODs) we bought our first non-supermicro JBOD last month.

Re: 832 TB – ZFS on Linux

#8

Post by wmf » Sat, Aug 05, 2017, 7:08 PM UTC

rsync wrote: post #7

"I ended up between the Supermicro SSG-6048R-E1CR60L or the SSG-6048R-E1CR90L – the E1CR60L is a 60-bay 4U chassis while the E1CR90L is a 90-bay 4U chassis. This nice part is that no matter which platform you choose Supermicro sells this only as a pre-configured machine – this means that their engineers are going to make sure that the hardware you choose to put in this is all from a known compatibility list. Basicall…

What specifically is the problem? Overpriced drives?

Re: 832 TB – ZFS on Linux

#9

Post by overcast » Sat, Aug 05, 2017, 7:09 PM UTC

qeternity wrote: post #5

4ad wrote: post #2

you can run ZFS on Ubuntu [...] You could also build this on Solaris with necessary licensing if you wanted to that route but it’d be more expensive. I find it bewildering the author didn't even consider illumos or FreeBSD, where ZFS is a first class citizen.

For someone not very up to date with all the various ZFS flavors, can you please explain this a bit?

ZFS is a native filesystem to FreeBSD, where as in Linux it is not.

Re: 832 TB – ZFS on Linux

#10

Post by X86BSD » Sat, Aug 05, 2017, 7:25 PM UTC

4ad wrote: post #2

you can run ZFS on Ubuntu [...] You could also build this on Solaris with necessary licensing if you wanted to that route but it’d be more expensive. I find it bewildering the author didn't even consider illumos or FreeBSD, where ZFS is a first class citizen.

Yeah I was like uhhhh what? Illumos and illumos based OS'es and FreeBSD are the only games in town where ZFS is a first class citizen. Ill chalk it up to extreme bias.