I am going for the 15tb instead of that 14 so I have extra space for backups. Says no body. We are clearly close to the end of spinning rust, absent some new breakthrough.
For archival spinning rust is still massively more cost effective than SSDs while offering better performance than tape, especially for random access.
I'm sure eventually SSDs will be cheap enough that HDD will go the way of the floppy but we're not there yet.
This is one reason why RAID 0+1 is a best practice, and RAID 5 & 6 are no longer recommended. It takes too long to rebuild the array, leading to a multi-failed disk situation.
RAID6 should be fine rebuilding online (in RAID5 mode) even under a moderate write load. Of course one should source RAID disks form 3 different vendors, to ensure that they are from different batches, and are not going to fail at approximately the same time.
Do other manufacturers produce this size of drive? It's difficult to source from 3 vendors if there's only one making the product.
Will we hit a point where the size of the drive is simply too big to get the data off in any decent amount of time?
This is one reason why RAID 0+1 is a best practice, and RAID 5 & 6 are no longer recommended. It takes too long to rebuild the array, leading to a multi-failed disk situation.
ZoL 0.8 will have sequential resilver which should be able to restore a disk in a few hours.
The best resource for that would probably be Backblaze's quarterly hard drive stats. Here are the ones for Q3 2018: https://www.backblaze.com/blog/2018-hard-drive-failure-rates... Scroll down a bit and you'll see the annualized failure rates (AFR). The 10TB and 12TB ones seem to be pretty excellent.
The counter-point to this is that since Backblaze uses consumer drives, they probably won't ever test these new drives, because they are enterprise.
Would the 10TB Seagate ST10000NM0086 (of which they have 1,220 drives) not count as enterprise ones? Or the 12TB HGST HUH721212ALN604 for that matter.
This is one reason why RAID 0+1 is a best practice, and RAID 5 & 6 are no longer recommended. It takes too long to rebuild the array, leading to a multi-failed disk situation.
Raid 01 has its own risk. If the wrong two disks fail your entire array is toast
Multiple "0" drives can be added for further redundancy.
I was about to buy 3x 12TB Toshiba for Deep Learning datasets; now I need to reconsider... Does anyone know what are the current reliability stats for >10TB drives? My old 6x 4TB HGST in NAS are running without a single problem for the past 3 years...
before my current crop of 8TB WD reds, I ran Toshiba enterprise drives and they were extremely reliable for me. none of them failed in a 24x7 hardware raid6 environment after a few years. only replaced them to upgrade capacity.
I was about to buy 3x 12TB Toshiba for Deep Learning datasets; now I need to reconsider... Does anyone know what are the current reliability stats for >10TB drives? My old 6x 4TB HGST in NAS are running without a single problem for the past 3 years...
before my current crop of 8TB WD reds, I ran Toshiba enterprise drives and they were extremely reliable for me. none of them failed in a 24x7 hardware raid6 environment after a few years. only replaced them to upgrade capacity.
I've read that Toshiba is based on old HGST process and those drives were extremely reliable, which is why I wanted to get them for the new Deep Learning workstation.
I was about to buy 3x 12TB Toshiba for Deep Learning datasets; now I need to reconsider... Does anyone know what are the current reliability stats for >10TB drives? My old 6x 4TB HGST in NAS are running without a single problem for the past 3 years...
How do people use such large HDDs when internet download speeds are still low as compared to downloading directly on cloud services (like aws)?
I was about to buy 3x 12TB Toshiba for Deep Learning datasets; now I need to reconsider... Does anyone know what are the current reliability stats for >10TB drives? My old 6x 4TB HGST in NAS are running without a single problem for the past 3 years...
How do people use such large HDDs when internet download speeds are still low as compared to downloading directly on cloud services (like aws)?
What do you consider low? On a 100Mbit/s connection you can fill a TB in a day or two, and those are somewhat common.
And of course some people actually create the data themselves and don't download it.
Will we hit a point where the size of the drive is simply too big to get the data off in any decent amount of time?
This is one reason why RAID 0+1 is a best practice, and RAID 5 & 6 are no longer recommended. It takes too long to rebuild the array, leading to a multi-failed disk situation.
Interesting. What do you think the advantage of raid01 instead of raid10? The latter looks safer at first sight.