Earlier quoted context omitted.
Note to self: stay the hell away from Western Digital. Good lord, an 8.2% annualized failure rate? That's unbelievable. They have the first, second, and third worst failure rates on that chart.
A few years ago, you could have said the same for Seagate. Even worse, actually. Certain models had over 10% failure rate. Some WD models almost had HGST levels of relibility. https://www.backblaze.com/blog/hard-drive-reliability-update...
Backblaze hard drive reliability stats for Q3 2016
51–60 of 116 posts
Re: Backblaze hard drive reliability stats for Q3 2016
#52Re: Backblaze hard drive reliability stats for Q3 2016
#53Earlier quoted context omitted.
A few years ago, you could have said the same for Seagate. Even worse, actually. Certain models had over 10% failure rate. Some WD models almost had HGST levels of relibility. https://www.backblaze.com/blog/hard-drive-reliability-update...
Hmmm. Curious. I wonder if Seagate has improved their production somehow to avoid those failure rates, because even with those previous very high rates, they fare much better on the 2013-2016 total chart.
Re: Backblaze hard drive reliability stats for Q3 2016
#54Earlier quoted context omitted.
The Backblaze Vault design mitigates that as the "raid array" is scattered across 20 different Storage Pods in twenty different racks. You'd need more than three racks to go down before you would be offline. Backup systems in place make that highly unlikely. Andy at Backblaze.
I'll see from your reports that you're migrating 1000s of 2TB drives to 8TB drives - what is actually happening to your old 2TB drives? Guess you are not throwing those away so what are you doing with them.
Re: Backblaze hard drive reliability stats for Q3 2016
#55Earlier quoted context omitted.
The Backblaze Vault design mitigates that as the "raid array" is scattered across 20 different Storage Pods in twenty different racks. You'd need more than three racks to go down before you would be offline. Backup systems in place make that highly unlikely. Andy at Backblaze.
I'll see from your reports that you're migrating 1000s of 2TB drives to 8TB drives - what is actually happening to your old 2TB drives? Guess you are not throwing those away so what are you doing with them.
https://www.backblaze.com/blog/hard-drive-reliability-q4-201...
Re: Backblaze hard drive reliability stats for Q3 2016
#56How are people using Backblaze's excellent hard drive reliability reports in making purchasing decisions? For example when I search for HGST HMS5C4040ALE640 on Amazon I get a dealer selling old out of warrantee drives as new. https://www.amazon.com/HGST-MegaScale-HMS5C4040ALE640-Coolsp... I get similar results with many of the other drives listed and with other websites such as NewEgg.
I chose to get 4 ST4000DM000 drives based on previous reports. Sure HGST drives never die, but it's cheaper to RMA or buy a single new drive if one fails, than the added cost of 4 reliable drives. Assuming only one fails, which is a risk I'm willing to take with my very non-mission-critical data. I don't read this as 'which drive to buy' but more as 'which drive not to buy'.
Disclaimer: I work at Backblaze. I know you didn't mean that as an absolute, but I just want to point out 100% of drives fail. It's my OCD that makes me point this out. We have NEVER found a drive that lasted forever. There are two types of drives: 1) those that have already failed, and 2) those that are about to fail. For any data you would be annoyed to lose, you need three copies in three locations with three separate vendors (three different pieces of software that don't share any lines of code).
Re: Backblaze hard drive reliability stats for Q3 2016
#57With hard drive size increasing so quickly but hard drive transfer speeds basically flat, I wonder if there are long-term implications for them with respect to recovery from backup and downtime. For example, if a whole rack goes down, and they are on 32TB drives in the future, for example, could it takes a week or more for their data to get online?
Well, uh, yes. No one really expects that rotational rust will get much faster, and in fact history shows that, compared to the increase in density, the increase in transfer rates are laughable at best. Between 1990 and today you are probably looking at a 20 000 times increase in density, yet transfer rates only increased around a factor of around 150-200. [In fact, from the early 1960 to today it's only a factor of…
Re: Backblaze hard drive reliability stats for Q3 2016
#58Earlier quoted context omitted.
You should really consider moving this webpage and report to something like AWS S3 when you first release it. Then move back to your usual servers when traffic has fallen off. Your poor servers must melt down when this shows up on Hacker News and Slashdot.
Internally we're blaming our SEO people for putting to much crap on the blog itself ;) But yea, it's worth exploring - though we have our own servers that should be able to handle the load. We haven't had blog loading trouble in a while, so it'll be neat to debug this later :D
Also seems there's no minification or combining of stylesheets/js and there are query strings on those static assets which is going to discourage caching.
No wonder you need a datacenter to handle that kind of resource punishment!
There are plenty of reasons to stick with Wordpress in a decent sized corporation but if not switching to a static site at least stick W3TC on there so you're minimising your server load and serving out static html and minified/combined resources.
You could then consider using Varnish in front of Apache or maybe nginx with a FastCGI cache.
I"m sure you've got some folks in the team who could whip up a W3TC install in 10 minutes.
Re: Backblaze hard drive reliability stats for Q3 2016
#59Earlier quoted context omitted.
Hmmm. Curious. I wonder if Seagate has improved their production somehow to avoid those failure rates, because even with those previous very high rates, they fare much better on the 2013-2016 total chart.
They might have. But I also wonder if those drives were among the first after the 2011 Thailand floods, and if Seagate's factories were still a bit dirty after resuming production.
Re: Backblaze hard drive reliability stats for Q3 2016
#60Backblaze is consistently a great service. Needs a Linux client though.
Yev from Backblaze here -> have you checked out B2? We likely won't have a Linux client for our backup service any time soon, but our B2 service has a lot of integrators (like Cloudberry and Duplicity, HashBackup, etc..) that can back up Linux machines, a lot of folks have been going that route.