Live data from Hacker News

Backblaze Drive Stats for 2024

backblaze.com

121–130 of 209 posts

Re: Backblaze Drive Stats for 2024

#121

I used to think these were interesting and used them to inform my next HDD purchase. I realized I only used them to pick a recently reliable brand, we're down to three, and the stats are mostly old models, so the main use is if you're buying a used drive from the same batch that Backblaze happens to have also used. Buy two from different vendors and RAID or do regular off-site backups.

> RAID or do regular off-site backups.

RAID is not a backup! Do both.

Re: Backblaze Drive Stats for 2024

#122
post #96

Earlier quoted context omitted.

>Often you will read online of people experiencing multiple failures from drives purchased from the same batch I'll toss in on that anecdata. This has happened to me a several times. In all these cases we were dealing with drives with more or less sequential serial numbers. In two instances they were just cache drives for our CDN nodes. Not a big deal, but I sure kept the remote hands busy those weeks trying to keep…

This has been the "conventional wisdom" for a very long time. Is this one of those things that get "lost with time" and every generation has to rediscover it? Like, 25+ years ago I would've bought hard drives for just my personal usage in a software raid making sure I don't get consecutive serial numbers, but ones that are very different. I'd go to my local hardware shop and ask them specifically for that. They'd sho…

Exactly this.

I mostly just buy multiple brands from multiple vendors. And size the partitions for mdadm a bit smaller.

But even the same model where it's 2 each from bestbuy, Amazon, newegg, microcenter, seems to get me a nice assortment of variety.

Re: Backblaze Drive Stats for 2024

#123
post #96

Earlier quoted context omitted.

>Often you will read online of people experiencing multiple failures from drives purchased from the same batch I'll toss in on that anecdata. This has happened to me a several times. In all these cases we were dealing with drives with more or less sequential serial numbers. In two instances they were just cache drives for our CDN nodes. Not a big deal, but I sure kept the remote hands busy those weeks trying to keep…

This has been the "conventional wisdom" for a very long time. Is this one of those things that get "lost with time" and every generation has to rediscover it? Like, 25+ years ago I would've bought hard drives for just my personal usage in a software raid making sure I don't get consecutive serial numbers, but ones that are very different. I'd go to my local hardware shop and ask them specifically for that. They'd sho…

It’s inconvenient compared to just ordering 10x or however many of the same thing and not caring. The issue with variety too is different performance characteristics can make the array unpredictable.

Of course, learned experience has value in the long term for a reason.

Re: Backblaze Drive Stats for 2024

#124

> I have been authoring the various Drive Stats reports for the past ten years and this will be my last one. I am retiring, or perhaps in Drive Stats vernacular, it would be “migrating.” Thank you for all these reports over the years.

Seriously. In addition to helping inform my purchasing decisions, these reports also taught me the most valuable lesson of data: that it can only ever inform most likely patterns, but never guarantee a specific outcome. Until you act upon it, the data has no intrinsic value, and once you act upon it, it cannot guarantee the outcome you desire.

Thanks for a decade of amazing statistics and lessons. Enjoy resilvering into retirement!

Re: Backblaze Drive Stats for 2024

#125

It's not a best practice, but the last 10 years I've run my home server with a smaller faster drive for the OS and a single larger disk for bulk storage that I choose using Backblaze Drive Stats. None of have failed yet (fingers-crossed). I really trust their methodology and it's an extremely valuable resource for me as a consumer. My most recent drive is a WDC WUH722222ALE6L4 22TiB, and looking at the stats (albeit…

Take these stats with a grain of salt. I am becoming more and more convinced that hard drive reliability is linked to the batch more than to the individual drive models themselves. Often you will read online of people experiencing multiple failures from drives purchased from the same batch. I cannot prove this because I have no idea about Blackblazes procurement patterns but I bought one of the better drives in this…

IME heat is a significant factor with spindle drives. People will buy enterprise-class drives, then stick them in enclosures and computer cases that don't flow much air over it, leading to the motor and logic board getting much warmer than they should.

Re: Backblaze Drive Stats for 2024

#126
post #88
post #68

Earlier quoted context omitted.

Nowadays you can get a petabyte in a single machine (50 drives 20TB each).

Out of curiosity, what server cases can actually accommodate 50 drives?

aic j4108 for 108 drives.

Not a server per se, but you just take one 1U server and daisy chain a lot of those JBOD chassis for the needed capacity. You can have 1080 disks in a 42" rack.

Re: Backblaze Drive Stats for 2024

#127

It's not a best practice, but the last 10 years I've run my home server with a smaller faster drive for the OS and a single larger disk for bulk storage that I choose using Backblaze Drive Stats. None of have failed yet (fingers-crossed). I really trust their methodology and it's an extremely valuable resource for me as a consumer. My most recent drive is a WDC WUH722222ALE6L4 22TiB, and looking at the stats (albeit…

Nobody should ever have peace of mind about a single drive. You probably have odds around 5% that the storage drive fails each cycle, and another 5% for the OS drive. That's significant.

And in your particular situation, 3 refurbished WUH721414ALE6L4 are the same total price. If you put those in RAIDZ1 then that's 28TB with about as much reliability as you can hope to have in a single device. (With backups still being important but that's a separate topic.)

Re: Backblaze Drive Stats for 2024

#128

It's not a best practice, but the last 10 years I've run my home server with a smaller faster drive for the OS and a single larger disk for bulk storage that I choose using Backblaze Drive Stats. None of have failed yet (fingers-crossed). I really trust their methodology and it's an extremely valuable resource for me as a consumer. My most recent drive is a WDC WUH722222ALE6L4 22TiB, and looking at the stats (albeit…

Take these stats with a grain of salt. I am becoming more and more convinced that hard drive reliability is linked to the batch more than to the individual drive models themselves. Often you will read online of people experiencing multiple failures from drives purchased from the same batch. I cannot prove this because I have no idea about Blackblazes procurement patterns but I bought one of the better drives in this…

This is why it’s best practice to buy your drives from different dealers when setting up RAID.

Re: Backblaze Drive Stats for 2024

#129

Earlier quoted context omitted.

hopefully you have 2x of these drives in some kind of raid mirror such that if one fails, you can simply replace it and re-mirror. not having something like this is risky.

Wasn’t the issue with large drives that remaining drive has a high chance of failure during re-silvering?

That may be true for pools that never get scrubbed. Or for management that doesn't watch SMART stats in order to catch a situation before it degrades to the point where one drive fails and another is on its last legs.

With ZFS on Debian the default is to scrub monthly (second Sunday) and resilvering is not more stressful than that. The entire drive contents (not allocated space) has to be read to re-silver.

Also define "high chance." Is 10% high? 60%? I've replaced failed drives or just ones I wanted to swap to a larger size at least a dozen times and never had a concurrent failure.

Re: Backblaze Drive Stats for 2024

#130

Earlier quoted context omitted.

Wow, that’s a cool stat. I wonder if people will ever seriously use 16EB of memory in a single system and will need to change to a more-than-64-bit architecture or if 64 bit is truly enough. This has „640k ought to be enough for anybody“ potential (and I know he didn’t say that).

> need to change to a more-than-64-bit architecture Perhaps we don't need a single flat address space with byte-addressable granularity at those sizes? I wonder how an 8 bit byte, 48 bit word system would have fared. 2*32 is easy to exhaust in routine tasks; 2*48 not so much.

Until Intel's Ice Lake server processors introduced in 2019, x86-64 essentially was a 48-bit address architecture: addresses are stored in 64-bit registers, but were only valid if the top two bytes were sign-extended from the last bit of the 48-bit address. Now they support 57 bit addressing.
Post reply on HN