Live data from Hacker News

What SMART Stats Tell Us About Hard Drives

backblaze.com

11–20 of 71 posts

Re: What SMART Stats Tell Us About Hard Drives

#11
post #6

Interesting, thanks for posting! Could you talk quickly about why it's interesting to predict drive failure? Is it to understand how many replacement drives you might need to order in the short term, or is there value beyond stock management of drives?

In a non-RAID context, for example NoSQL databases that keep 3 copies of chunks of data, knowing about a failure in advance means that you can abandon using that drive slowly, without it becoming an emergency.

Re: What SMART Stats Tell Us About Hard Drives

#12
post #6

Interesting, thanks for posting! Could you talk quickly about why it's interesting to predict drive failure? Is it to understand how many replacement drives you might need to order in the short term, or is there value beyond stock management of drives?

Besides stock management, they help use determine the overall health of a Storage Pod or Vault. They also help find trouble with other components. For example, if a backplane or cable were failing, the drives via their SMART stats may notice first. So they SMART stats are part of what we use to evaluate the whole system health.

Re: What SMART Stats Tell Us About Hard Drives

#13

This data should be put into smartmontools or a separate tool to give a simple good/bad rating as the actual values are somewhat meaningless w/o data.

Hmmm, I wonder if a crowdsourced data collection would be useful/securable?

Would you enable an option for smartmontools that sent all your drive SMART data to a cloud hosted db (with as little identifying information as possible) and tell it when you had a drive fail - in return for that same service alerting you with "best estimates" of your risks of drive failure?

Re: What SMART Stats Tell Us About Hard Drives

#14
Ten years ago when I was I trying to learn how to "program", I wrote this bash script (to be added into /etc/cron.daily) that dumps a few smart stats that are normally 0 or slow changing, diffs it with the copy from the previous run, and if anything is different (and cron in configured right) it will email you the diff. Every linux machine I touch gets this file dropped onto it. I've replaced many hard drives because of it

    #!/bin/bash
    
    
    smartctl -a /dev/sda > /root/smartStates
    grep Reallocated_Sector_Ct /root/smartStates > /root/stats
    grep Current_Pending_Sector /root/smartStates >> /root/stats
    grep Offline_Uncorrectable /root/smartStates >> /root/stats
    grep UDMA_CRC_Error_Count /root/smartStates >> /root/stats
    
    touch /root/statsOld
    cmp /root/stats /root/statsOld
    result=$?
    
    if [[ $result -ne "1" && $result -ne "0" ]]
      then
    	echo "Something went wrong"
    	exit -1
    fi
    
    if [[ $result -eq "1" ]]
      then
    	echo "Files are different\n"
    	cat /root/stats
    fi
    
    mv /root/stats /root/statsOld
    rm /root/smartStates

Re: What SMART Stats Tell Us About Hard Drives

#15
post #6

Interesting, thanks for posting! Could you talk quickly about why it's interesting to predict drive failure? Is it to understand how many replacement drives you might need to order in the short term, or is there value beyond stock management of drives?

In a non-RAID context, for example NoSQL databases that keep 3 copies of chunks of data, knowing about a failure in advance means that you can abandon using that drive slowly, without it becoming an emergency.

If you have three replicas, who cares if one fails? Just wait for it to fail and rereplicate from the survivors.

Re: What SMART Stats Tell Us About Hard Drives

#16
post #9
post #6

Interesting, thanks for posting! Could you talk quickly about why it's interesting to predict drive failure? Is it to understand how many replacement drives you might need to order in the short term, or is there value beyond stock management of drives?

Not OP, but: Perfect predictability would obviously be beneficial, in that you could get by without any redundancy. But even imperfect predicability can help you reduce the required number of drives for a set level of security.

Yeah but no. The problem is that absence of smart counters does in no way indicate good health of the device.

Re: What SMART Stats Tell Us About Hard Drives

#17
Small nitpicking here, but the moment it popup a modal dialog asking me to enter my email for some kind of subscription I simply close the tab. I do this since three months ago for any unknown website I visit.

Such nuisance for what might be a good read.

Re: What SMART Stats Tell Us About Hard Drives

#18
post #14

Ten years ago when I was I trying to learn how to "program", I wrote this bash script (to be added into /etc/cron.daily) that dumps a few smart stats that are normally 0 or slow changing, diffs it with the copy from the previous run, and if anything is different (and cron in configured right) it will email you the diff. Every linux machine I touch gets this file dropped onto it. I've replaced many hard drives because…

Looks useful

Re: What SMART Stats Tell Us About Hard Drives

#19

Earlier quoted context omitted.

In a non-RAID context, for example NoSQL databases that keep 3 copies of chunks of data, knowing about a failure in advance means that you can abandon using that drive slowly, without it becoming an emergency.

If you have three replicas, who cares if one fails? Just wait for it to fail and rereplicate from the survivors.

Because there's a risk that another replica will fail. And because you can do the copying more slowly if the failure is predicted and not super-immediate.

Re: What SMART Stats Tell Us About Hard Drives

#20
post #9

Earlier quoted context omitted.

Not OP, but: Perfect predictability would obviously be beneficial, in that you could get by without any redundancy. But even imperfect predicability can help you reduce the required number of drives for a set level of security.

Yeah but no. The problem is that absence of smart counters does in no way indicate good health of the device.

If the presence of smart counters indicates imminent failure, their absence by definition indicates health.

Not perfectly, obviously, but this is about probabilities.

Say you want some level of data security (i. e. 99.9% over one year).

The formula for the risk of data loss is (r^n) where r is the failure rate of drives and n is the number of drives (assuming independence and using just mirroring).

But – if you have a test that can predict failure with some probability s the formula becomes (n*(1-s))^r. which is strictly smaller for any 0 < s <= 1, meaning you get a higher level of expected security (or possibly the same with fewer drives).

Post reply on HN