Live data from Hacker News

SSD will fail at 40k power-on hours (2021)

cisco.com

181–190 of 276 posts

Re: SSD will fail at 40k power-on hours (2021)

#181

crap so its certainly HP laptops. so which laptops are safe from this?

This appears to be talking about Cisco enterprise drives; where do you see anything about HP laptops? Edit: If it's a problem in Cisco's upstream vendor then it could affect others, but probably still just enterprise stuff.

https://news.ycombinator.com/item?id=32052757

> HPE is one of the SSD OEMs affected by it: ...

Re: SSD will fail at 40k power-on hours (2021)

#182
post #34
post #17

Earlier quoted context omitted.

planned obsolescence is quite a thing...?

In some cases, but a product must fulfill its core purpose. If a SSD intentionally dumped data and self destructed at a set time, that would be disastrous for the brand. Same way a car doesn't adopt planned obsolescence by blowing up after 200k miles.

What more could a manufacturer do to be "disastrous for the brand" than literally build an ssd that stops working after 40kh? Because this does not seem to qualify for you

Re: SSD will fail at 40k power-on hours (2021)

#183
post #118

Earlier quoted context omitted.

I got bit by this with iPhone backups. I did a phone trade in and followed the backup before trading in instructions. Problem is after the trade in the backup failed to restore due to an unknown error. The whole manual syncing and backing up with a cable workflow with Apple is super fickle and riddled with bugs. Luckily I had Time Machine backups of my iOS backups and I managed to avoid losing too much data. As a sid…

While I don't like how annoying Apple is with service upselling (iCloud, Music, Arcade), at least they moved iPhone backup from iTunes to Finder. So their local iPhone backup process is being maintained over time. I don't have issues with my computer (PC or Mac) detecting my iPhone. Generally need to make sure iPhone is unlocked after plugging it in. What is tough is the large size of my iPhone (X gb) and how small m…

I’ve changed iphones many times and the issue still persists for me. The only reliable way to get photos synced or iphone deteced in finder is to turn on airplane mode for some reason. Must be a bug with wifi syncing.

You actually bring up another issue. There is no obvious way to backup iPhone locally to an external hard drive. So either pay the mac SSD storage tax or the icloud tax.

Re: SSD will fail at 40k power-on hours (2021)

#184

Earlier quoted context omitted.

It seems more likely it was four drives (though dang and Mike both refer to "two" in the earlier thread). Both primary and failover servers had RAID arrays. I suspect RAID 10 (striped mirror), which would mean two drives would have to fail to take down a single server. Four drives of the same manufacturer spec and batch would do that.

This is what always worries me about our home server. It's running ZFS with multiple redundant drives but the supplier refused (when I explicitly asked) to supply it with disks known to be from different batches claiming that the odds of multiple failures close together were negligible. Obviously we have backups as well but the time and cost to restore a full server from online backups can be significant.

Possibly the supplier was talking of hardware failures.

The issue here (as it was several years ago with the re-known Seagate 7200.11 issue [0]) is not about the odds of multiple (hardware) failures together (which may actually be a very rare case), in these case it is essentially a software failure, a counter that crashes the on-disk operating system (if we can call it so) be it an overflow of the counter or hitting a certain value.

The chances of having almost simultaneous failures is near to certainty for drives that are booted the same number of times and have been powered for the same number of hours, if the affected counters are related to these events.

[0] Some reference:

https://msfn.org/board/topic/128807-the-solution-for-seagate...

>Root Cause

This condition was introduced by a firmware issue that sets the drive event log to an invalid location causing the drive to become inaccessible.

The firmware issue is that the end boundary of the event log circular buffer (320) was set incorrectly. During Event Log initialization, the boundary condition that defines the end of the Event Log is off by one. During power up, if the Event Log counter is at entry 320, or a multiple of (320 + x*256), and if a particular data pattern (dependent on the type of tester used during the drive manufacturing test process) had been present in the reserved-area system tracks when the drive's reserved-area file system was created during manufacturing, firmware will increment the Event Log pointer past the end of the event log data structure. This error is detected and results in an "Assert Failure", which causes the drive to hang as a failsafe measure. When the drive enters failsafe further update s to the counter become impossible and the condition will remain through subsequent power cycles. The problem only arises if a power cycle initialization occurs when the Event Log is at 320 or some multiple of 256 thereafter. Once a drive is in this state, there is no path to resolve/recover existing failed drives without Seagate technical intervention. For a drive to be susceptible to this issue, it must have both the firmware that contains the issue and have been tested through the specific manufacturing process.

Re: SSD will fail at 40k power-on hours (2021)

#185
post #127
post #86

Earlier quoted context omitted.

If both SSD's are from the same lot number and one fails, the chances of the second failing go up by a high amount. Both failing at the same time though is extremely rare.

We (as an industry) went through this bad batch madness with the IBM DeskStar 75GXP hard drives, which were affectionately referred to as "IBM Deathstar"[1]. It's rare, but it's not _that_ rare. You have to make the effort to understand why it failed. I had a situation where I deployed Toshiba SLC SSDs (that were purchased over the course of several months) and a piece of software that synchronized to disk frequently…

There was also more recently the case of the Seagate 7200.11, see my previous comment:

https://news.ycombinator.com/item?id=32053477

Re: SSD will fail at 40k power-on hours (2021)

#186
post #142

Earlier quoted context omitted.

How to do this on a Windows PC?

In an elevated powershell prompt Get-PhysicalDisk | Get-StorageReliabilityCounter | Select-Object PowerOnHours

Getting blanks on some of my disks. Two show 64422h and 73318h with no signs of failing :)

Re: SSD will fail at 40k power-on hours (2021)

#187
post #28

Check your power-on hours: $ sudo smartctl -a /dev/sda | grep -e Power_On_Hours -e ^ID ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 9 Power_On_Hours 0x0032 098 098 000 Old_age Always - 9743 Just looking at the raw value, it seems to be 9'743 hours in my case

I seem to have the world's oldest SSD (or am I misinterpreting the output?)

  (shell 1) ~# smartctl -a /dev/sda | grep -e Power_On_Hours -e ^ID
  ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  9 Power_On_Hours_and_Msec 0x0032   000   000   000    Old_age   Always       -       933932h+27m+33.940s

Re: SSD will fail at 40k power-on hours (2021)

#188

Earlier quoted context omitted.

getting a blank value

Make sure to run PS with admin privileges

I did, but still got no SMART values. Speccy works though and I'm sure I've also run smartctl successfully on this laptop in the past.

Re: SSD will fail at 40k power-on hours (2021)

#189
post #134
post #11

Earlier quoted context omitted.

Not two SSDs, four : two in the main server, and two in the backup server.

Yowch. The old "stagger your drive replacements, stagger your batches" thing might not be quite as outdated as we'd like to think...

About 20 years ago I worked for a small storage company, the person that managed the returns of disks form customers was very strongly of the opinion that the odd firmware versions on Seagate drives were returned way more often than the even.
Post reply on HN