Live data from Hacker News

Old tech is haunted

therectangle.substack.com

91–100 of 103 posts

Re: Old tech is haunted

#91
post #69

Earlier quoted context omitted.

I've mentioned before how loud an argument we got into with a guy who aspired to being a hacker, and yet didn't understand that the magnetic domains on a HDD were essentially analog. Even after we asked him why, if hard drives were truly binary, that secure disk erase tools were so complex and slow he still insisted that everything was binary, soup to nuts. Even the simplest things are a fiction. Or maybe I should sa…

>that secure disk erase tools were so complex It's security theater. All you have to do is write 0s to the entire HDD.

It depends on the value of your data. It's theoretically possible to use specialized equipment to find remnants of the data even after having been zero'd out (by taking out the platters and very carefully poring over the ever-so-slight analog-induced discrepancies in what "0" and "1" look like), but unless your attacker is the NSA you probably don't have to worry about that (and if your attacker is the NSA, you're probably already using full-disk encryption anyway, which largely renders disk erasure a moot point).

Re: Old tech is haunted

#92

Earlier quoted context omitted.

>that secure disk erase tools were so complex It's security theater. All you have to do is write 0s to the entire HDD.

It depends on the value of your data. It's theoretically possible to use specialized equipment to find remnants of the data even after having been zero'd out (by taking out the platters and very carefully poring over the ever-so-slight analog-induced discrepancies in what "0" and "1" look like), but unless your attacker is the NSA you probably don't have to worry about that (and if your attacker is the NSA, you're pr…

>It's theoretically possible to use specialized equipment to find remnants of the data even after having been zero'd out

No, this is not possible neither in theory nor in practice.

>by taking out the platters and very carefully poring over the ever-so-slight analog-induced discrepancies in what "0" and "1" look like

Even doing this is not enough to recover the data. What 0 and 1 look like isn't even constant. There is variability in what the current value is set to and their is variability in what the previous value was set to. There is too much randomness to recover the original data.

>which largely renders disk erasure a moot point

Disk erasure in this case can still be useful. In this case you only have to overwrite the master key.

The idea that overwritten data can be recovered is an urban legend that is not based off reality, and simply wastes people's time and contributes to ewaste from people destroying harddrives.

For just wiping data overwriting it with anything is fine. If you plan on using the disk for FDE you should overwrite the drive with random bytes so that you don't leak the size of the used disk space.

Re: Old tech is haunted

#93

Relevant philosophical discussion: Koestler (1967) https://en.wikipedia.org/wiki/The_Ghost_in_the_Machine This work has informed quite a bit of art and literature ever since, from the manga/anime series Ghost in the Shell to a fair bit of William Gibson's work (see 'semiotic ghosts' of futures that might-have-been in The Gernsback Continuum). As far as religious belief in modern civilization, Frank Herbert in Dune (A…

> The agnostic ruling class (including the Guild) for whom religion was a kind of puppet show to amuse the populace and keep it docile, and who believed essentially that all phenomena - even religious phenomena - could be reduced to mechanical explanations.

Sound a bit like Gibbon on Roman religion:

"The policy of the emperors and the senate, as far as it concerned religion, was happily seconded by the reflections of the enlightened, and by the habits of the superstitious, part of their subjects. The various modes of worship, which prevailed in the Roman world, were all considered by the people, as equally true; by the philosophers, as equally false; and by the magistrate, as equally useful. And thus toleration produced not only mutual indulgence, but even religious concord."

Re: Old tech is haunted

#94

Earlier quoted context omitted.

It depends on the value of your data. It's theoretically possible to use specialized equipment to find remnants of the data even after having been zero'd out (by taking out the platters and very carefully poring over the ever-so-slight analog-induced discrepancies in what "0" and "1" look like), but unless your attacker is the NSA you probably don't have to worry about that (and if your attacker is the NSA, you're pr…

>It's theoretically possible to use specialized equipment to find remnants of the data even after having been zero'd out No, this is not possible neither in theory nor in practice. >by taking out the platters and very carefully poring over the ever-so-slight analog-induced discrepancies in what "0" and "1" look like Even doing this is not enough to recover the data. What 0 and 1 look like isn't even constant. There i…

> No, this is not possible neither in theory nor in practice.

Then go tell that to Peter Gutmann: https://www.usenix.org/legacy/publications/library/proceedin...

The saving grace here is that newer drives are a lot denser than the ones in common use back then, so data recovery in this fashion is prohibitively expensive for anything manufactured in the last decade or so. You basically need to be more precise in your reads than hard drives themselves - and that's a pretty tall order.

Still, technology does march on; there remains a risk that recovery techniques could catch up, and there are indeed folks who need absolute guarantees of erasure - and there ain't much more absolute than physical destruction.

> What 0 and 1 look like isn't even constant. There is variability in what the current value is set to and their is variability in what the previous value was set to.

It's exactly that variability that makes data recovery possible.

> simply wastes people's time and contributes to ewaste from people destroying harddrives.

It doesn't really do either. Again: this is really only relevant if you're being targeted by the sorts of nation-state-level intelligence agencies that have the time, resources, and expertise for this sort of thing - and when you're such a target, guaranteed data destruction matters a lot more than the amount of e-waste you generate.

> If you plan on using the disk for FDE you should overwrite the drive with random bytes so that you don't leak the size of the used disk space.

This doesn't always work - for example, if you want to use TRIM on SSDs, since unused blocks are zero'd out instead of left as-is. The usual recommendation there for maximum security is "just don't use TRIM", with the SSD performance and longevity implications that entails.

Re: Old tech is haunted

#95
post #89
post #79

Earlier quoted context omitted.

...who built a simulation so robust that we've yet to demonstrate any actual bugs. This world is freakishly consistent, if it's the work of anything remotely like human intelligence (though I hold out hope for modern physics to wind up unresolved and unreconcilable, because I love mysteries).

For all we know, the bugs are all around us - we just don't know what the normal behavior is supposed to be.

Possible, but physics is still really consistent, apart from maybe at the cosmological scale.

Re: Old tech is haunted

#96

Earlier quoted context omitted.

>It's theoretically possible to use specialized equipment to find remnants of the data even after having been zero'd out No, this is not possible neither in theory nor in practice. >by taking out the platters and very carefully poring over the ever-so-slight analog-induced discrepancies in what "0" and "1" look like Even doing this is not enough to recover the data. What 0 and 1 look like isn't even constant. There i…

> No, this is not possible neither in theory nor in practice. Then go tell that to Peter Gutmann: https://www.usenix.org/legacy/publications/library/proceedin... The saving grace here is that newer drives are a lot denser than the ones in common use back then, so data recovery in this fashion is prohibitively expensive for anything manufactured in the last decade or so. You basically need to be more precise in your r…

>Then go tell that to Peter Gutmann:

Which is what the authors of "Overwriting Hard Drive Data: The Great Wiping Controversy" did. The highlight of their response is that for the recovery method described in Gutmann's paper to be accurate it requires a copy of the original data. When the authors tested a drive that existed at the time Gutmann wrote that paper in optimal conditions there was only a 92% chance of recovering a bit correctly. The chance to successfully recover exponentially decays with the number of bits you want to recover.

>if you want to use TRIM on SSDs

We were talking about HDDs. SSDs are out of scope.

Re: Old tech is haunted

#97

Earlier quoted context omitted.

One time I had a horrible roommate I hated immensely. She did shit like make a friend of mine cry on her birthday. Her boyfriend broke up with her cause she was obviously a terrible person, so her response to this was visiting a witch doctor (This is an incident that happened in the third world so bear with me for a moment). His recommendation was to cut an X into limes and put them in the corner of each room in the…

What would be the case if she came back home from work and they were intact? Missing piece from the story! haha :)

She said he'd just get bad luck

Re: Old tech is haunted

#98

Earlier quoted context omitted.

> No, this is not possible neither in theory nor in practice. Then go tell that to Peter Gutmann: https://www.usenix.org/legacy/publications/library/proceedin... The saving grace here is that newer drives are a lot denser than the ones in common use back then, so data recovery in this fashion is prohibitively expensive for anything manufactured in the last decade or so. You basically need to be more precise in your r…

>Then go tell that to Peter Gutmann: Which is what the authors of "Overwriting Hard Drive Data: The Great Wiping Controversy" did. The highlight of their response is that for the recovery method described in Gutmann's paper to be accurate it requires a copy of the original data. When the authors tested a drive that existed at the time Gutmann wrote that paper in optimal conditions there was only a 92% chance of recov…

> When the authors tested a drive that existed at the time Gutmann wrote that paper in optimal conditions there was only a 92% chance of recovering a bit correctly. The chance to successfully recover exponentially decays with the number of bits you want to recover.

That's still a non-zero probability. For folks whose tolerance for data exfiltration is "zero", anything non-zero, no matter how infinitesimally small, is non-acceptable - hence: physical destruction rather than relying on overwriting.

Thankfully, as mentioned previously, said folks are a pretty tiny minority of the total hard drive market, and are typically the folks encrypting everything at rest anyway. A random pass or two over encrypted data is more than enough to ensure that even if an attacker is able to accurately recover old bits, there's no telling whether or not those old bits are actually data.

> We were talking about HDDs. SSDs are out of scope.

If we're going to adjust our expectations for "overwriting is sufficient for data destruction" based on changes in technology, then SSDs are absolutely in scope - and indeed have their own set of implications when it comes to data retention after overwrite (like TRIM, as mentioned before, or the general case of two writes to the "same" block not necessarily being written to the exact same set of cells).

Re: Old tech is haunted

#99

Earlier quoted context omitted.

>Then go tell that to Peter Gutmann: Which is what the authors of "Overwriting Hard Drive Data: The Great Wiping Controversy" did. The highlight of their response is that for the recovery method described in Gutmann's paper to be accurate it requires a copy of the original data. When the authors tested a drive that existed at the time Gutmann wrote that paper in optimal conditions there was only a 92% chance of recov…

> When the authors tested a drive that existed at the time Gutmann wrote that paper in optimal conditions there was only a 92% chance of recovering a bit correctly. The chance to successfully recover exponentially decays with the number of bits you want to recover. That's still a non-zero probability. For folks whose tolerance for data exfiltration is "zero", anything non-zero, no matter how infinitesimally small, is…

>That's still a non-zero probability

Just as there is a nonzero chance of someone recovering your data by reading /dev/urandom. Technically your data could be outputed but the person reading /dev/urandom would not be able to tell if it was just random data or if it was what was wiped.

Even if your tolerance for data exfiltration is 0 you can be okay with a non 0 chance for someone to randomly generate the data.

>If we're going to adjust our expectations for "overwriting is sufficient for data destruction" based on changes in technology, then SSDs are absolutely in scope

The process of wiping SSDs is different because you don't do it by overwriting all of the data, but instead by initiating a secure erase.

Re: Old tech is haunted

#100

Earlier quoted context omitted.

> When the authors tested a drive that existed at the time Gutmann wrote that paper in optimal conditions there was only a 92% chance of recovering a bit correctly. The chance to successfully recover exponentially decays with the number of bits you want to recover. That's still a non-zero probability. For folks whose tolerance for data exfiltration is "zero", anything non-zero, no matter how infinitesimally small, is…

>That's still a non-zero probability Just as there is a nonzero chance of someone recovering your data by reading /dev/urandom. Technically your data could be outputed but the person reading /dev/urandom would not be able to tell if it was just random data or if it was what was wiped. Even if your tolerance for data exfiltration is 0 you can be okay with a non 0 chance for someone to randomly generate the data. >If w…

> Just as there is a nonzero chance of someone recovering your data by reading /dev/urandom.

That variety of non-zero is much closer to zero than the risk of increasingly-sophisticated equipment being able to recover overwritten data - and unlike the non-zero risk of such an "infinite typewriters" sort of attack, mitigating the non-zero risk of recovering overwritten information from media is straightforward: destroy the media.

> The process of wiping SSDs is different because you don't do it by overwriting all of the data, but instead by initiating a secure erase.

In other words: trusting an opaque blob of SSD firmware to overwrite all of the data for you.

Post reply on HN