Live data from Hacker News

Heuristics that almost always work

astralcodexten.substack.com

71–80 of 541 posts

Re: Heuristics that almost always work

#71
post #48

My favourite one is seeing IT admins plan for “this almost always won’t fail.” Substitute “this” for SAN array, core switch, or entire data centre. I’ve had someone argue with me at length that simultaneous multi disk failures in a RAID5 never happen. Two weeks later it did and the main SAN disk array went up in smoke.

It is useful to remember that "almost never" is a synonym for "sometimes".

“Scientists have calculated that the chances of something so patently absurd actually existing are millions to one. But magicians have calculated that million-to-one chances crop up nine times out of ten.”

Terry Pratchett

Re: Heuristics that almost always work

#72
One interesting twist on the doctor example: we know she is almost always right that it's nothing, that it will all go away and that just two aspirins are ok. The article correctly points out that she will miss one or two cases where it was a terrible disease instead, and that her prescription of aspirin and to go away and rest will be misguided.

However... doctors must do more than just cure you. They must also "do no harm"; in fact that is (or should be) their default. What if she intervened more directly in more cases, maybe poked and prodded and recommended more invasive treatments? She would get more cases wrong in the opposite direction (recommending a potentially invasive or even harmful treatment when some rest and an aspirin would have sufficed), maybe resulting in accidental death through action rather than inaction.

She must be alert, but hers is a good default/heuristic. It's not the same as a rock with "TAKE ASPIRIN" written on it.

And this is just an example. I think the heuristics that work 99.9% of the time do so because they do indeed work. Erring in the opposite direction can, in some cases, be also harmful.

Re: Heuristics that almost always work

#73

Funnily enough, you could replace this article with a rock that said, "When people are confronted with a very skewed probability distribution, after a while they become complacent and default to the most probable outcome".

Hum... You mean you can replace some text with some other text?

Re: Heuristics that almost always work

#74

>The only problem is: he now provides literally no value. He’s excluded by fiat the possibility of ever being useful in any way. He could be losslessly replaced by a rock with the words “THERE ARE NO ROBBERS” on it except for the value of having a security guard visible so that 99% of the robbers who might conceivably want to rob a Pillow Mart decide to go rob Quilting Heaven down the road instead.

Instead of a rock you just need an inflatable security guard. What's frightening about all this is that this article has gotten 15 upvotes despite 100% of the comments so far being about what a pointless article this is.

People who agree upvote and have nothing more to say, people who disagree come to post their objections.

Re: Heuristics that almost always work

#75
post #72

One interesting twist on the doctor example: we know she is almost always right that it's nothing, that it will all go away and that just two aspirins are ok. The article correctly points out that she will miss one or two cases where it was a terrible disease instead, and that her prescription of aspirin and to go away and rest will be misguided. However... doctors must do more than just cure you. They must also "do…

Yeah this is literally found to be the case with back injuries I think?

Re: Heuristics that almost always work

#76

>The only problem is: he now provides literally no value. He’s excluded by fiat the possibility of ever being useful in any way. He could be losslessly replaced by a rock with the words “THERE ARE NO ROBBERS” on it except for the value of having a security guard visible so that 99% of the robbers who might conceivably want to rob a Pillow Mart decide to go rob Quilting Heaven down the road instead.

A coworker and I were once stuck in an office building for an hour or two. We were working as consultants at a client's building and ended up working rather late. Not particularly late by software programmer standards, but clearly exceptionally late by the culture of the client company.

At some point in the evening all the exit doors, including the front door, became armed, and this was conspicuously noted as when we packed up for the night and tried to exit to the parking lot, we realized we couldn't open the door without an alert being sent to the police (not just the security company). There should have been a guard at his station (desk, CCTVs, etc) in the entryway, but we found none.

We waited for awhile. Then we walked up, down, and through every corridor and restroom of that 4-5 story building, multiple times, looking for the guard. When that failed, we called the security company to ask them if it was okay to open the door. They swore there was a guard on duty and asked us to wait a little longer in case he was doing rounds. Despite knowing that couldn't possibly be the case, we obligingly passed more time waiting in the entryway. Then we walked up, down, and around the building again, but this time splitting up and shouting. Nothing. Nobody.

We go back down and inform the security company that we weren't going to wait any longer and that we'd be triggering the silent alarm as we left. And guess who exits the elevator just as we were about to open the door.... Apparently he had been sound asleep in a cozy nook somewhere in the upper floors--presumably in a conference room or more likely a private office, the former being something we inspected in passing (glass walls), the latter we didn't feel comfortable opening and entering, and both being the last place you'd expect to find a security guard. IIRC, he wouldn't admit it outright, but just played coy. We weren't mad. A little tired and frustrated because as consultants we still had to get in early the next morning, but that was mostly offset by the sheer absurdity of the situation, and by the fact that he seemed quite elderly.

Anyhow, you may assume too much if you assume the security guard actually maintains some kind of useful presence. I guess these days it's more common to have electronic way stations to log a guard doing rounds. I dunno if this building had such measures (this was circa 2001-2002), but as the sole guard he probably was expected to spend most of his time, if not all of his time, manning the security desk, providing ample opportunity to be doing something else, instead.

Re: Heuristics that almost always work

#77

This is what Nassim Nicholas Taleb has been writing books about. He calls them black swan events, because if you took a sample of 1000 swans, chances are you'd conclude that all swans are white, but it just isn't so. People tend to round down the probability of very rare events to zero, even when the upside of them is small and the downside is catastrophically bad. Examples: the 2008 housing crisis, Fukushima, and ou…

I think it's what he calls "fat tails" : events happening at low frequency at the tail of the probability distribution, but which have a significant impact.

Re: Heuristics that almost always work

#78

I don't understand how articles like this get upvoted. Who is getting value from this? This reads like some generic LinkedIn CEO post that sounds deep on the surface but actually means nothing.

It seems to make its point pretty clearly to me: "just naysay" is a strategy that is extremely effective/accurate in many domains, but provides no actual value compared to people attempting more honest evaluations or predictions. I just realized it's possible I'm being whooshed by your comment.

I don't think he's being meta, just obtuse.

Re: Heuristics that almost always work

#79
post #44

Earlier quoted context omitted.

It's a great example. This is the very reason I have scaled back the amount of time I rock climb as I've gotten older -- not because any individual outing is dangerous, but there's an element of Russian roulette wherein the mere act of doing it more often dramatically changes the risk.

Also known as the Kelly criterion. If one possible outcome of an action is associated with a great enough loss, it doesn't make sense to perform the action no matter how unlikely the loss.

Isn't that called Pascal's Wager?

Re: Heuristics that almost always work

#80

Earlier quoted context omitted.

Instead of a rock you just need an inflatable security guard. What's frightening about all this is that this article has gotten 15 upvotes despite 100% of the comments so far being about what a pointless article this is.

People mostly seem to object to the security guard example as missing a part of the analysis.

Seems like the article writer has fallen for the very issue they're trying to portray, by writing so many examples that they've stopped thinking and just resorted to writing "PERSON CAN BE REPLACED WITH ROCK". If this isn't ironic then I don't know what is.
Post reply on HN