Live data from Hacker News

Heuristics that almost always work

astralcodexten.substack.com

11–20 of 541 posts

Re: Heuristics that almost always work

#11
I'm confused. These heuristics don't almost always work. The security guard has a 0% chance of investigating. How is 0% almost always?

If you make a confusion matrix its precision and recall is 0. If it almost always worked then its precision and recall would be close to 1.

Re: Heuristics that almost always work

#12
post #3

Generally agree with the article, though the reverse is obviously, "Heuristic which almost never works", and all the stories are about the 1 out 100000 times the weirdo was right and everyone lauded them as a genius but really they just got lucky the once.

There's 100000 or more weirdos out there claiming all sorts of spurious stuff, it's only natural one of them would be right

Re: Heuristics that almost always work

#13
Sure, relying too much on heuristics can be a bad idea in tail risk situations.

But other times, they make perfect sense and save a lot of time and effort.

This post reads like a series of straw men created to show that heuristics are dangerous. I’m not sure who is going to argue that heuristics are appropriate in those situations.

Re: Heuristics that almost always work

#14

>The only problem is: he now provides literally no value. He’s excluded by fiat the possibility of ever being useful in any way. He could be losslessly replaced by a rock with the words “THERE ARE NO ROBBERS” on it except for the value of having a security guard visible so that 99% of the robbers who might conceivably want to rob a Pillow Mart decide to go rob Quilting Heaven down the road instead.

Instead of a rock you just need an inflatable security guard. What's frightening about all this is that this article has gotten 15 upvotes despite 100% of the comments so far being about what a pointless article this is.

People mostly seem to object to the security guard example as missing a part of the analysis.

Re: Heuristics that almost always work

#16
This is what Nassim Nicholas Taleb has been writing books about. He calls them black swan events, because if you took a sample of 1000 swans, chances are you'd conclude that all swans are white, but it just isn't so. People tend to round down the probability of very rare events to zero, even when the upside of them is small and the downside is catastrophically bad. Examples: the 2008 housing crisis, Fukushima, and our current supply chain problems.

Re: Heuristics that almost always work

#17

I'm confused. These heuristics don't almost always work. The security guard has a 0% chance of investigating. How is 0% almost always? If you make a confusion matrix its precision and recall is 0. If it almost always worked then its precision and recall would be close to 1.

You're only counting the positives. When positives are rare, just guessing the result will be negative is usually a really good starting place.

Re: Heuristics that almost always work

#18
post #15

> Whenever someone pooh-poohs rationality as unnecessary, or makes fun of rationalists Fun and clever article, but for it all to land on that was jarring and disappointing. Preaching to the choir I guess.

He’s not complaining about those criticizing rationalists but warns fellow rationalists to not fall into this heuristics trap themselves.

Re: Heuristics that almost always work

#19

I'm confused. These heuristics don't almost always work. The security guard has a 0% chance of investigating. How is 0% almost always? If you make a confusion matrix its precision and recall is 0. If it almost always worked then its precision and recall would be close to 1.

You're only counting the positives. When positives are rare, just guessing the result will be negative is usually a really good starting place.

>is usually a really good starting place

No, you are getting misleading results because you have an imbalanced dataset.

Re: Heuristics that almost always work

#20

I'm confused. These heuristics don't almost always work. The security guard has a 0% chance of investigating. How is 0% almost always? If you make a confusion matrix its precision and recall is 0. If it almost always worked then its precision and recall would be close to 1.

You're only counting the positives. When positives are rare, just guessing the result will be negative is usually a really good starting place.

This is how you can throw out most of the COVID tests in the trash and say they all were negative and get away with it... for a while!
Post reply on HN