Live data from Hacker News

Why Do Models That Predict Failure Fail? [pdf]

fdic.gov

11–20 of 29 posts

Re: Why Do Models That Predict Failure Fail? [pdf]

#11

A true future predicting algorithm should be aware of its existence and the affect its prediction will have over the receiver / receivers.

Indeed, shouldn't that be the point?

Yes, but that would make it infinitely hard for the algorithm as the output is depending on who is receiving the output. Hence the algorithm should have perfect understanding of environment, receiver and equation between the environment and receiver.

Re: Why Do Models That Predict Failure Fail? [pdf]

#13

A true future predicting algorithm should be aware of its existence and the affect its prediction will have over the receiver / receivers.

Hari Selden had a pretty developed concept what people can know about an algorithm that anticipates their behavior.

Re: Why Do Models That Predict Failure Fail? [pdf]

#14

A true future predicting algorithm should be aware of its existence and the affect its prediction will have over the receiver / receivers.

This is the gist of the Rational Expectations wave of economic theory.

https://www.nobelprize.org/prizes/economic-sciences/1995/cer...

Re: Why Do Models That Predict Failure Fail? [pdf]

#15

There's an old saying that goes something like there are countless way to fail, but only a few ways to succeed. Perhaps there's more complexity in modeling failure?

All happy families are alike; each unhappy family is unhappy in its own way.

https://en.wikipedia.org/wiki/Anna_Karenina_principle

Re: Why Do Models That Predict Failure Fail? [pdf]

#16

Taleb's preachings come to mind

How exactly?

Excerpted summary from here [0]

Difficulties of Prediction Ultimately, our world and future are unknowable and unpredictable because of various factors, including:

• The role of chance and luck in inventions and game-changing discoveries

• The inherently unpredictable nature of dynamical systems and variables that behave in inconsistent or nonlinear ways

• We can’t make accurate predictions with flawed and incomplete information.

The combination of the 2 sets of factors above means that: humans are terrible at prediction, yet we keep making predictions without realizing how frequently we’re off the mark. Taleb calls this the “scandal of prediction”.

[0] - https://readingraphics.com/book-summary-the-black-swan/

Re: Why Do Models That Predict Failure Fail? [pdf]

#17

A true future predicting algorithm should be aware of its existence and the affect its prediction will have over the receiver / receivers.

Hari Selden had a pretty developed concept what people can know about an algorithm that anticipates their behavior.

They got mad ?

"Violence is the last refuge of the incompetent." - not actually Hari Seldon

Re: Why Do Models That Predict Failure Fail? [pdf]

#18

Earlier quoted context omitted.

How exactly?

Excerpted summary from here [0] Difficulties of Prediction Ultimately, our world and future are unknowable and unpredictable because of various factors, including: • The role of chance and luck in inventions and game-changing discoveries • The inherently unpredictable nature of dynamical systems and variables that behave in inconsistent or nonlinear ways • We can’t make accurate predictions with flawed and incomplete…

These are characteristic talebian points (it's good that you read a Cliff's Notes, I read the whole thing and what a pompous gasbag) but there isn't much that's specifically talebian to what you said.

People make predictions because they judge that it's better to have bad predictions than none at all. The probable error in prediction (e.g. the "cone of uncertainty" that becomes wider and wider as you go into the future in the simplest, best-performing econometric models) is somewhat undersold, but the general understanding is that this is still a Pareto improvement.

Bicycle helmets are also no good if you get hit by a truck.

Re: Why Do Models That Predict Failure Fail? [pdf]

#19

There's an old saying that goes something like there are countless way to fail, but only a few ways to succeed. Perhaps there's more complexity in modeling failure?

I usually think of it as being a reflection of entropy. There are innumerable configurations of the plastic and steel that makes up my car, but only a vanishingly small proportion result in drivable vehicles.
Post reply on HN