Live data from Hacker News

Nassim Taleb: We should retire the notion of standard deviation

edge.org

241–250 of 254 posts

Re: Nassim Taleb: We should retire the notion of standard deviation

#241
post #223

Earlier quoted context omitted.

After being assigned to a currency desk, he was sitting on a lot of Eurodollar options when black Monday happened in October, 1987. http://en.wikipedia.org/wiki/Black_Monday_(1987) That unpredicted event made him and his organization loads of money, and made him a sudden seer of markets. Which is humorous because his book Fooled By Randomness is primarily a bit of a bitter tirade about how we declare people savants b…

Almost everyone predicted it yet almost nobody was ready when it came, and I still remember the panic and cries about "this is the end of western civilization" and "we have to abandon capitalism now because it failed completely". Maybe "almost everyone" was not as everyone as it seems. >>> There was absolutely nothing of worth predicted in that, I think it was quite worthy for those who was on the right side of the m…

The housing and subprime issues were the fodder for every economic fear monger, rightly, for literally years (and honestly if you think otherwise, you have absolutely no knowledge of the financial markets). So why then didn't everyone just pull out of the market? Well, eventually they did, and that was what caused the crash. But preceding it was effectively a game of chicken where people still want to make money trading papers, and if they think they can buy something today that they can sell for more tomorrow, even if they think the next day it might be worthless, many will do that. In the same way that the world is pretty certain we're going to run out of oil...so we use more of it than ever. We'll deal with it running out when that actually happens.

There was zero specificity in Taleb's proclamations. It was just the vague "there are a lot of debts and an inflated housing market that is bound for a correction and is immensely interest rate dependent". Yeah, that's great, but is the same thing everyone else was saying.

GM went bankrupt during the financial crunch. This may blow your mind but the bankruptcy of GM was predestined for years -- their debts kept growing larger while their profits stayed static or shrank.

Everyone knew it was coming, it was only a question of when and what would precipitate it. Yet, people still traded in GM. Exactly the same concept -- people don't trade on what they think will happen tomorrow or next year, they trade on what they think other people think will happen tomorrow or next year.

So there is no misleading, and honestly only "rubes" fall for the "I predicted this" bit.

Re: Nassim Taleb: We should retire the notion of standard deviation

#242

Earlier quoted context omitted.

After being assigned to a currency desk, he was sitting on a lot of Eurodollar options when black Monday happened in October, 1987. http://en.wikipedia.org/wiki/Black_Monday_(1987) That unpredicted event made him and his organization loads of money, and made him a sudden seer of markets. Which is humorous because his book Fooled By Randomness is primarily a bit of a bitter tirade about how we declare people savants b…

Actually, Taleb has explicitly stated that the 2008 financial crisis was not a Black Swan nor does he claim to be able to predict any of them.

Fascinating, but how is that at all relevant? I didn't call 2008 a black swan, I called Black Monday in 1987 a "Black Swan", using Taleb's own descriptor for it. So what is the issue?

A different discussion concerns the fact that Taleb's possible luck in 1987 makes him a prescient seer for things like the financial crisis. But he isn't, and a tremendous number of things he has said have simply been wrong (most notably, and importantly, everything he said about government intervention. He was 100% wrong in every way).

People ask why people get the heckles up about Taleb, and it isn't actually about Taleb at all. It's about the, for lack of a better phrase, Taleb "fan boys". Bizarre that such a thing exists, but people like having their prophet.

Re: Nassim Taleb: We should retire the notion of standard deviation

#243
post #78

Earlier quoted context omitted.

>> The notion of standard deviation has confused hordes of scientists > What an assertion! It also proved to be very useful for hordes of scientists... what about some examples of confused scientists ? He is exaggerating, for sure. But the point is valid: the mean average deviation (MAD) is often very different than the standard deviation (STD), and the MAD is more intuitive, it has a natural geometrical interpretati…

I'm relieved to hear from others who didn't love his book, now I don't feel so left out. I checked out Black Swan from the library a while back. It seemed like Taleb's smug prose and mudslinging were writing a check his evidence couldn't cash, but I couldn't stand more then the first 50 pages, so I never got to find out. My girlfriend read it all of it and sort of gave me the cliff notes; she thought I wasn't missing…

I couldn't make it through 50 pages of Black Swan. I haven't read his newest book.

Fooled by Randomness[1] was very good. It's more of a set of cautionary tales, mostly pulled from Wall Street, about how to think about chance and making sure you're judging all events against what is expected by chance.

The thing about Taleb is that all of his success hinges on a single, long-ago tail event that few people even remember. It defines his entire outlook and he often assumes that people who interview him or read his articles know this. The article in question not withstanding, if you mentally insert "when discussing tail events" before his claims, many of them make much more sense :)

[1] http://www.amazon.com/Fooled-Randomness-Hidden-Chance-Market...

Re: Nassim Taleb: We should retire the notion of standard deviation

#244

Earlier quoted context omitted.

Actually, Taleb has explicitly stated that the 2008 financial crisis was not a Black Swan nor does he claim to be able to predict any of them.

Fascinating, but how is that at all relevant? I didn't call 2008 a black swan, I called Black Monday in 1987 a "Black Swan", using Taleb's own descriptor for it. So what is the issue? A different discussion concerns the fact that Taleb's possible luck in 1987 makes him a prescient seer for things like the financial crisis. But he isn't, and a tremendous number of things he has said have simply been wrong (most notabl…

Your post was in reply to someone asking about Taleb's Black Swans so I assumed you were talking about 2008 in reference to that.

Re: Nassim Taleb: We should retire the notion of standard deviation

#245
post #224

Earlier quoted context omitted.

Actually, Taleb has explicitly stated that the 2008 financial crisis was not a Black Swan nor does he claim to be able to predict any of them.

In fact, most of Taleb's ideas are about how to not rely on predictions of events that are unpredictable - so faulting him for predicting or not predicting this and that means one does not really understands what Taleb is talking about.

Yes, his Black Swan stuff is a completely separate issue from whether he has or hasn't predicted anything.

Re: Nassim Taleb: We should retire the notion of standard deviation

#246
post #36

I really tried to get through "The Black Swan" and Taleb's writing struck me as so pretentious and self-involved that it made it impossible for me to finish. He strikes me as someone who is so desperate to be important and recognized that an assertion like this doesn't really surprise me.

Not really a surprise for someone who was so in thrall to Benoît Mandelbrot, another world-class narcissist.

Here's Taleb on Mandelbrot: "[He] had perhaps more cumulative influence than any other single scientist in history, with the only close second, Isaac Newton."

That quote really says it all.

Re: Nassim Taleb: We should retire the notion of standard deviation

#247

Earlier quoted context omitted.

> The STD is far more easy to analyze in a mathematical way. That is the huge value it brings This is also what I have read (I have essentially no experience with statistics). > squaring is an operation you can take the derivative of, but absolute value you cannot We can talk without wild, obviously false hyperbole. It's trivial to take the derivative of the absolute value function. Working with it is more difficult,…

"Easy as anything in math"? Now that's "obviously false hyperbole". You can't just brush away that discontinuity, specially when it's on the minimum (which is what people most often care about). Anyway, this is formalized in the notion of subderivative. http://en.wikipedia.org/wiki/Subderivative

This occurred to me after the editing window for my other reply passed, but...

The tangent function has discontinuities at x = pi/2 and every interval of pi from it. When taking the derivative, is it more fruitful to say "you can't just brush away those discontinuities", or "sec^2 x"? And this is a derivative all calculus students are required to know!

Re: Nassim Taleb: We should retire the notion of standard deviation

#248
post #222

Earlier quoted context omitted.

I'm relieved to hear from others who didn't love his book, now I don't feel so left out. I checked out Black Swan from the library a while back. It seemed like Taleb's smug prose and mudslinging were writing a check his evidence couldn't cash, but I couldn't stand more then the first 50 pages, so I never got to find out. My girlfriend read it all of it and sort of gave me the cliff notes; she thought I wasn't missing…

What is hilarious is that I have been scratching my head over the exact opposite phenomenon! I actually love Taleb's books (Black Swan, Antifragile). And I work with "data scientists", most with Ph.D.s, many in statistics. I always talk about his book, but I cannot for the life of me find a single person who's even read it. I think: these are some the ONLY book about stats on the NY Times best seller lists (up until…

Ok, you convinced me to try again, thanks.

FWIW, I'm from the west coast, but have spent the last several years in New York working with natural sciences students and post-docs. I might be what you would call an "ideas" person. Abstraction appeals to me. People in our department seem happier when their work is closer to physical observerations. Measuring stuff with yard sticks and radar: good. Getting big piles of data from other people, and doing stats: OK. Fitting a parematerized model to someone else's data: healthy skepticism. Of course healthy skepticism is generally cultivated.

It wouldn't be surprising if our friends reading lists (and reactions) depend on what they do for living. Did you meet a lot of people in finance or economics on the east coast? Maybe people's professions are spatially correlated.

My peers seem to treat models cautiously (including their own), and have tended to respond to abstract economic ideas with measured skepticism. I can't speak for them, but I sometimes perceive that economic arguments are suspected of being insufficiently empirical and subject to ulterior motives. Which, it seems, is at least a part of what Taleb is complaining about. Obviously these things can be true of any kind of argument, I'm just reporting my impression. Anyhow, it would be easier to listen Taleb if his tone was more restrained.

Most of the economists I have paid attention to (which are not near as many as I would like) seemed inclined to provocation. Sowell in "Basic Economics", and Friedman in his speeches (I haven't read his papers) tend to poke fun at their fellow citizens, for example. I think they sometimes alienate those outside their discipline because of this. It makes reading fun though. I find Friedman very amusing, and I think so does he.

Re: Nassim Taleb: We should retire the notion of standard deviation

#249
post #223

Earlier quoted context omitted.

Almost everyone predicted it yet almost nobody was ready when it came, and I still remember the panic and cries about "this is the end of western civilization" and "we have to abandon capitalism now because it failed completely". Maybe "almost everyone" was not as everyone as it seems. >>> There was absolutely nothing of worth predicted in that, I think it was quite worthy for those who was on the right side of the m…

The housing and subprime issues were the fodder for every economic fear monger, rightly, for literally years (and honestly if you think otherwise, you have absolutely no knowledge of the financial markets). So why then didn't everyone just pull out of the market? Well, eventually they did , and that was what caused the crash. But preceding it was effectively a game of chicken where people still want to make money tra…

>>> were the fodder for every economic fear monger, rightly, for literally years

You realize "everyone" and "every economic fear monger" are very distinct groups? Before the crisis struck, those fear mongers were generally thought of as curiosities or cranks, not visionaries. It wasn't that long ago, too early yet to rewrite history.

Moreover, theories like these: http://www.wired.com/wired/archive/7.09/zeros.html http://bullnotbull.com/archive/predictions-2007.html http://useconomy.about.com/b/2007/01/03/2007-forecast-for-th... http://knowledge.wpcarey.asu.edu/article.cfm?articleid=1344 or even this one: http://www.amazon.com/gp/product/0385514344

were pretty popular. At the last one, we've got excellent review from top people at Federal Reserve and Fannie Mae.

>>> There was zero specificity in Taleb's proclamations.

Huge surprise from a guy who talks about principally unpredictable events as the basis of his philosophy. You expect him to talk about black swans and then say "the market would go down X points at day Y"?

>>> In the same way that the world is pretty certain we're going to run out of oil.

Are you sure? http://cnsnews.com/news/article/gao-recoverable-oil-colorado...

Re: Nassim Taleb: We should retire the notion of standard deviation

#250
post #222

Earlier quoted context omitted.

What is hilarious is that I have been scratching my head over the exact opposite phenomenon! I actually love Taleb's books (Black Swan, Antifragile). And I work with "data scientists", most with Ph.D.s, many in statistics. I always talk about his book, but I cannot for the life of me find a single person who's even read it. I think: these are some the ONLY book about stats on the NY Times best seller lists (up until…

Ok, you convinced me to try again, thanks. FWIW, I'm from the west coast, but have spent the last several years in New York working with natural sciences students and post-docs. I might be what you would call an "ideas" person. Abstraction appeals to me. People in our department seem happier when their work is closer to physical observerations. Measuring stuff with yard sticks and radar: good. Getting big piles of da…

I am a programmer in Silicon Valley, but I was more interested in philosophy/mathematics when I was young (I was raised and educated on the east coast). I do feel there is a cultural difference -- not sure precisely what it is though.

I guess I share Taleb's problems with models. Even before I read Taleb I would say to myself "the map is not the territory", particularly with regard to software abstractions. I think the space between the model and reality is where you find a lot of interesting things (including the ability to make a lot of money).

I also share Taleb's skepticism with economics. The core problem is that it's not really a predictive science. It's a lot of people talking about stuff. Did those ideas help anyone? You can make a good case that they hurt a lot of people. If they are so smart, why aren't they rich? The Scholes case is a great example of that.

I'm currently reading "The Signal and the Noise" by Nate Silver, which is actually a fantastic complement to Taleb's books. They say very much the same things, in very different ways. The good part is that you will not be turned off by Silver's prose -- he's humble and very readable. I didn't follow 538 at all, and didn't pay all that much attention to the 2012 election, but I can tell that his writing skill was a big reason he became so popular.

To give an example, Taleb talks over and over about "negative knowledge" -- what not to do, what things don't work, etc. And Nate Silver says the same thing. To make accurate predictions and models, you have to be aware of known classes of mistakes, cognitive biases, etc. and not fall into those traps. People often think that they need to improve themselves by learning more. But for a reasonably smart people, the bottleneck to your effectiveness is actually thinking that you know something you don't.

I am also an "ideas" person but I share the utilitarianism and empiricism of Taleb. There has to be "skin in the game", as he says. There are so many ideas out there, and generally most philosophical arguments (and journalism, advocacy, etc.) boil down to confused semantics. So the way to find truth is through actions and experiments. Economics fails these tests for truth.

EDIT: Nate Silver talks about this paper: http://www.plosmedicine.org/article/info:doi/10.1371/journal... This would resonate with Taleb quite a bit. Most ideas are false, including published ones. It would actually violate economic theory if that weren't the case -- if most science was true -- because scientists have bad incentives (something I know from direct experience).

Post reply on HN