Live data from Hacker News

The Fallacy of Seeing Patterns

blog.clevertap.com

31–36 of 36 posts

Re: The Fallacy of Seeing Patterns

#31
post #19

Earlier quoted context omitted.

I'm tempted to point out that you went from zero to Godwin in record time. To assume that Konrad's party affiliation (likely a pragmatic choice at the time) either validates or invalidates his work is a bit absurd. The issue as I see it is one of the modern meaning, which is to say, a tendency to see patterns where none exist. Nonetheless, let us see whether Konrad's work has been dismantled in more recent studies. A…

I didn't say his party affiliation validates or invalidates his theory. I said that a published paper was not able to validate it empirically. The big issue I have is that it seems impossible to define a general concept of "pattern", such that one could claim it doesn't exist. If such a concept cannot be defined, then it is unclear what the concept actually means. The only thing I can imagine that could possibly fit…

The fundamental result behind the gambler's ruin is the human tendency to perceive patterns in genuine randomness. Rorschach blots, lotteries, slot machines, most betting endeavors all work because some humans will always find patterns in randomness. The result is easy enough as are the experiments (generate random noise from Uniform(0,1), project it onto a suitable manifold, hire some undergrads or local homeless people to look at them). That's not at all what I claimed Konrad originated. If you want an origin for this type of thing, de Finetti or Laplace or Descartes might be some candidates.

Konrad did give the phenomenon a catchy name and proposed that an increase in this tendency is an initial step in developing schizophrenia. If someone could actually establish this at a neurogenetic level that would be impressive and fundamental; I'm not aware of anyone doing so. I'd expect it to show up in a CNS journal and NIMH or WT to make a big deal if someone did.

The contrast between epiphany and apopheny is so striking, though, and so relevant to this topic, that it annoys me to no end when it is ignored. At the base of all of statistics is a desire to quantify how much of each is present in an observation, experiment, or cyclic series.

As you probably guessed, I am an applied statistician, not a neuroscientist. (I have serious issues with the way statistics are misused in neuroscience, for whatever that's worth). I do not, and cannot, claim that Konrad's theory is fundamental to that field. I do claim that anyone attempting to explain statistical reasoning to a lay public ought to internalize the contrast he proposed. Its setting as a proposed turn towards insanity is just a happy historical note.

Re: The Fallacy of Seeing Patterns

#32
post #19

Earlier quoted context omitted.

I'm tempted to point out that you went from zero to Godwin in record time. To assume that Konrad's party affiliation (likely a pragmatic choice at the time) either validates or invalidates his work is a bit absurd. The issue as I see it is one of the modern meaning, which is to say, a tendency to see patterns where none exist. Nonetheless, let us see whether Konrad's work has been dismantled in more recent studies. A…

I didn't say his party affiliation validates or invalidates his theory. I said that a published paper was not able to validate it empirically. The big issue I have is that it seems impossible to define a general concept of "pattern", such that one could claim it doesn't exist. If such a concept cannot be defined, then it is unclear what the concept actually means. The only thing I can imagine that could possibly fit…

Incidentally, if you are a Popperian, you'll note that the best we can do in the sciences is to disprove (empirically falsify) a theory.

Outside of math, there is (almost?) no absolute proof. The weight of the evidence is all we have.

Re: The Fallacy of Seeing Patterns

#33
post #30
post #28

Earlier quoted context omitted.

Appreciate your interesting thoughts on the subject. It certainly does appear that brain circuits are evolved to respond to patterns in data, for example, visual neurobiology has been studied extensively re: how visual systems can identify patterns in visual data. Not exactly sure how you define "appropriate" in this context. Like an astronomically complex "neural net", the brain integrates "input" into pattern recog…

You're right in that it doesn't seem to add any information. It's possible that there's nothing more to learn, but it's also possible that the distinction would manifest in a subtle way that your current formalized understanding doesn't employ sufficient granularity to capture. I guess I prefer the term appropriate because it more cleanly handles the case when the patterns "don't" match: by indicating that such situa…

> Either way, it bears keeping in mind that our day-to-day language isn't really optimized for discussing these kinds of things, so there's bound to be multiple layers of confusion.

After decades-long study of human behavioral phenomena, I'm striving to articulate what I've learned in coherent written form. It's proving difficult to transform a non-linear multi-dimensional model into ordinary English prose that readers can comprehend. So I absolutely agree with your comment about limitations of ability to reduce mental models to common language.

The issues you bring up concerning formalized models that allow mapping behavior to determining factors are indeed of central importance. A model must permit sufficient granularity of analysis, at the same time covering sufficient generality without contradiction of the granular level. The hard part is describing the interactivity of this whole range of "levels", because the immediate and the distant elements are in fact occurring simultaneously and affecting the system under observation in real time. It gets convoluted when we realize the observation itself has effects on the observed behavior.

The problem I have with "appropriate" is the term's ambiguity. OTOH "pattern" implies there's a "match" or there isn't. (I know, patterns can be iffy, but then they're not quite a pattern.) Encountering a situation that's unclear, where no "matched" pattern is evident, immediately arouses alarm. Then we proceed with caution until observing enough that something "familiar" is gleaned, or observe/interact enough to establish a new pattern.

This state of "I don't know" is constantly implicit, patterns never match perfectly, details always vary. Most of the time that's overlooked because we accept a "close enough fit" to established patterns, that is, categorical classification is an abstraction that works adequately most of the time.

For example, often it's good enough to say "that's a tree" without saying what kind of tree. But other times it's important to distinguish a fir from a pine from a hemlock. Patterns are infinitely divisible, ultimately no two trees are identical, at some level of refinement abstractions break down and no longer apply. A thing is no more or less than its actual attributes. Though indispensable for human existence, abstraction is just a tool, pattern recognition is a built-in mechanism of abstraction, best to remember all tools have their limits.

I certainly would never say there's no more to learn, just that defining terms is only a tool for communication, not to be confused with the information we attempt to share. We get confused when we think we are "explaining" phenomena that we observe. In reality, it's less confusing and more informative to simply describe what we observe. Curiously, thoroughly observed phenomena are the things we tend to call self-evident or self-explaining, which suggests an explanation is only an expression of uncertainty about patterns yet to be adequately elucidated.

Re: The Fallacy of Seeing Patterns

#34
post #31

Earlier quoted context omitted.

I didn't say his party affiliation validates or invalidates his theory. I said that a published paper was not able to validate it empirically. The big issue I have is that it seems impossible to define a general concept of "pattern", such that one could claim it doesn't exist. If such a concept cannot be defined, then it is unclear what the concept actually means. The only thing I can imagine that could possibly fit…

The fundamental result behind the gambler's ruin is the human tendency to perceive patterns in genuine randomness. Rorschach blots, lotteries, slot machines, most betting endeavors all work because some humans will always find patterns in randomness. The result is easy enough as are the experiments (generate random noise from Uniform(0,1), project it onto a suitable manifold, hire some undergrads or local homeless pe…

>The fundamental result behind the gambler's ruin is the human tendency to perceive patterns in genuine randomness.

I don't think pattern recognition drives most gamblers. There are all kinds of other benefits, perceived or real, that are not accounted for in a purely monetary payoff grid.

I don't know how you can generate random noise. I assume you are using a standard, pixelated display to read this message. Even if a random process was choosing what to display on that screen, there are only a finite number of configurations. Exactly what you are viewing now could be recreated by such a random process.

The problem that hasn't been addressed yet is that "pattern" is not well-defined. If a random display shows a horizontal line pattern, it is still a pattern by some definition (and you would have no way to distinguish it from a "intentionally patterned" display that has the same configuration).

Re: The Fallacy of Seeing Patterns

#35
post #32

Earlier quoted context omitted.

I didn't say his party affiliation validates or invalidates his theory. I said that a published paper was not able to validate it empirically. The big issue I have is that it seems impossible to define a general concept of "pattern", such that one could claim it doesn't exist. If such a concept cannot be defined, then it is unclear what the concept actually means. The only thing I can imagine that could possibly fit…

Incidentally, if you are a Popperian, you'll note that the best we can do in the sciences is to disprove (empirically falsify) a theory. Outside of math, there is (almost?) no absolute proof. The weight of the evidence is all we have.

I believe Popper thought you might be able to find a metric to judge how close to a "truth" one theory might be compared to others.

Re: The Fallacy of Seeing Patterns

#36
post #31

Earlier quoted context omitted.

The fundamental result behind the gambler's ruin is the human tendency to perceive patterns in genuine randomness. Rorschach blots, lotteries, slot machines, most betting endeavors all work because some humans will always find patterns in randomness. The result is easy enough as are the experiments (generate random noise from Uniform(0,1), project it onto a suitable manifold, hire some undergrads or local homeless pe…

>The fundamental result behind the gambler's ruin is the human tendency to perceive patterns in genuine randomness. I don't think pattern recognition drives most gamblers. There are all kinds of other benefits, perceived or real, that are not accounted for in a purely monetary payoff grid. I don't know how you can generate random noise. I assume you are using a standard, pixelated display to read this message. Even i…

Of course you could have an intersection between recognizable images and random noise. The odds of this occurring with any regularity are infinitesimal, hence the design of experiments. (Recall that there is nothing like a mathematical proof in the physical world -- at a molecular level, some water molecules are moving upstream at any given moment, but by reaching into a stream or tossing some objects into the flow you are taking a large enough sample to determine where most of them are going).

Since you're not going to get proof one way or another, all a well designed and experiment can do is give you evidence. This happens to be more valuable than just about anything else that science has come up with, but it isn't proof.

Which is why the gold standard for a result is replication in a large sample. I could have this very page generated by convolving couple of high entropy random streams. Is it likely to happen repeatedly? Not if the generator is any good. Same principle for randomized trials. You can end up with unbalanced arms (I'm proofing a manuscript where we had exactly this problem). But it's unlikely that they'll be consistently unbalanced across trials with sufficient sample sizes.

Post reply on HN