Live data from Hacker News

Adversarial Collaboration

edge.org

151–160 of 224 posts

Re: Adversarial Collaboration

#151
> To a good first approximation, people simply don't change their minds about anything that matters.

I love the model of adversarial collaboration, and I don't dispute the extremely strong influence of social bonds on knowledge formation, but Kahneman is just wrong about this. I know he's wrong because I change my mind relatively frequently, about things of at least some consequence.

For a recent example, I was fairly sure that at the beginning of the pandemic, in the US, widespread, cheap testing would enable us to drive COVID cases near zero, and I wasn't shy about telling everyone I met. Obviously, I was wrong, for a variety of reasons - so I updated.

That intimate experience with uncertainty and updating my own beliefs makes me wonder about Kahneman's research methods. It makes me doubt whether this question is even tractable or whether people are even legible enough to researchers to draw conclusions about this.

Interestingly (and disarmingly) Khaneman is very forthright about the role his own experiences have played in convincing him that people in general don't change their minds. He writes:

> I was also impressed by the fact that Anne and I didn't change our minds. I had read Kuhn and Lakatos about the robustness of paradigms, but I didn't expect that minor theories would also be impervious to evidence.

also:

> I will now share a personal experience of belief perseverance that I cannot shake ... However, it turns out that I only changed my mind about the evidence. My view of how the mind works didn't change at all. The evidence is gone, but the beliefs are still standing. Indeed, I cannot think of a single important opinion that I have changed as a result of losing my faith in the studies of behavioral priming, although they seemed quite important to me at the time.

I think the most likely explanation for this is 1) social desirability bias has a dramatic influence on what information people make accessible about their cognition and 2) Kahneman is unusually stubborn, and his generalization from his own personality to all humankind is a manifestation of the typical mind fallacy. [0]

[0] https://www.lesswrong.com/tag/typical-mind-fallacy

Re: Adversarial Collaboration

#152
post #3

One of the most disappointing things that I have learned is that most people hold opinions in order to be part of some group. If someone is a member of a group, it is almost not worth listening to their arguments, especially arguments in support of views held strongly by that group. They are arguing in order to maintain their group membership, not to find the truth. It appears this is true of academic and scientific…

> If someone is a member of a group, it is almost not worth listening to their arguments, especially arguments in support of views held strongly by that group. They are arguing in order to maintain their group membership, not to find the truth. It appears this is true of academic and scientific disciplines as much as anywhere else.

I tend to agree with you, but based on the way you have worded this, I am curious if you think that people have conscious awareness (which is required to form intent) of this?

And as a follow-up: if this phenomenon is sub perceptual, might that change how one might go about addressing it, or even discussing it (it is a fairly common point raised in these sorts of discussions)?

Re: Adversarial Collaboration

#153
post #78

Earlier quoted context omitted.

Those with most priviledge are usually the least aware of it. I've come to realize that "white male software engineer" is one of the groups with the highest ratio of priviledge versus priviledge awareness. (Disclosure: I belong to that group as well.)

This discussion is about ideas (or opinions), not privileges.

You're right, it's about ideas, but the original article handles the interesting case where we fail to form or handle our ideas using "reason."

> The power of reasons is an illusion. The belief will not change when the reasons are defeated.

So privilege plays an interesting role. Unaware privilege - failing to see ones own circumstances, failing to assess how we fit in the world - is almost the same thing as non-reason. I suppose there could be a class of people who are like, "I am totally privileged, and somehow I delude myself and don't notice, but in every OTHER way I am totally reasonable." That could be a subgroup. But probably not a big one?

Re: Adversarial Collaboration

#154
post #67

Earlier quoted context omitted.

If you want a good idea killed, have it presented by the wrong person. We attach an outsized amount of meaning between the two, sometimes so much that we kill the person delivering it.

Sometimes? The easiest way to get killed by people in rage is to tell them the naked truth. That's a hard rule since humanities dawn.

I don't think that is true.

People claiming to be brutally honest, are often far more interested in being brutal than in being honest.

Re: Adversarial Collaboration

#155
post #3

One of the most disappointing things that I have learned is that most people hold opinions in order to be part of some group. If someone is a member of a group, it is almost not worth listening to their arguments, especially arguments in support of views held strongly by that group. They are arguing in order to maintain their group membership, not to find the truth. It appears this is true of academic and scientific…

> It appears this is true of academic and scientific disciplines as much as anywhere else. Sure, of course! That's why "A new scientific truth does not triumph by convincing its opponents and making them see the light, but rather because its opponents eventually die, and a new generation grows up that is familiar with it." And we can be happy with at least that! In anything outside science there is no progress at all…

> We did not manage to solve even one none technical problem since we came down the trees. But that's nothing unexpected actually given we're a horde of apes. I'm old enough to know that nothing will ever change as we had already more than enough time to easily mange at least some "humanity scale" issues by now. But we as a species are seemingly bound to our ape nature.

Counter-example: The use of slavery as an energy source replaced by the use of electricity as an energy source.

When you want to listen to music, you open up Youtube (or Spotify, or your carefully curated collection of FLAC files, or whatever) and press play.

When Romans wanted to listen to music, they would tell the slaves to pick up the instrument and start playing.

That's a significant change, IMO.

EDIT: also, written language went from non-existant to 8 billion humans and 86% of them can read in a few thousand years.

Re: Adversarial Collaboration

#156
I'm not sure what he means by the naive scientific method. It has always been a fundamentally adversarial process, nothing new is being discovered here.

The scientific method as it has always existed requires two heuristics from you, the scientist: a hypothesis generator, a test generator (and an all important simplicity measure). The point of the method is that by making these things work adversarially, we can turn our very messy, fallible creativity, ie these heuristics, into facts about what the model isn't. Moreover no additional hypothesis of what the model is, or test which contradicts it, can derive a false fact of this form, relegating the entire concept of adversary to the meta who-gets-their-name-on-the-paper game.

If Daniel has only recently started "using science adversarially", then he has only recently started doing science.

Re: Adversarial Collaboration

#157

Earlier quoted context omitted.

I got a good laugh from your comment here. Imagine it from my perspective. Someone (you) is suggesting they search for a ToE in their spare time, and they’re labeling someone else as clearly crazy . ;) All in good fun. I greatly enjoy the sentiment of your comment and it’s parent that great ideas can come from anywhere. At the risk of creating a segue into controversial topics, I think this plays a huge part of why i…

An analogy is that one can walk in the right direction for an awfully long way before getting stuck at the end of a valley, staring up a proverbial cliff. Someone walking parallel to you on a ridge might be nearby the whole time, but avoid being stuck.[1] Anyone studying AI/ML would know about getting stuck in local minima, and having to essentially restart training to shake things loose. Same thing. My theory is tha…

> My theory is that physics is stuck in a local minima where it's not sufficient to change just one, or even two or three fundamental things to get unstuck. That's too big a leap via traditional incremental publishing of new theories. Any one change to the status quo won't work, and is rejected.

Makes me think of Stephen Wolframs current work. Guy's a genius, who's current stuff kind of reads like he's a crank. But at the same time I'm kind of rooting for a revolutionary paradigm that's gonna totally upend things.

Re: Adversarial Collaboration

#158
post #3

One of the most disappointing things that I have learned is that most people hold opinions in order to be part of some group. If someone is a member of a group, it is almost not worth listening to their arguments, especially arguments in support of views held strongly by that group. They are arguing in order to maintain their group membership, not to find the truth. It appears this is true of academic and scientific…

What do you think of the wisdom of the great Groucho Marx: I wouldn't be a member of any group that would have me as a member.

i thought that was bertrand russell...

Re: Adversarial Collaboration

#159
post #79

Earlier quoted context omitted.

My hobby is to look for a physics theory of everything (ToE). I have virtually no chance at succeeding at this, but it's fun reading through random junk on ArXiV. I noticed something similar: You can find papers by clearly crazy people that have nuggets of good ideas in them. Odd bits of mathematics they reference might be an interesting rabbithole to go down, even if it ultimately leads nowhere. The whole thing remi…

Have you taken a look at Wolframs ToE? I found it pretty intriguing.

Crazy -- just brought up Wolfram in response to a sibling comment before I saw this. Happy to see I'm not the only one.

Re: Adversarial Collaboration

#160

> To a good first approximation, people simply don't change their minds about anything that matters. I love the model of adversarial collaboration, and I don't dispute the extremely strong influence of social bonds on knowledge formation, but Kahneman is just wrong about this. I know he's wrong because I change my mind relatively frequently, about things of at least some consequence. For a recent example, I was fairl…

That's a recent example of something that you came to quickly (obviously, covid didn't exist before) and so you were relatively easily able to get back out of it.

As an approximation, it works insanely well. And as more and more things becomes "proxies for political decisions" we'll see it ramp up even more.

Post reply on HN