Live data from Hacker News

No evidence for nudging after adjusting for publication bias

pnas.org

171–180 of 246 posts

Re: No evidence for nudging after adjusting for publication bias

#171

Earlier quoted context omitted.

> results that speak for themselves. This is exactly how a midwife explained to me why she uses magic crystals. She told me that there's science, and there's results, and that she's seen the crystals work.

Obviously they don't work by magical vibration, but are you sure they don't work at all? If the midwife feels and acts more confident from having that tool or the mother feels more relaxed because she thinks they will make the process easier, then the crystals do, in fact, work. They just don't work through the mechanism those individuals think they do.

[deleted]

Re: No evidence for nudging after adjusting for publication bias

#172
post #123

Earlier quoted context omitted.

> results that speak for themselves. This is exactly how a midwife explained to me why she uses magic crystals. She told me that there's science, and there's results, and that she's seen the crystals work.

I mean, yeah, if she has solid RCT data on thousands to millions of childbirths and has found a statistically significant impact from using the magic crystals, I would support their use. A/B as well as scientific research uses the same basis. The issue is that in fact the midwife will not have such data. The comparison being made is that A/B testing, if run competently, is pretty close to scientific research, in part…

The OP was referring to A/B tests that were "perhaps not up to the standard of science", not ones that were already science.

Re: No evidence for nudging after adjusting for publication bias

#173

Earlier quoted context omitted.

Isn't this just one specific analysis using a very narrow definition of "nudge", one that doesn't even begin to encompass the work being done at those "300 "research" departments"? Further, isn't this using the same data from the original meta analysis that did find "of small to medium size" effect[0]? Why would this, alone, undo decades of research and clear, bright-line conclusions such as the ones cited in my sibl…

I think social scientists have lost the right to the benefit of the doubt. They don't preregister their trials. They don't publish their negative results. They're notoriously bad at statistics, notoriously let their political beliefs distort their conclusions, notoriously scatter their work over thousands of arbitrary, hard-to-compare small-sample-size studies instead of concentrating their resources. I don't think i…

> I don't think it matters if this criticism is right or not.

Okay, you and I care about very different things.

Re: No evidence for nudging after adjusting for publication bias

#174

Whether 'nudging' works or not, the concept is unacceptable to me. First, the term 'nudging' is a misnomer. Let's call it what it is - manipulation. Manipulating the options or defaults to some other set in order to achieve a better outcome for someone... Well, who is that someone? The government? Who says that their values align with mine? I wouldn't have responded as the government did to the pandemic, but their nu…

Your vote says their values align with yours, or at least most people's. Governments have to do things all the time that step on a few toes for the overall good.

What about all other public health campaigns? Drink driving, cancer screening, anti-smoking? Not everyone will want what they're pushing but we mostly agree that's a good thing for people, and that's why we let the government promote those things.

Re: No evidence for nudging after adjusting for publication bias

#175

Earlier quoted context omitted.

If defaults don't work then Google wasted 15 billion dollars last year paying Apple to be in the search bar... I guess there must be further detail in the paper and I will have to read it to understand the nuance.

Defaults very clearly work in matters such as consent to organ donation. In countries where you need to opt out of organ donation, few people bother to do so. Another question is whether this increases the total amount of successful donations. I was looking around for studies and found this one [1], which basically says "in some countries, yes". [1] https://behavioralpolicy.org/wp-content/uploads/2020/01/Does...

There is also some research suggesting that defaults in organ donation (so called presumed consent) may decrease rates of actual donations in those countries. I can't find the original podcast where I heard about it (I assume related to either Planet Money or Freakonomics), but found this source:

https://blogs.bmj.com/medical-ethics/2017/09/25/organ-donati...

Re: No evidence for nudging after adjusting for publication bias

#176
post #11

No evidence for nudging =/= nudging doesn't exist. I'm fairly sure anyone who has done A/B testing at scale has plenty of evidence that nudging works. Perhaps not up to the standard of science, but there are literally people who manipulate choice architecture for a living and I'm fairly convinced a lot of that stuff actually works.

"We studied X extensively and there is no evidence that it works" is a textbook example of how scientists say "X doesn't work".

Except the article is more specific and has way more details than that.

Re: No evidence for nudging after adjusting for publication bias

#177

Earlier quoted context omitted.

I think social scientists have lost the right to the benefit of the doubt. They don't preregister their trials. They don't publish their negative results. They're notoriously bad at statistics, notoriously let their political beliefs distort their conclusions, notoriously scatter their work over thousands of arbitrary, hard-to-compare small-sample-size studies instead of concentrating their resources. I don't think i…

> I don't think it matters if this criticism is right or not. Okay, you and I care about very different things.

>> I don't think it matters if this criticism is right or not.

> Okay, you and I care about very different things.

Clearly it is being suggested that it doesn't matter with respect to the social studies departments being in dire need of drastic reform. If you don't care about that either direction why are you commenting on this thread? You do actually care one way and you're "point scoring" to further the argument? Something else? I'm misreading something that I think I'm reading clearly?

Re: No evidence for nudging after adjusting for publication bias

#178

Earlier quoted context omitted.

This seems to be the standard response to anything that seeks to debunk nudge. Any time you say ‘This example of a nudge doesn’t work / isn’t replicable / isn’t actually socially helpful’ someone will say ‘Ah but that’s not really nudge tactics.’

No true Scotsman.

Also the other way will come up in these kinds of "arguments" without doubt.

"How can these horrible critics say nudges don't work? Have they never been nudged with a loaded revolver? Can they not imagine that working?"

Leaving those of us who don't follow the controversy closely in the field and are interested in what has actually been found out and understood about the world with some degree of confidence across many fields of study, leaves us scratching our heads unable to see through the viewing window for all the mud getting flung.

Re: No evidence for nudging after adjusting for publication bias

#179
post #7

Remember, Obama appointed a regulatory czar based on this science: https://www.nytimes.com/2010/05/16/magazine/16Sunstein-t.htm...

Obama would have appointed Sunstein no matter what book he wrote, because he was one of UChicago's superstar professors (and was at the same time being aggressively courted by schools around the country; he ended up, of course, at Harvard). His appointment was notable not so much for "nudges" as for the fact that Sunstein was probably one of the most conservative appointments Obama made.

Possibly. I recall nudges being a major talking point during the appointment: https://www.politico.com/agenda/story/2015/10/obamas-effort-....

Re: No evidence for nudging after adjusting for publication bias

#180

Earlier quoted context omitted.

In the example you cited I don't think that's a nudge? Or is it? I ask because I am sure that changing defaults DEFINITELY works, especially if the user does not have a strong existing preference. You're not really changing user behaviour most of the time, you're changing the outcome of what they're trying to do, which is to reduce their cognitive load by ignoring as much as they possibly can.

Some other poster posted that they must have a pretty specific definition of nudge, because it defies credulity that defaults don’t change outcome if only because half the time I don’t read the defaults or know where to find them. I mean I just found out two weeks ago you could change the hacker news banner color. Are you telling me I’m in a statistically insignia can’t minority of hacker news users? Also how many se…

I'm not sure it is useful to lump nudging on decisions users don't want to or don't know how to make in with nudging on decisions users either want to or have to make.

It's a no brainer that defaults will alter outcomes for users who aren't willing or capable of making a selection for the choice in question.

Post reply on HN