Live data from Hacker News

A/B test of banner ads vs. traffic

gwern.net

21–30 of 149 posts

Re: A/B test of banner ads vs. traffic

#21
post #3

As someone who has founded and runs an adserver for a living (we deal only with legitimate publications, nothing sketchy), I found this thought provoking. Since I deal mostly in niche/local advertising, I might have a unique perspective. It turns out that the more relatable a banner ad is, the less offended the reader is. That may sound obvious, and it probably is. But the general effect is that users engage with and…

[deleted]

Re: A/B test of banner ads vs. traffic

#22
post #16

I honestly couldn't follow most of the math but found this really interesting. I used to do UX analyses at a marketing agency and would constantly link clients to [1]. Page speed is huge, especially on desktop where its easier to navigate away. OP mentions this, but I imagine the effect is massive on a site where users are actively researching a topic and have tens of tabs open and so can easily switch to a similar w…

I'm aware of those results, but I assumed that they weren't an issue because I was using the best-practices 'async'/background loading AdSense JS snippets. The ads never block the rendering or loading of the rest of the page, they pop in a second or two later.

Re: A/B test of banner ads vs. traffic

#23
What do you think the mechanism is on the connection between ads and pageviews? Or the mechanism for the autocorrelation of pageviews? Have you been able connect the dots on something like sharing to sites like HN?

Re: A/B test of banner ads vs. traffic

#24
post #16

I honestly couldn't follow most of the math but found this really interesting. I used to do UX analyses at a marketing agency and would constantly link clients to [1]. Page speed is huge, especially on desktop where its easier to navigate away. OP mentions this, but I imagine the effect is massive on a site where users are actively researching a topic and have tens of tabs open and so can easily switch to a similar w…

In my experience that kissmetrics blog is a load of nonsense in practice.

We massively reduced load time on the all the key pages from 4 secs to roughly I did a similar thing with their mobile site a year or two later, massively reducing the page-weight and reducing loading times on the devices I tested from seconds to again sub-second load times. Again no discernible bump.

Re: A/B test of banner ads vs. traffic

#25
post #20
post #3

As someone who has founded and runs an adserver for a living (we deal only with legitimate publications, nothing sketchy), I found this thought provoking. Since I deal mostly in niche/local advertising, I might have a unique perspective. It turns out that the more relatable a banner ad is, the less offended the reader is. That may sound obvious, and it probably is. But the general effect is that users engage with and…

This is the biggest problem I have with Adsense. Most of the time it seems like they couldn't find an ad that fits me but their system decided to just throw me a random ad for Forex Trading or whatever. This turns their supposedly sophisticated ad system into a random generator as far as I'm concerned. They could fix this by: 1. Just showing blanks if they can't get something targeted to my preferences 2. Not allowin…

I just wanted to say that it’s actually nice not to be the only one who is harassed by forex trading ads around the web. Them and Mobile Strike are pretty much all of the ads I see. (I do have Adblock but can’t block for YouTube mobile etc.)

Re: A/B test of banner ads vs. traffic

#26
post #3

As someone who has founded and runs an adserver for a living (we deal only with legitimate publications, nothing sketchy), I found this thought provoking. Since I deal mostly in niche/local advertising, I might have a unique perspective. It turns out that the more relatable a banner ad is, the less offended the reader is. That may sound obvious, and it probably is. But the general effect is that users engage with and…

As a user,I am most offended by ads that target me. I would rather see a completely unrelatable ad. It feels like learning new information that way,as opposed to being stalked and preyed upon.

Re: A/B test of banner ads vs. traffic

#27
As always, thanks for the very thorough write up. My immediate thoughts were highlighted in the "Discussion" section. Namely, the demographic of your website might respond more negatively to the presence of ads than the general population. This seems to be substantiated by the unusually high use of ad blockers (~60% vs ~18% [1]).

I also wonder if some of the drop off could be explained by the use of Patreon and ads. For instance, I would never pay for Hulu because they still show ads. Did you receive any Patreon cancellations or negative feedback from pledged users?

[1] US ad block usage as of Feb 2017 https://pagefair.com/blog/2017/adblockreport/

Re: A/B test of banner ads vs. traffic

#28
I don't know how much research has been done on the subject,but personally I don't mind ads in general,I mind ads that target (stalk) me and intrusive ads.

I can tolerate ads that target the page content or random ads just fine.

Re: A/B test of banner ads vs. traffic

#29
I used to roll my eyes every time I saw someone on HN talk about "signal to noise ratio," but I'm getting more and more swayed. Humans deal in abstractions: more clean an abstraction is, the more we can hold onto it.

So when I read a ~10% difference in traffic, I'm not surprised. Art, in absolutely any form, is always about focusing on your theme. And ads, by their very nature, blur that focus.

Re: A/B test of banner ads vs. traffic

#30

As always, thanks for the very thorough write up. My immediate thoughts were highlighted in the "Discussion" section. Namely, the demographic of your website might respond more negatively to the presence of ads than the general population. This seems to be substantiated by the unusually high use of ad blockers (~60% vs ~18% [1]). I also wonder if some of the drop off could be explained by the use of Patreon and ads.…

Patreon-wise, I had ads long predating Patreon, so presumably anyone signing up was already OK with that? I don't remember anyone ever complaining about both ads & Patreon, unless there's a complaint form on Patreon.com I haven't been checking. (Looking at the signup numbers, it goes from $619 for August to $645 for September/October, which at least is in the predicted direction, but too few datapoints to tell since the usual trend is upwards.)
Post reply on HN