I honestly couldn't follow most of the math but found this really interesting. I used to do UX analyses at a marketing agency and would constantly link clients to [1]. Page speed is huge, especially on desktop where its easier to navigate away. OP mentions this, but I imagine the effect is massive on a site where users are actively researching a topic and have tens of tabs open and so can easily switch to a similar w…
In my experience that kissmetrics blog is a load of nonsense in practice. We massively reduced load time on the all the key pages from 4 secs to roughly I did a similar thing with their mobile site a year or two later, massively reducing the page-weight and reducing loading times on the devices I tested from seconds to again sub-second load times. Again no discernible bump.
A/B test of banner ads vs. traffic
41–50 of 149 posts
Re: A/B test of banner ads vs. traffic
#42Earlier quoted context omitted.
The other option is to target the ads to the publication . As long as the publication is on a niche topic or geographically localized, you can choose ads that will likely interest people (local restaurants) without needing to track them. Tracking is only necessary when the ad venue is incredibly broad across topics and geography.
I have been wondering why that isn't done more often myself. I mean,it isn't like tv ads didn't work.
Tracking and microtargeting just seem too attractive for advertisers to pass up. Same goes for large size, autoplay, multimedia ads.
These mechanisms would have to fail to perform in obvious ways (not long-term, subtle, whole-market ways) before people will stop using them.
Re: A/B test of banner ads vs. traffic
#43Re: A/B test of banner ads vs. traffic
#441. Banners hurt unless they are relevant
2. Filtering for banners that are relevant tends to reduce revenue rather than increase as there is a smaller pool of highly relevant advertisers
3. Removing all banner adverts significantly increased engagement by every metric
4. Some revenue is possible using affiliate links within the content (re-writing existing links rather than inserting awful links on a word match basis)
That last one is what I now do. Is it as profitable as running banners everywhere? No. But it is the highest possible engagement with some revenue, and if one focuses energy on reducing costs instead it can work well.
Re: A/B test of banner ads vs. traffic
#45There are ways to have comments that are a lot less awful than Disqus.
Re: A/B test of banner ads vs. traffic
#46Unless I misread this it sounds like the assignment is on 2 day chunks rather than some unique user ID. Just doing this at impression rather than user level makes me question the applicability of the results, but really interesting read nonetheless.
Per-user level doesn't capture the effects I am interested in. Imagine you click on a website and the banner ad makes you subconciously less happy and so you don't submit it to HN for thousands of other users to read; how would randomizing on you and thousands of others' user IDs help? There's no way to link your user ID's randomization to the subsequent visits (or non-visits) of thousands of other people; it just av…
Re: A/B test of banner ads vs. traffic
#47How does this experiment methodology account for cross device mixed experience? Because of the multiple devices use, There will be lot of users that have seen both variation.
Re: A/B test of banner ads vs. traffic
#48Earlier quoted context omitted.
Good question. Even if it does not load, it should still show the adsense code in the html. But looking at some random post, I don't see it: http://web.archive.org/web/20150304235943/http://www.gwern.n... Adsense is usually a script loaded from googlesyndication.com which is not in the source here. Maybe archive.org rewrote the html so much that it is not there anymore?
After a few moments of searching I'm going to assume that whoever specifically scraped and uploaded the page may have removed the adsense javascript. Doesn't look to be a normal archive.org thing.
I checked some other site and the Adsense code is not changed by archive.org. So something is strange.
Maybe Gwern experimented with different types of ads and on that page at that time did not use adsense?
I do see the adsense code in a snapshot from a year later:
http://web.archive.org/web/20160629230243/https://www.gwern....
Re: A/B test of banner ads vs. traffic
#49There are myriad contributing factors that I can't isolate out. People don't like ads, but many of the people who loudly complain about ads will also very aggressively tell you that they will not tip, will not be a Patreon supporter and expect high quality content for free. They will aggressively say that your business model is your problem, not theirs, while actively shooting down any way to monetize content.
These are often people who make good money as, for example, programmers. Another thing such people have told me is to get a real job, like they have, and write for free. It is a kind of classism in a sense: Writers who provide good quality web content aren't seen as valuable or serious contributors the way programmers are. Yet, at the same time, people decry both the lack of good content and the trend towards content done as content marketing.
I get paid to write content done as content marketing. I rarely write anything I feel bad about. I work on projects I can believe in. But I find it frustrating because I would rather spend more of my time producing high quality, independent content for my own projects. These are projects intended to put out useful information and/or to be entertaining.
I am doing some unique things that add value to the world. I run a homeless site with useful information for homeless Americans. Most homeless services have terrible websites. They are almost always donor facing, not client facing. It is very challenging for a homeless person to find useful information online. I had a college class on internet search and I had a hard time finding information I needed.
The other thing is that a lot of homeless services are a very negative experience and can help keep you trapped. Services are often designed with the idea that homeless people are incompetent losers who can't be trusted to make good decisions. They often come with strings attached that can help keep a person trapped in poverty.
I want to promote market based solutions that can work for homeless individuals, but can lead to a future because they continue to be viable after you get off the street. Programs to help the homeless or help poor people often actively encourage failure.
I think I have worked out a couple of models that work, but I am not finding a path forward. I continually come up against the idea that I should just stop caring about marginalized people because there is no money in it. I should just go where the money is, and never mind that the world is going to hell.
And I can't quite bring myself to do that because there is scary stuff happening and I feel like if I don't do something, no one will. Because rich people aren't going to solve it. The attitudes of so many of them that poor people just need a handout (UBI), not earning opportunities, is part of the problem.
We have the technology to allow people with disabilities, like me and my sons, to work in a way that works for us. But I don't know how to overcome the attitudes that we shouldn't bother to try, we should just accept that we are losers unworthy of any respect.
The inability to get taken seriously is a big barrier to getting engagement and traction and that is a big barrier to turning it into money. The whole thing makes me crazy. It is a case of the key is in the safe.
Re: A/B test of banner ads vs. traffic
#50Earlier quoted context omitted.
As a user,I am most offended by ads that target me. I would rather see a completely unrelatable ad. It feels like learning new information that way,as opposed to being stalked and preyed upon.
The other option is to target the ads to the publication . As long as the publication is on a niche topic or geographically localized, you can choose ads that will likely interest people (local restaurants) without needing to track them. Tracking is only necessary when the ad venue is incredibly broad across topics and geography.
New media just outsources all the hard work to Google and other big ad placers. Easier but you lose editorial control over your work.