Live data from Hacker News

Vertical vs. grid product listings - a surprising AB test

westiseast.co.uk

1–10 of 58 posts

Re: Vertical vs. grid product listings - a surprising AB test

#3
post #2

It's a bit hard to assess the significance of this. Sample size isn't even given. 40 people went through this test, or 4 million?

sorry, yes you're right. The sample size was not huge (@500 people viewed each variant) although the result was statistically significant. I just added a note to the post about this. My aim is to repeat the test at a later date to see if the results repeat themselves.

Re: Vertical vs. grid product listings - a surprising AB test

#5
post #4

Not surprising at all. Conventional layout wisdom says give the eye a clear path in a direction it knows. A multi-dimensional grid takes you in a Z shape, whereas a vertical lineup's images and text are all aligned and easier to distinguish.

I guess it was surprising for a bozo like me :)

I think I'd overestimated "pretty" and underestimated "functional" in this case, so the results were a wakeup.

Re: Vertical vs. grid product listings - a surprising AB test

#7
one of these listing styles performed 15% better than the other in generating clicks on actual products. One of them results in 40% click through, while the other one generates only a quarter

That isn't 15% better. That's a 60% increase in click-through rate. That's massive.

We had already planned to remove a grid display from our app and replace it with a linear flow, but this seals the deal. Thanks!

Re: Vertical vs. grid product listings - a surprising AB test

#8

one of these listing styles performed 15% better than the other in generating clicks on actual products. One of them results in 40% click through, while the other one generates only a quarter That isn't 15% better. That's a 60% increase in click-through rate. That's massive. We had already planned to remove a grid display from our app and replace it with a linear flow, but this seals the deal. Thanks!

why not AB test yours and share the results? My results are accurate and significant (statistically) but I don't know under what circumstances they are transferable. I have a hunch that I get these results because it's a small inventory of products, but with a large inventory, maybe it works differently.

Re: Vertical vs. grid product listings - a surprising AB test

#10
post #2

It's a bit hard to assess the significance of this. Sample size isn't even given. 40 people went through this test, or 4 million?

sorry, yes you're right. The sample size was not huge (@500 people viewed each variant) although the result was statistically significant. I just added a note to the post about this. My aim is to repeat the test at a later date to see if the results repeat themselves.

Correct me if I am wrong, but isn't statistical significance a function of sample size?
Post reply on HN