Live data from Hacker News

Show HN: ABBA - Beautiful, open-source A/B test calculator

thumbtack.com

1–8 of 8 posts

Re: Show HN: ABBA - Beautiful, open-source A/B test calculator

#4
post #2

Mixpanel also has an A/B split testing calculator: https://mixpanel.com/labs/split-test-calculator

Theirs has a nice, simple presentation which makes it very easy to use, especially for casual users. But it includes much less information (no confidence intervals and p-values are only approximate), uses much simpler statistics (z-test with no multiple testing correction can result in highly overconfident results), and doesn't describe what underlying statistics it uses. Although not as immediately accessible, I think Abba has much more to offer to anyone who's serious about A/B testing.

Re: Show HN: ABBA - Beautiful, open-source A/B test calculator

#6
Great explanations. For people, who prefer excel we have a calculator as an excel sheet: http://visualwebsiteoptimizer.com/split-testing-blog/ab-test...

We also have a blog post that explains mathematics of A/B testing: http://visualwebsiteoptimizer.com/split-testing-blog/ab-test...