A/B testing considered Bullshit

Author here: the title might seem like a clickbait, but we've seen it's accurate. Another option is "harmful". Correct answer is that it depends depending on how the testing tool is used:

1. If used correctly -> "harmful" (months of waiting without touching the site)

2. If not (like in most cases) -> "bullshit" (results are random)