Live data from Hacker News

The danger of the mediocre success when testing startup hypotheses (2023)

pivotal.substack.com

11–20 of 88 posts

Re: The danger of the mediocre success when testing startup hypotheses (2023)

#11
I worked in a SaaS company selling an A/B Testing app where I saw a lot of tests and their outcomes from different clients.

Of course there are the low hanging fruits, which scored the clear success. Most of the tests although were not a clear success, but just a slightly better conversion rate.

Multiple tests applied after each other slowly increased the overall value. If taken the advice not to implement the changes of the small success, the overall amount would not have changed.

Re: The danger of the mediocre success when testing startup hypotheses (2023)

#12

> One of the wisest and most important pieces of advice I received as a startup founder was this: “The worst outcome is a mediocre success”. …in a zero interest rate environment where there is a bunch of money sloshing around looking to roll the dice multiple times.

Yes, this is not good advice at all. Stumbling into an honest living is somehow a terrible thing?

Re: The danger of the mediocre success when testing startup hypotheses (2023)

#14

> make sure that there’s a well-defined distinction between success and failure. Don't fall in the messy middle. I agree this is the right thing to do, but it isn’t always possible to do for a given experiment. For instance, with the cold-calling example, how do you ensure that it’s either a smashing success or definite failure a-priori? Is there a principled way to choose the threshold number of conversions? Do you…

I've built a few sales team for early stage startups, and invariably the question comes up: "Inbound sales is working. Will outbound sales work?"

The successful experiments I've seen look like this: hire 2 SDRs at the time, focus them exclusively on outbound, then measure their results to identify the CAC. Then, you can make a call if that CAC is something you want to scale.

The failed experiments look like this: the founder doesn't want to invest too heavily in something that might not pay off, so we hire 1 SDR and they have to commit 50% of their time to following up on low quality Marketing leads.

It's not so much about the number itself, but more about the experiment design that will give you clear results

Re: The danger of the mediocre success when testing startup hypotheses (2023)

#15

> One of the wisest and most important pieces of advice I received as a startup founder was this: “The worst outcome is a mediocre success”. …in a zero interest rate environment where there is a bunch of money sloshing around looking to roll the dice multiple times.

The economics of venture capital is that mediocrity gives a near zero return, and thus should go to zero as an investment

What if you're bootstrapped and are just trying to make an honest living instead of playing the VC casino?

Re: The danger of the mediocre success when testing startup hypotheses (2023)

#16
Competitive sports isn't for everybody, regardless of your ability to work hard. If you aren't built for it, you're going to be a failure or a mediocre success. Entrepreneurship isn't for everyone either.

Silicon Valley normalized the idea that if you follow the scientific process (The Lean Method, finding Product/Market Fit or whatever this garbage is known in the latest terminology), and burn out for 10 years of your life, then you WILL achieve success. Most people are blind to survivorship bias even if they know the phenomenon. On top of it, incompetent, scumbag VCs muddy the waters with their snake oil "wisdom" which bright eyed, impressionable tech bros gulp down with passion.

If you achieve a "mediocre" success, which allows you financial independence, then you HAVE achieved success, regardless of what the VCs are pontificating. They'd scream because their investment didn't 1000x. Fuck them and continue living your life. Don't burn out for these soul-less MBAs.

And say you achieve the outsized "success". What then? If you go with the history of silicon valley then your so-called success is going to be a shit deal for workers, consumers and the environment.

Re: The danger of the mediocre success when testing startup hypotheses (2023)

#17

Earlier quoted context omitted.

The economics of venture capital is that mediocrity gives a near zero return, and thus should go to zero as an investment

What if you're bootstrapped and are just trying to make an honest living instead of playing the VC casino?

then congratulations, you have escaped the matrix

Re: The danger of the mediocre success when testing startup hypotheses (2023)

#18
Clickbait, deceptive title.

What the author means is ‘get real about continuous learning’

Of course it takes money to run experiments you can actually learn from, and the article is bereft of practical advice about doing this on the cheap.

However, I clicked. But you don’t have to.

Re: The danger of the mediocre success when testing startup hypotheses (2023)

#20
“Mediocre success”, as described by the author, is how great science starts out. You try an experiment, (eventually) get a slight indication that your hypothesis might be valid, and then keep iterating until it seems clear that the idea is real (or not).

Startup companies generally shouldn’t do science, but that same interactive process should guide you. Because when you start you never know enough.

Post reply on HN