How long do I run an experiment for?

#1

Post by hganesan » Mon, Sep 08, 2014, 2:44 AM UTC

I'm always reading about "failing fast" and validating an idea, but I can't wrap my mind around how long it takes to validate a concept.

It seems like most startup post-mortems include an element of "incorrect validation" or not asking the right question or not asking that question for long enough.

Are there any good mental frameworks to read about picking the length of a study/experiment?

Re: How long do I run an experiment for?

#2

Post by anthony_franco » Mon, Sep 08, 2014, 4:35 AM UTC

A great, actionable guide I'd recommend is the book Running Lean.

But knowing is half the battle. By this point everyone should know about Lean Startup and Customer Development. The true test is having the discipline to apply the principles rigorously and not cut any corners. That's where most entrepreneurs stumble, I think.

Re: How long do I run an experiment for?

#3

Post by Ryel » Mon, Sep 08, 2014, 5:01 AM UTC

Test the idea until you either find a result (good idea or bad) or you stress your limits (financial/emotional).

Re: How long do I run an experiment for?

#4

Post by Animats » Mon, Sep 08, 2014, 6:39 AM UTC

Read "Why Experiments End", which addresses exactly this question.

Re: How long do I run an experiment for?

#5

Post by hganesan » Mon, Sep 08, 2014, 5:27 PM UTC

Animats wrote: post #4

Read "Why Experiments End", which addresses exactly this question.

Did you mean "How Experiments End" by Peter Galison? It looks perfect for helping answer this question.