Live data from Hacker News

“Scientific Method for Startups”, and AMA with Michael Seibel

blog.ycombinator.com

21–30 of 50 posts

Re: “Scientific Method for Startups”, and AMA with Michael Seibel

#21
post #18

This was a better article than I expected. Finding ways to measure your assumptions is great, because if you can measure the behavior, you can measure the impact of changes. Generally, I'm not a fan of "scientific method" as a phrase. It's too often used by people dismissing intuition in a very non-scientific way.

Thanks - I agree that balance is really important. Also, in many cases - especially where the founder is a user - intuition can be a key early driver of success.

Re: “Scientific Method for Startups”, and AMA with Michael Seibel

#22
post #20
post #2

I always love the debate on whether great products are imagined or are discovered through experimentation (certainly a bit of both). This post details the advice I usually give to startups on this topic and I'm happy to answer questions and join the discussion.

In the creativity bucket, there's also a fair amount of inspiration from: 1. Studying other products and reasoning about them. 2. Conceptually dissecting multiple existing products and looking at different combinations of some subset of their components. Any thoughts? PS: Loved your essay

Yes, one of our YC partner Dalton Caldwell hammered this idea in my mind. He told me that when he sees a founder trying to attack a product that other have either failed or succeeded at - he looks for what they've learned from those folks. If the founder dismisses previous attempts to solve this problem or similar ones - that is a very bad sign.

Re: “Scientific Method for Startups”, and AMA with Michael Seibel

#23
post #11

Hey Michael, apart from custom internal analytics tools and solutions similar to GA which other tools would you suggest using?

I always loved Mixpanel - but its been a couple years since I've been active on the product side and there are now tons of great tools. In the end of the day - use the events based analytics product that your team will enjoy looking at everyday.

Re: “Scientific Method for Startups”, and AMA with Michael Seibel

#24

Michael, How much racism have you faced in Silicon Valley? Do you ever face racism from companies going through the YC program?

In operating my startup or working at YC I haven't faced any overt racism (in the real world just living life that is a different story). Have I faced any covert racism? - very hard for me to tell because so much of startups is facing failure and there are often many probable causes of that failure. Not sure what you mean by the second question.

Re: “Scientific Method for Startups”, and AMA with Michael Seibel

#25
post #18

This was a better article than I expected. Finding ways to measure your assumptions is great, because if you can measure the behavior, you can measure the impact of changes. Generally, I'm not a fan of "scientific method" as a phrase. It's too often used by people dismissing intuition in a very non-scientific way.

Thanks - I agree that balance is really important. Also, in many cases - especially where the founder is a user - intuition can be a key early driver of success.

Absolutely agree. I'm a "scratching my own itch" founder, and building a product based on years of doing the job of my target users. "Scientific method" isn't terribly useful for me as I build the initial product.

On the other hand, I don't necessarily know what this technology is going to mean to end users. They're going to find problems to solve that I didn't even imagine. As we're closing in on a beta, I'm doing demo/interviews as often as I can (a couple of times a week at this point), and seeing where their minds run. As William Gibson said, the street finds its own uses for things.

Once we get the product in the hands of real customers, it'll be far easier to start taking measurements and figuring out what to work on from there. But for now, intuition is the only tool I have.

Re: “Scientific Method for Startups”, and AMA with Michael Seibel

#26

Hi Michael, how does one conduct customer research? What questions do you ask? How do you know you're doing it right? Are there any good books on customer research?

Different answer depending on whether you have a product built or not. Also different if you have a consumer product. My best personal experience with customer research is for live consumer products. In that case we would recruit potential customers off of craigslist (offering $50 for an hour of their time). We would bring them into the office and sit them at the table. The entire team (small) would be in the room. We would give them a scenario and ask them to complete a task in our app in front of us. For example, you saw a really good video on Facebook made with this app and now you want to download that same app and make a video for yourself. Then we would ask them to complete that task asking us any questions they had and sharing their inner monolog out loud. Some questions we would answer but most we would ask them to figure it out. It was very important that everyone involved with building and designing the product was in the room experiencing the user test live. We would take notes on issues the customer faced and conduct about 5 interviews in an afternoon. Anything that came up 4-5 times we would attempt to fix. We would rince and repeat monthly.

Re: “Scientific Method for Startups”, and AMA with Michael Seibel

#27
post #25

Earlier quoted context omitted.

Thanks - I agree that balance is really important. Also, in many cases - especially where the founder is a user - intuition can be a key early driver of success.

Absolutely agree. I'm a "scratching my own itch" founder, and building a product based on years of doing the job of my target users. "Scientific method" isn't terribly useful for me as I build the initial product. On the other hand, I don't necessarily know what this technology is going to mean to end users. They're going to find problems to solve that I didn't even imagine. As we're closing in on a beta, I'm doing d…

This is one of the reasons why YC pushes people to launch MVPs so quickly - the speed of learning is much faster when the product is in customer's hands.

Re: “Scientific Method for Startups”, and AMA with Michael Seibel

#28
post #6

What are some best practices for evaluating ideas before building anything. You mentioned talking to users which is good advice but assumes that an industry has been identified already.

The first thing I ask a founder is how often does the target customer have the problem they are looking to solve and how much money are they willing to spend to solve it. The more often the customer has your problem and the more money they are willing to spend - the easier it will be (all other things being held equal) to get customers and iterate. Sequoia calls these problems hair on fire problems. The second thing I ask is who else is trying to solve the same problem and what do you know that they don't.

Re: “Scientific Method for Startups”, and AMA with Michael Seibel

#29
post #14

Earlier quoted context omitted.

Sure, it does! I just added it to register that is weird to publish as an AMA and not answer many questions. I think your approach is right. One thing that helps me is to use hypothesis from users/visitors/customer as much as possible. Talk to customers and try to distill what are their hypothesis about a specific problem. Talking to customer goes a long way. On the topic, I think that famous quote atributed to Ford…

Its funny - I think the Ford quote is right. I always tell folks to not ask a customer what they want but ask them what their problem is. Its the customer task to describe and demonstrate their problem - its the founder's task to think up and test solutions for that problem.

Thanks for answering below!

About the quote, it kinds of depends on what do you mean by "want", but I understand and agree of your approach (while still disagreeing with the quote if that is possible).

BTW the quote is probably bogus, as the first Ford cars were slower than horses. 45km/h vs 88km/h (world record)

https://en.wikipedia.org/wiki/Ford_Model_A_(1903%E2%80%9304) https://en.wikipedia.org/wiki/Horse_gait

Post reply on HN