Live data from Hacker News

Optimizely (YC W10) Increases Homepage Conversion Rate by 29%

blog.optimizely.com

11–20 of 49 posts

Re: Optimizely (YC W10) Increases Homepage Conversion Rate by 29%

#11

How does Optimizely compare with Visual Website Optimizer?

VWO is a great product but here are some of the unique benefits of using Optimizely:

First is ease-of-use and simplicity: we hope Optimizely is a product anyone can use, not just IT or engineers. Paras Chopra, the creator of VWO recently said on Quora: "Optimizely is a great tool and perhaps even bit easier than VWO, so I would recommend you to signup for a free trial of both the products and see which one is suited best to your needs."

Secondly, we enable power-users: all of the changes you make in Optimizely can be transformed into JavaScript statements that correspond to those changes. We enable you to see the JavaScript that gets generated and even edit it or write your own if you want to create sophisticated transformations of your page (click the "Edit Code" button in the bottom-right corner in the editor).

Third, we enable you to track any numbers of goals, even if you decide you want to measure a goal AFTER you've started your experiment. You can track any pageview, JavaScript event, or custom event and match these goals exactly, using a substring or regular expression. We keep all of the data you've sent us so you can always add and remove goals even if the experiment is still running. This gives you the flexibility and power to measure any goal you have on your website in real-time.

In addition to these three we are also unique in offering automated cross-browser testing, behavioral targeting, undo/redo, and unlimited simultaneous experiments.

Re: Optimizely (YC W10) Increases Homepage Conversion Rate by 29%

#12
I wish I could apply Optimizely AB Tests in everything I do. Like measuring the best way to word movie choices so that the one you secretly want gets chosen (conversion)!

Anyway, interesting statistics. Larger sample size I think would definitely be more dramatic.

Re: Optimizely (YC W10) Increases Homepage Conversion Rate by 29%

#15
post #7

Earlier quoted context omitted.

Great point, the goal we talk about in this blog post is the number of people who click that button. One nice feature of Optimizely is that we can test as many goals as we like-- you can add goals even after the experiment has started running and we retroactively measure the conversion rate! After I read your comment I went in and added a goal to see whether there was a change in the number of people who ended up sta…

I'm curious how far you're able to follow them down the funnel (e.g. conversions from that free trial to paying member? or effect on the cancel rate of those members?). I ask because I've been looking at Hubspot, and find their ability to connect the lead gen into the CRM a big selling point (I guess they call this "lead nurturing"). Are you focusing narrowly on the lead gen half of it?

Hi Josh,

Yup, you can track as far down the funnel as you like. Here is an article in our knowledge base that explains how you can do this: http://support.optimizely.com/kb/goal-tracking-and-reporting...

Let me know what you think!

Re: Optimizely (YC W10) Increases Homepage Conversion Rate by 29%

#16
That "Enter Your website URL" field is really annoying. The easiest way to change the default "http://www.example.com to your website's URL would normally be to double click the "example" and type your address, leaving the boilerplate "http://www. and ".com" and such.

But you can't do that due to the fancy javascript and everything. Have to type the whole thing yourself.

If the field cleared when you gave it focus, it wouldn't really matter and I'd just type in the URL myself. But the text remains, in the background, taunting you. It even appears to highlight the "example" part if you double click it.

Re: Optimizely (YC W10) Increases Homepage Conversion Rate by 29%

#17

Earlier quoted context omitted.

I'm curious how far you're able to follow them down the funnel (e.g. conversions from that free trial to paying member? or effect on the cancel rate of those members?). I ask because I've been looking at Hubspot, and find their ability to connect the lead gen into the CRM a big selling point (I guess they call this "lead nurturing"). Are you focusing narrowly on the lead gen half of it?

Hi Josh, Yup, you can track as far down the funnel as you like. Here is an article in our knowledge base that explains how you can do this: http://support.optimizely.com/kb/goal-tracking-and-reporting... Let me know what you think!

Josh -

I think tools like Optimizely can track to the final sale if you have an online (ecommerce only) transaction. This works well when the user is expected to complete the transaction online and without changing computers or deleting their cookies during the consideration process.

If you have an offline sales process (where a salesperson takes an order in person or on the phone) or customers who pay by invoice, or a longer and more considered sales process (bigger ticket items), you need a closed loop marketing tool that connects your marketign leads database to the CRM that the sales team is using. HubSpot does this, and connects to Salesforce.com, NetSuite, Highrise, Sugar CRM, Microsoft Dynamics, ACT, Goldmine, or pretty much any CRM.

So, Optimizely for small ticket / ecommerce, and HubSpot for large ticket / offline sales.

Thanks, Mike Volpe (CMO @ HubSpot)

Re: Optimizely (YC W10) Increases Homepage Conversion Rate by 29%

#18

How do you know AB test works if you aren't testing with the same user?

A/B testing works by randomly distributing your traffic. We can't assume that every person is the same, but by splitting the traffic randomly we can assume that the two groups are similar.

For a little bit more information on how our particular flavor of AB testing works check out http://optimizely.appspot.com/works

Re: Optimizely (YC W10) Increases Homepage Conversion Rate by 29%

#19
It would be very cool if Optimizely could gather the A/B test results across all customers, run some statistical analysis, and publish which optimizations are significant. Sort of like an OKTrends for websites.

That would be a great resource for initial usability and design decisions. After which, can be tweaked and further optimized by their product.

Re: Optimizely (YC W10) Increases Homepage Conversion Rate by 29%

#20

How does Optimizely compare with Visual Website Optimizer?

Without diving into the arcane specifics, I can safely say that I wouldn't have my sanity today without Optimizely.

It's mind-numbingly simple to use, but also hugely powerful, and intelligently implemented. Many people seem to assume the power/appeal is in the visual editor, but they've advanced so far ahead of just being "visually created experiments", in both experiment design, targetting, implementation, and customization; they've entirely eliminated the headaches and fudging that usually comes with online testing tools. I'm as happy of a customer as they come.

Post reply on HN