Live data from Hacker News

Bootstrapped Wingify moves to a bigger office and hits 1600+ customers

visualwebsiteoptimizer.com

31–40 of 46 posts

Re: Bootstrapped Wingify moves to a bigger office and hits 1600+ customers

#31

Earlier quoted context omitted.

I'd be keen to hear the difference from someone who has used both in anger. I'm with VWO (because it gets mentioned around here so much - so I went there first) and it's awesome but it's always good to keep your options open.

Congrats, Paras! As for a comparison, Optimizely uses Akamai which has 100,000 nodes in 75 countries. VWO uses Cloudfront and does two round-trips. Cloudfront has 32 points of presence in 12 countries. Optimizely response time: Slowest: 289ms, Average: 65ms, Slowest: 19ms VWO response time: Slowest 1983ms, Average: 276ms, 171ms Source: http://till.klampaeckel.de/blog/archives/100-Shopping-for-a-... Unique features to…

Thanks Dan. Appreciate you pitching in. However, actually, you have old statistics. We recently rolled out a dynamic, custom built CDN that sped up our response times by 7x. Our average is now 45ms. We spent a lot of time perfecting our system. See the details here: http://visualwebsiteoptimizer.com/split-testing-blog/geo-dis...

Plus, you are wrong about almost all of your points:

- We do have a well documented API. Many customers use it on a daily basis to integrate VWO into their systems. http://visualwebsiteoptimizer.com/split-testing-blog/announc...

- Our 21 lines of code is unique as it provides an asynchronous fail safe method. With 1-line of code, websites still have a theoretical single point a failure where code is fetched from your servers/CDN. If your code isn't able to get fetched for any reason, standard timeout of browser (30 seconds) applies and since it is synchronous page load stalls. With our asynchronous approach, we completely decouple the dependence (even if it doesn't look elegant, it certainly is much preferable to our customers). Here are the details: http://visualwebsiteoptimizer.com/split-testing-blog/asynchr...

- I'm not sure what you mean by Human-readable results. Certainly we have some great looking reports that our customers love. 50+ case studies on our websites is a testimony to that http://visualwebsiteoptimizer.com/case-studies.php In fact, one independent website that tracks UI from color blindness perspective says we have one of the best charts out there http://wearecolorblind.com/example/visual-website-optimizer/

- We offer developer CSS/JavaScript API that allows complete modification of a website without touching any backend code

- Our tests run on mobiles as well, a lot of our enterprise customers regularly test their mobile landing pages

- We have one-click integration for Google Analytics, and have plugins for KISSMetrics, SiteCatalyst, etc.

- ALL employees of Wingify (including me the CEO and our CTO) do support for all levels of customers (not just enterprise ones). In fact, support is bed rock of our offering. My number is there on our about us page http://visualwebsiteoptimizer.com/about-us.php

According to best of my knowledge, apart from cross-browser previews I do not think there is any feature that VWO lacks. You may want to cross-check your facts. Our backend delivery infrastructure prioritizes on speed and fall-back rather than elegance of how the code looks.

However, you did not mention the features VWO has that Optimizely currently lacks:

- Usability testing. Our users can get quantitative feedback and improvement ideas on what they should be A/B testing http://visualwebsiteoptimizer.com/split-testing-blog/geo-beh...

- Heatmaps and Clickmaps to show where people are clicking on their pages. Our customers LOVE This feature and some solely use VWO for its heatmap functionality http://visualwebsiteoptimizer.com/split-testing-blog/ab-test...

- Enterprise security options such as whitelisting office IPs for login and realtime activity notifications to administrator http://visualwebsiteoptimizer.com/split-testing-blog/hallowe...

- Free 30 day trial without requiring a credit card.

- Numerous other small features that I won't go into (test labels, test organization, frequently used goals, roles/permissions, account management, reports exportable to CSV/PDF, etc.)

Re: Bootstrapped Wingify moves to a bigger office and hits 1600+ customers

#33

Earlier quoted context omitted.

I'd be keen to hear the difference from someone who has used both in anger. I'm with VWO (because it gets mentioned around here so much - so I went there first) and it's awesome but it's always good to keep your options open.

Congrats, Paras! As for a comparison, Optimizely uses Akamai which has 100,000 nodes in 75 countries. VWO uses Cloudfront and does two round-trips. Cloudfront has 32 points of presence in 12 countries. Optimizely response time: Slowest: 289ms, Average: 65ms, Slowest: 19ms VWO response time: Slowest 1983ms, Average: 276ms, 171ms Source: http://till.klampaeckel.de/blog/archives/100-Shopping-for-a-... Unique features to…

Hey Dan,

I am a bit confused.

You Say - 100% money back satisfaction guarantee

Your Terms say (https://www.optimizely.com/terms) - 4.B. No Refunds. You may cancel your Member account at any time; however, there are no refunds for cancellation. In the event that Optimizely suspends or terminates your account or this Agreement, you understand and agree that you shall receive no refund or exchange for any Optimizely Property, any unused time on a subscription, any license or subscription fees for any portion of the Service, any content or data associated with your account, or for anything else.

Also couldn't locate the SLA on your site, can we have the link?

Re: Bootstrapped Wingify moves to a bigger office and hits 1600+ customers

#35

Hey Paras, What was your methodology for customer development, customer acquisition in the early days of your startup? Or, did you build for yourself? What are the distribution channels you currently use?

Main methodology was guest blogging. I contributed exhaustive articles in publications such as Smashing Magazine, CopyBlogger, etc. The articles were purely educational in nature, taught people what A/B testing was and VWO was introduced as one of the of the new tools to do A/B testing easily.

The second big focus was on passion for feedback from early customers and incorporating that into the product. Really, our product is driven mostly by customer feedback and that is why our customers love talking about it.

I plan to write comprehensively about it. But I do keep posting my experiences on my blog http://paraschopra.com/blog/

Re: Bootstrapped Wingify moves to a bigger office and hits 1600+ customers

#37

Earlier quoted context omitted.

Congrats, Paras! As for a comparison, Optimizely uses Akamai which has 100,000 nodes in 75 countries. VWO uses Cloudfront and does two round-trips. Cloudfront has 32 points of presence in 12 countries. Optimizely response time: Slowest: 289ms, Average: 65ms, Slowest: 19ms VWO response time: Slowest 1983ms, Average: 276ms, 171ms Source: http://till.klampaeckel.de/blog/archives/100-Shopping-for-a-... Unique features to…

Hey Dan, I am a bit confused. You Say - 100% money back satisfaction guarantee Your Terms say ( https://www.optimizely.com/terms ) - 4.B. No Refunds. You may cancel your Member account at any time; however, there are no refunds for cancellation. In the event that Optimizely suspends or terminates your account or this Agreement, you understand and agree that you shall receive no refund or exchange for any Optimizely P…

We offer our 100% money-back satisfaction guarantee prominently on our pricing page located at https://www.optimizely.com/pricing

All plans come with a 30 day FREE trial and a 100% Satisfaction Money Back Guarantee.

Our SLA is part of the Mutual Services Agreement contract we have with customers.

Re: Bootstrapped Wingify moves to a bigger office and hits 1600+ customers

#38

Earlier quoted context omitted.

Hey Dan, I am a bit confused. You Say - 100% money back satisfaction guarantee Your Terms say ( https://www.optimizely.com/terms ) - 4.B. No Refunds. You may cancel your Member account at any time; however, there are no refunds for cancellation. In the event that Optimizely suspends or terminates your account or this Agreement, you understand and agree that you shall receive no refund or exchange for any Optimizely P…

We offer our 100% money-back satisfaction guarantee prominently on our pricing page located at https://www.optimizely.com/pricing All plans come with a 30 day FREE trial and a 100% Satisfaction Money Back Guarantee. Our SLA is part of the Mutual Services Agreement contract we have with customers.

I do see it being prominently listed in Pricing page, but the "Terms of Service" is a binding contract which I have to agree to while I signup, don't you think they should be consistent.

Is this SLA done individually with each customer after they signup?

Re: Bootstrapped Wingify moves to a bigger office and hits 1600+ customers

#39

Earlier quoted context omitted.

Congrats, Paras! As for a comparison, Optimizely uses Akamai which has 100,000 nodes in 75 countries. VWO uses Cloudfront and does two round-trips. Cloudfront has 32 points of presence in 12 countries. Optimizely response time: Slowest: 289ms, Average: 65ms, Slowest: 19ms VWO response time: Slowest 1983ms, Average: 276ms, 171ms Source: http://till.klampaeckel.de/blog/archives/100-Shopping-for-a-... Unique features to…

Thanks Dan. Appreciate you pitching in. However, actually, you have old statistics. We recently rolled out a dynamic, custom built CDN that sped up our response times by 7x. Our average is now 45ms. We spent a lot of time perfecting our system. See the details here: http://visualwebsiteoptimizer.com/split-testing-blog/geo-dis... Plus, you are wrong about almost all of your points: - We do have a well documented API.…

It's great to see multiple products in the market trying to solve this problem and I admire your ability to do so without a large team or any funding. It's unclear how the market will grow in the future but we're thrilled to see Optimizely grow +397% amongst the top 10,000 websites in the last year to over 2,500 happy customers.

I'm glad to see you are focusing on improving your response time. Unfortunately hitting live servers serving dynamic content in 5 locations is never going to be able to beat 100,000 edge-cached nodes in 75 countries serving static content when it comes to response time and reliability.

According to the link you provided it looks like Pingdom reports VWO response times as:

VWO Slowest Average: 352ms

VWO Overall Average: 207ms

VWO Fastest Average: 45ms

According to Pingdom, Optimizely response times are:

Optimizely Slowest Average: 95ms

Optimizely Average: 65ms

Optimizely Fastest Average: 19ms

Here is a head-to-head comparison of Optimizely vs. VWO including response time and feature differentiation: http://i.imgur.com/BRTxC.png

To clarify some of the points you might have misunderstood:

- Here is a demo showing the Optimizely visual mobile editor: http://www.youtube.com/watch?v=HucXw_egPRs

- Documentation of Optimizely one-click integrations: http://support.optimizely.com/customer/portal/articles/58188...

- The Optimizely API is publicly available at: https://www.optimizely.com/docs/api

You are right we don't currently offer ancillary features like heatmaps and usability testing. We've been focused on offering the best possible experience for A/B and multivariate testing.

Re: Bootstrapped Wingify moves to a bigger office and hits 1600+ customers

#40

Earlier quoted context omitted.

We offer our 100% money-back satisfaction guarantee prominently on our pricing page located at https://www.optimizely.com/pricing All plans come with a 30 day FREE trial and a 100% Satisfaction Money Back Guarantee. Our SLA is part of the Mutual Services Agreement contract we have with customers.

I do see it being prominently listed in Pricing page, but the "Terms of Service" is a binding contract which I have to agree to while I signup, don't you think they should be consistent. Is this SLA done individually with each customer after they signup?

Good point and we'll clarify the terms of service and make our SLA more prominent.
Post reply on HN