Live data from Hacker News

Launch HN: RankScience (YC W17) – Automated Split-Testing for SEO

rankscience.com

61–70 of 88 posts

Re: Launch HN: RankScience (YC W17) – Automated Split-Testing for SEO

#61
It seems like you integrate with the likes of Google (Webmaster Tools) and Cloudflare in ways not done before, so my assumptions here are probably a bit outdated.

Let's say you want to test a new title. You collect stats for a week, change the title, collect stats for another week. The two datasets are then compared. Am I close?

Does it mean that you can't AB test in parallel? If so, it's not optimal for time sensitive stuff like breaking news.

Re: Launch HN: RankScience (YC W17) – Automated Split-Testing for SEO

#62
post #61

It seems like you integrate with the likes of Google (Webmaster Tools) and Cloudflare in ways not done before, so my assumptions here are probably a bit outdated. Let's say you want to test a new title. You collect stats for a week, change the title, collect stats for another week. The two datasets are then compared. Am I close? Does it mean that you can't AB test in parallel? If so, it's not optimal for time sensiti…

We don't run experiments on a single page, but instead run them across groups of similar pages. The easiest way to think about this is running a test across a "product" template on an e-commerce site. A site could have thousands of product pages, but they're all on the same template. We would grab a set of a few thousand product pages, and split them into control and variant groups, execute the change on the variant group, and monitor how Google reacts to the groups in aggregate over a period of time.

Depending on how many pages you have, we can run many tests in parallel.

Re: Launch HN: RankScience (YC W17) – Automated Split-Testing for SEO

#63
I consult with startups and tech companies (recently: SurveyMonkey) on SEO, so this is super-interesting... especially the automated aspect, which is pretty novel in this space.

What are some of the specific types of automated tests that you run?

Re: Launch HN: RankScience (YC W17) – Automated Split-Testing for SEO

#64
post #62
post #61

It seems like you integrate with the likes of Google (Webmaster Tools) and Cloudflare in ways not done before, so my assumptions here are probably a bit outdated. Let's say you want to test a new title. You collect stats for a week, change the title, collect stats for another week. The two datasets are then compared. Am I close? Does it mean that you can't AB test in parallel? If so, it's not optimal for time sensiti…

We don't run experiments on a single page, but instead run them across groups of similar pages. The easiest way to think about this is running a test across a "product" template on an e-commerce site. A site could have thousands of product pages, but they're all on the same template. We would grab a set of a few thousand product pages, and split them into control and variant groups, execute the change on the variant…

Gotcha

Thanks

Re: Launch HN: RankScience (YC W17) – Automated Split-Testing for SEO

#66

Co-founder/CTO here. Please share any SEO questions!

seems like a hard nut to crack, considering there are constant changes to google algos that could screw with test results mid-test, and many other moving parts. I think what you are doing is great, have built similar tools in the past and always ran into issues due to so many moving parts, but im not a statistician.

Also what do you consider success? what if one title/meta combo gets a better rank but fewer clicks(ie; the bots like it but the users dont)? which one would you keep? I know many people like to brag about how many rankings they have but as an SEO for over a decade, i think traffic count is still king. in that id rather rank 11th for an extremely high volume term, then rank 2nd for a low volume one.

another thought... a blackhat site gets banned halfway through one of your tests and you move up based on no actions you took. thus you would get a false positive, no?

Re: Launch HN: RankScience (YC W17) – Automated Split-Testing for SEO

#69

I consult with startups and tech companies (recently: SurveyMonkey) on SEO, so this is super-interesting... especially the automated aspect, which is pretty novel in this space. What are some of the specific types of automated tests that you run?

Here's a case study with a simple example of a test: https://www.rankscience.com/coderwall-seo-split-test

* CTR on titles/meta descriptions * Any HTML changes * Design changes * Time on site

Post reply on HN