Mobile A/B Testing Made Easy

#1

Post by mwseibel » Thu, Feb 09, 2012, 6:08 PM UTC

Mobile A/B Testing Made Easy
blog.socialcam.com

Re: Mobile A/B Testing Made Easy

#2

Post by jyiin » Thu, Feb 09, 2012, 8:09 PM UTC

This approach makes a lot of sense. I tried something similar with an iOS app and was surprised to find that Apple frowns upon this practice. They'd prefer that developers do usability testing beforehand instead of native A/B testing in the wild. Does anyone know if Apple has clarified this position?

It would be much more developer friendly to encourage this and would ultimately lead to better experiences for users.

Re: Mobile A/B Testing Made Easy

#3

Post by jamesshamenski » Thu, Feb 09, 2012, 8:46 PM UTC

Brilliant! Can I ask how long this methodology took to implement?

Re: Mobile A/B Testing Made Easy

#4

Post by ammon » Thu, Feb 09, 2012, 9:08 PM UTC

jamesshamenski wrote: post #3

Brilliant! Can I ask how long this methodology took to implement?

Glad you like it. We got the testing/config system working in a day. Of course, we've spent time tweaking and adding features since

Re: Mobile A/B Testing Made Easy

#5

Post by gustaf » Thu, Feb 09, 2012, 9:16 PM UTC

This is great :)

Re: Mobile A/B Testing Made Easy

#6

Post by gustaf » Thu, Feb 09, 2012, 9:17 PM UTC

jyiin wrote: post #2

This approach makes a lot of sense. I tried something similar with an iOS app and was surprised to find that Apple frowns upon this practice. They'd prefer that developers do usability testing beforehand instead of native A/B testing in the wild. Does anyone know if Apple has clarified this position? It would be much more developer friendly to encourage this and would ultimately lead to better experiences for users.

Can you elaborate? Your app got rejected?

Re: Mobile A/B Testing Made Easy

#7

Post by [deleted] » Thu, Feb 09, 2012, 9:17 PM UTC

jyiin wrote: post #2

This approach makes a lot of sense. I tried something similar with an iOS app and was surprised to find that Apple frowns upon this practice. They'd prefer that developers do usability testing beforehand instead of native A/B testing in the wild. Does anyone know if Apple has clarified this position? It would be much more developer friendly to encourage this and would ultimately lead to better experiences for users.

[deleted]

Re: Mobile A/B Testing Made Easy

#8

Post by ammon » Thu, Feb 09, 2012, 9:20 PM UTC

jyiin wrote: post #2

This approach makes a lot of sense. I tried something similar with an iOS app and was surprised to find that Apple frowns upon this practice. They'd prefer that developers do usability testing beforehand instead of native A/B testing in the wild. Does anyone know if Apple has clarified this position? It would be much more developer friendly to encourage this and would ultimately lead to better experiences for users.

Apple does not want beta products in the app store, which makes sense. But I've not seen an outright ban on testing. Testing allows us to make the app better! In any case, we've not been rejected.

Re: Mobile A/B Testing Made Easy

#9

Post by jyiin » Fri, Feb 10, 2012, 3:30 AM UTC

gustaf wrote: post #6

jyiin wrote: post #2

This approach makes a lot of sense. I tried something similar with an iOS app and was surprised to find that Apple frowns upon this practice. They'd prefer that developers do usability testing beforehand instead of native A/B testing in the wild. Does anyone know if Apple has clarified this position? It would be much more developer friendly to encourage this and would ultimately lead to better experiences for users.

Can you elaborate? Your app got rejected?

We were just encouraged to take a different approach. Not rejected. That's why I'm curious to see if others have had a different experience if they've been up front about what they're doing.