Live data from Hacker News

Show HN: Birdy – Twitter Profile A/B Testing

birdy.so

21–30 of 59 posts

Re: Show HN: Birdy – Twitter Profile A/B Testing

#22

If I’m understanding correctly, this switches your profile on some interval between A and B, whereas a proper A/B test will randomly bucket a user to experiment A or B. Not that it matters - this solution is probably the right way to go without building something into Twitter itself - but the more data/stats oriented folks may be confused or irked by calling this “A/B testing”

That is correct - it switched your profile version at a regular interval.

Indeed, that's the only way I could do it. The Twitter API has its limitations :D

I didn't know there was a specific definition of A/B testing. I'll see if I get more complaints about the terms I use ^^.

To me, that's still A/B testing - that is I'm testing a version A and a version B and then report on which one does better. I guess the way I'm doing it is different :D

Re: Show HN: Birdy – Twitter Profile A/B Testing

#24

I built Birdy to help you optimize your Twitter profile with continual automated A/B testing! Why? More Twitter followers. More website clicks. I'm a huge fan of Twitter since I discovered the indie makers community. I wanted to create a product around this passion of mine, so I started experimenting with the Twitter API and I eventually landed on profile A/B testing as a cool problem to solve :).

What's a good entry to the indie maker community on Twitter?

Re: Show HN: Birdy – Twitter Profile A/B Testing

#27

Looks really cool! Would you a consider a free tier if you have a low follower count?

Oh! That's a good idea. I didn't think about that.

I think at some point I'll have a free plan for everyone (with limited features). I just need to finish implementing all the profile components and then enable only some of them for the free plan.

Re: Show HN: Birdy – Twitter Profile A/B Testing

#28
post #24

I built Birdy to help you optimize your Twitter profile with continual automated A/B testing! Why? More Twitter followers. More website clicks. I'm a huge fan of Twitter since I discovered the indie makers community. I wanted to create a product around this passion of mine, so I started experimenting with the Twitter API and I eventually landed on profile A/B testing as a cool problem to solve :).

What's a good entry to the indie maker community on Twitter?

Start building a strong Twitter presence! Also engage with the IndieHacker forum.

Re: Show HN: Birdy – Twitter Profile A/B Testing

#29

If I’m understanding correctly, this switches your profile on some interval between A and B, whereas a proper A/B test will randomly bucket a user to experiment A or B. Not that it matters - this solution is probably the right way to go without building something into Twitter itself - but the more data/stats oriented folks may be confused or irked by calling this “A/B testing”

That is correct - it switched your profile version at a regular interval. Indeed, that's the only way I could do it. The Twitter API has its limitations :D I didn't know there was a specific definition of A/B testing. I'll see if I get more complaints about the terms I use ^^. To me, that's still A/B testing - that is I'm testing a version A and a version B and then report on which one does better. I guess the way I'…

Definitely agree that this is a good solution given the limitations, I think the only downside to this approach is that there might be some effect based on time of day or the interval affecting your results. That said I think the chances of that are super low and A/B testing is only so accurate anyway. Great idea and nice website!

Re: Show HN: Birdy – Twitter Profile A/B Testing

#30

Earlier quoted context omitted.

That is correct - it switched your profile version at a regular interval. Indeed, that's the only way I could do it. The Twitter API has its limitations :D I didn't know there was a specific definition of A/B testing. I'll see if I get more complaints about the terms I use ^^. To me, that's still A/B testing - that is I'm testing a version A and a version B and then report on which one does better. I guess the way I'…

Definitely agree that this is a good solution given the limitations, I think the only downside to this approach is that there might be some effect based on time of day or the interval affecting your results. That said I think the chances of that are super low and A/B testing is only so accurate anyway. Great idea and nice website!

Thank you!

> I think the only downside to this approach is that there might be some effect based on time of day or the interval affecting your results.

That is definitely true. I'm about to start alternating the versions every 5m to mitigate this. The closer I can get to 0m, the more accurate the results are. This way even if you get a followers spike (let's say you get a viral tweet), the followers will be properly distributed between each version.

Post reply on HN