Ask HN: Please help with an AB test. (Live results in comments.)(theplanis.com)
theplanis.com
Ask HN: Please help with an AB test. (Live results in comments.)
http://theplanis.com/app/mst
2 comments
The first time I hit the page the request for an email address just didn't turn up at all; not sure if you're capturing that possibility. (FF 3.5.3, OSX 10.5.8)
just as important are users who DIDNT respond :) are you collecting that information?
Good point, yes I am - It's not going into the live results but I'll put that data up too at an appropriate point.
(For the interested the short link points to a tiny Django web app that's doing both the tracking and handling AJAX e-mail uploads. Everything else is client side JavaScript.)
(For the interested the short link points to a tiny Django web app that's doing both the tracking and handling AJAX e-mail uploads. Everything else is client side JavaScript.)
a/b testing is a great tool, but wouldn't telling people they are participating in an a/b test trying to determine a specific question 'requesting e-mail addresses from visitors' bias the results?
I'm logging referrers so I can see how much of an effect that has - if it turns out to be significant I'll segment the results.
I wanted to get something up quickly to test my tool chain/environments and I thought that running a simple experiment was a great way to do that. I'm AB testing two versions of requesting e-mail addresses from visitors and I'm happy to share the results with HN.
I'll post a more detailed (anonymous) breakdown later on but you can see the initial results here: http://theplanis.com/app/abtestresults/