Good Javascript A/B (Split) Testing package/library?

Question

My boss for some reason wants to try to implement A/B Testing (or Split Testing) in JavaScript. Anyone know of any good JavaScript packages/libraries/solutions to implement A/B Testing?

Answer 1

Here's this: http://ejohn.org/blog/genetic-ab-testing-with-javascript/

Are you trying to test the marketability of your site or the performance of your code or what?

Assuming marketability, you could simply have some JS that appends a class name to your body tag (+ whatever else) based on a random number. Then record the random choice and outcome (when the visitor clicks something, also record which random layout they were presented with) via whatever analytics engine you use.

I don't know of a code quality a/b framework for JS but the idea would be similar. Define what constitutes higher quality (lower milliseconds of execution time?), run the variations of the code and see which comes out ahead. Tools like JMeter and JSUnit might be helpful for these purposes.

Answer 2

There's also Google Site Optimizer.

Answer 3

If you are using a server side language I recommend doing the split testing on the server as this will allow you to save the results. in javascript you will have to use jsonp or other ugly smelly things to save the results of your split tests.

I wrote a small article on this for asp.net mvc. It may inspire you to implement something similar in whatever backend language u use.