Some information on A/B split-testing: http://startuplessonslearned.blogspot.com/2008/09/one-line-split-test-or-how-to-ab-all.html http://www.37signals.com/svn/posts/1525-writing-decisions-headline-tests-on-the-highrise-signup-page I could do this in a Rails app with a simple case or if statement in my views, but that gets to be a lo...
We just now started doing the A/B testing for our Django based project. Can I get some information on best practices or useful insights about this A/B testing. Ideally each new testing page will be differentiated with a single parameter(just like Gmail). mysite.com/?ui=2 should give a different page. So for every view I need to write a...
Assume I have a site which shows information regarding restaurants. All the urls are named as /restaurants/some-dynamic-restaurant-name/ eg.../restaurants/somename**1**/, /restaurants/somename**2**/ etc... How can I A/B test or Multivariate test using GWO, all the restaurant pages in one single experiment? Update: I have created a quest...
My boss for some reason wants to try to implement A/B Testing (or Split Testing) in JavaScript. Anyone know of any good JavaScript packages/libraries/solutions to implement A/B Testing? ...
What is the best and cleanest way to implement A-B testing in asp.net mvc? That is, when we make new changes to an asp.net mvc web site, we want to test the new html/css/js with a certain subset of visitors (defined on cookie, login id, etc) and then analyze some metrics (page response time, number of pages visited, $$$ in sales, etc) a...
Hi there, I'm trying to run a multivariate test across 3 pages, google says this should be ok, as long as you use the same section names, it doesn't care about the url so much. so I have checked in google optimizer, it says all my scripts are set up correctly. Also the strange thing is it DOES work, it replaces the content, but it neve...
from: http://www.bingocardcreator.com/abingo/usage #A view example with a block passed to ab_test: <% ab_test("call_to_action", %w{button1.jpg button2.jpg}) do |button| > <%= image_tag(button, :alt => "Call to action!" %> <% end %> Does whatever "choice" that gets passed in the block have to be some sort of link? How does a/bingo kn...
Has anyone done much A/B testing with a rich client (i.e. WinForms or WPF) application? I am interested in deployment strategies that make sense for this scenario. It seems like ClickOnce deployment would be a good fit, but there's so much baggage with getting ClickOnce to work properly for a non-trivial application. If using ClickO...
I am doing A/B testing and I am facing Simpson's paradox in my results (day vs month vs total duration of the test). Does it mean that my a/b testing is not correct/representative? (Some external factor impacted the testing?) If it is a sign of problem, what are the directions to follow? Thanks for your great help. Further reading: ...
We have a framework that offers A/B split testing. You have a 'champion' version of a page and you develop a 'challenger' version of it. Then you run the website and allocate some of your users the champion and some the challenger and measure their different responses. If the challenger is better than the champion at achieving your me...
Hey, I'm trying to do A/B testing and I'm using Nginx fo this purpose. My Nginx config file looks like this: events { worker_connections 1024; } error_log /usr/local/experiments/apps/reddit_test/error.log notice; http { rewrite_log on; server { listen 8081; access_log /usr/local/experiments/apps/reddit...
I'm about to use Google's Website Optimizer to do a/b testing on the home page of my site. My question is: which of the alternative pages will google's spider index? All of them? I couldn't find any info about this on google or on GWO pages. ...
I've had an A/B Test running in Google Web Optimizer for six weeks now, and there's still no end in sight. Google is still saying: "We have not gathered enough data yet to show any significant results. When we collect more data we should be able to show you a winning combination." Is there any way of telling how close Google is to makin...
I've previously asked how long it takes for a winning combination to appear on Google's Web Optimizer, but now I have another weird problem during an A/B test: For the past two days has Google announced that there was a "High Confidence Winner" that had a 98.5% chance of beating the original variation by 27.4%. Great! I decided to l...
Hi all, I'm about to start work on a new project and thought it could be a good time to also start looking into a new PHP framework. I've really only spent a lot of time with Joomla, so "new" can almost be "any". Anyway, I've also been seeing a lot of talk about A/B testing and thought that it might be a good idea to try. From what I'v...
When using Google Website Optimizer A/B split test, is there a way I can read a cookie to see which version A or B did the user get? I need to know this from a page other than the control page. ...
Hi, I'd like to do A/B testing for my views and I was wondering what gems are out there and what strategies you can suggest. I already found http://www.bingocardcreator.com/abingo but I can't tell if that does entire templates as well, or just buttons, etc. suggestions? ...
I'm using A/Bingo for Rails, and it seems to be working fine, except for counting conversions. It looks like conversions for the first user that converts are counted, but then it gets stuck and doesn't record any other conversions. I know that conversions occurred because I see them in two completely separate and unrelated analytics apps...