When you run an experiment with Website Optimizer, you're testing new content to see whether it improves your conversion rate. We can often find big winners, but, of course, some of our variations are going to be losers in that they perform significantly worse than our original content.
While you've been able to disable poor performing variations on your own for some time now, you needed to sign in, check your reports, and manually prune away the losers. No longer! Today, Website Optimizer adds a new feature: auto-disabling.
With auto-disabling, Website Optimizer will automatically prune poor performing variations for you. This keeps overall conversion rate high while testing. Additionally, by removing poor variations automatically, your traffic is focused on only the variations that have a chance at winning, which means experiments should complete faster. Lastly, we think auto-disabling gives you more freedom to try really big changes. If that crazy variation just doesn't work out, it'll be disabled. And if you've been anxious about running a test, you should be able to relax knowing that a losing variation won't hurt your overall conversion rate.
Auto-disabling is available for any Website Optimizer experiment with more than two variations (i.e. you can't use it for an A/B test, but you could for an A/B/C test). You can enable it from the experiment settings page. You can read more about setting up auto-disabling in
this Help Center article.
Posted by Trevor Claiborne, Website Optimizer team
