The Official Google Website Optimizer Blog - The most up-to-date product news, industry insights, and testing strategies

Picking a good test page with Google Analytics

Thursday, July 02, 2009 7/02/2009 04:42:00 PM

A common question we hear from users of Website Optimizer is, "What page should I test?" Of course, people have different opinions. For example, some experts say that you should never run a test on your homepage while others may disagree. We recommend taking a data-driven approach when choosing a test page. Simply put, test a page that needs improvement.

By using Google Analytics, you can find pages on your site that could most benefit from website testing. We've put together a short video showing how you can quickly identify these top choices:



Enjoy!

Upcoming Webinar: The 7 Deadly Sins of Landing Page Design

Tuesday, June 23, 2009 6/23/2009 11:19:00 AM

Tomorrow, June 24th at 10 AM PDT (new date, see below), we'll hosting a free webinar on landing page design. Tim Ash of SiteTuners, one of our Website Optimizer Authorized Consultants, will lead the event. He'll be sharing what he calls the seven deadly sins of landing page design.

If you want to increase your conversion rate, but are unsure of where you should start, this webinar will help you identify common issues that might be holding you back. The 90-minute webinar will conclude with open Q&A with Tim.

If you'd like to attend, you'll need to register to attend. Hope to see you there!

UPDATE 6/29/09
This webinar has been rescheduled for 7/1/09 at 10 AM PDT. You'll still need to register to attend. For those who couldn't make it on 6/24, here's your second chance.

Upcoming Seminars for Success

Wednesday, June 10, 2009 6/10/2009 05:48:00 PM

We have two upcoming Seminars for Success for Google Website Optimizer. If you're looking for a day of in-person training to help you get started in your testing, you should try to attend. The curriculum includes:
  • An overview of testing and Website Optimizer
  • How to identify problematic pages and estimate sample sizes
  • Loads of testing best practices drawn from real tests and case studies
  • Hands-on lab experience in setting up, configuring, & launching both A/B and Multivariate tests
  • How to interpret the data and run follow up experiments
The two dates are fast approaching so you'll want to sign up right away.
And if you're looking to increase your expertise in other Google products, take a look at Seminars for Success for AdWords and Google Analytics.

Run better experiments with the Mom test

Friday, May 08, 2009 5/08/2009 04:05:00 PM

In Made to Stick, the authors warn us about the curse of knowledge. Simply stated, once we know something it's hard to imagine us not knowing something.

When looking at our websites, we know how they work. We know where to find the Add to Cart button. We know that we'll pick shipping options after we enter billing information. We know the answers to questions that visitors have on their minds, and it's very hard for us to put ourselves in their shoes.

So I'd like to introduce to you, the Mom Tests:

All mothers want what's best for their children, which is, of course, why we love our mothers. While some moms have taken to the Internet with fervor, not all of our mothers are blogging, facebooking, tweeting machines. Moms are always willing to lend a helping hand and give their advice. Here are two ways your mom can help you improve your website.

The Mom Usability Test
Ask Mom to complete a task on your page. You'll want to have her start like an actual visitor would. So, think about how visitors arrive to your page. You could look in Google Analytics at Top Entrance Pages and see how people get to them, or start with a Google search and go from there. Ask your mom to try to buy something on your page or sign up for more information. Ask her to think out loud if she has any questions. Don't try to help or tell her what she should be doing. Just watch and take notes.

The Mom A/B Test
When people test their pages, they often try to test very small changes. Minute changes, like the use of a semicolon or the use of Arial font versus Verdana font (see the difference?), often have no effect on conversions. One rule of thumb to keep in mind is that users make a decision to stay on a page or leave in less than 5 seconds. That means, any change you are testing needs to stand out within 5 seconds.

So where does Mom come in? Show your mom your A page and your B page and ask her what's different. If she struggles to spot the differences, your changes may not be big enough. As for which page will convert better, that's where testing with Website Optimizer comes in.

We hope the Mom Tests help you improve your website and bring you and your mother a little closer this weekend. Happy Mothers' Day to all the Moms out there.


Landing Page Testing with Offline Conversions using Website Optimizer

Wednesday, April 29, 2009 4/29/2009 10:21:00 AM

This is a guest post from David Booth at WebShare, a Website Optimizer Authorized Consultant. In addition, David is one of our Google Website Optimizer Seminar Leaders.

Can you use Website Optimizer to test your landing pages if your conversion occurs offline?

We know Website Optimizer is great when the conversion happens online, but what if your goal is an offline conversion, such as getting the phone to ring? Conversions are defined with JavaScript that has to be executed by a browser, so testing with a tool like GWO may sound like an impossible task – but it’s not.

Pacific Hills Treatment Centers was able to achieve a 40% lift in phone leads via their top landing page by using Website Optimizer, and this post will show you how they did it.

The Offline Lead Generation Dilemma

Tod Cunningham, VP of Business Development of PacHills found himself in a familiar position. “I was discussing how to get a better conversion rate out of my landing pages with my AdWords rep, and when she mentioned conversion testing my first response was, ‘That’s not going to work for me, my conversion doesn't happen on my site.’”

As is the case with many lead-gen sites like PacHills, a conversation with a real, live, human being is much more likely to turn a visitor into a customer, and is often necessary during the sales cycle.

With our help, an A/B test was created and run to test three alternate variations of a top paid search landing page. The goal of this page was not to get an online form submission or get a visitor through a shopping cart, but to get visitors to pick up the phone and call.

How to Test Offline Conversions

So how do you run a test with a phone call as your conversion? This can be done by using Website Optimizer alongside just about any of the widely available phone tracking solutions out there.

1. The first step is like any other test – after consulting your web analytics to determine the best candidate for the test page and experiment type, it’s time to create the variations. Ask yourself what changes you’d like to make and why you believe those changes will have a positive impact on conversions, and let that guide your variation design. In this experiment, WebShare’s design team helped facilitate this process and created three different alternatives to the original landing page. The original and winning pages are pictured below:

Click to see a larger image

2. Now it’s time to set up the phone tracking. All we really need to do is place a special phone number on each of our test pages that will tell us which of our different pages originated the call. In this case, ClickPath was used to automate this by assigning and tracking calls from phone numbers (or banks of numbers) dedicated to each specific landing page.

3. Next, set up the test in Google Website Optimizer. This example is of the A/B variety, where the original was defined along with three variations. You could do this as a Multivariate test as well.

4. After validating the alternate pages and previewing the variations in the preview tool, launch the experiment.

5. Patiently let the experiment run and collect your data.

Running the Analysis

At this point you’ll have Google Website Optimizer splitting traffic, recording unique visitors, and handling all your cookies to ensure that repeat visitors continue to see the same variation. Your phone tracking application will be recording the phone calls (conversions) that result from each of your variations, and you now have all the data necessary for your analysis.

Because Website Optimizer displays the data it’s recording, you can run the statistics yourself at any time using any tool you’re comfortable with. A simplified set of free conversion marketing tools is available on WebShare’s site to help you get the results you need. Here’s how:

1. From Website Optimizer, you’ll get the visitors data in your experiment report:

2. Your phone tracking software will provide your conversion data:

3. Next, plug these values into a tool (like this one) that will do the number crunching for you:

4. The last step is to run the numbers to get a report:

Start Answering Those Phones!

This particular experiment found a clear winner – a winner that boosted the likelihood of a visitor calling PacHills by over 40%.

According to Tod at PacHills, “This has opened up doors that we had thought were closed to us. You can bet next time you’re on our site, we’ll be testing on you!”

If you’re in a situation where a call is your conversion, then we hope this post will give you the tools to start testing and getting your phones ringing off the hook!

Advanced Website Optimizer tricks

Friday, April 10, 2009 4/10/2009 10:59:00 AM

If you've been enjoying the Techie Guide to Website Optimizer, we have a treat for you. Eric Vasilik, the lead Website Optimizer engineer, has put together the new GWO Tricks blog showcasing some of the extra-cool things you can do with Website Optimizer such as:
It's important to note that these are pretty advanced techniques, so if you're just starting out with Website Optimizer, you probably want to begin at our Help Center or YouTube channel.

Big thanks to Eric for pushing the envelope on what's possible with Website Optimizer. If you've got ideas on what he should try next, leave a note in the comments.

Two new Website Optimizer integrations

Tuesday, March 24, 2009 3/24/2009 10:21:00 AM

Greetings from SES!

We have two cool new Website Optimizer integrations to share with you. One is from CoreCommerce, an ecommerce platform, and the other SEO Samba, an organic search management platform. With these integrations, implementing Website Optimizer on your site just got easier.

Here's a video demonstrating SEO Samba's integration:



And you can also see some videos of the CoreCommerce integration in action at their site.