How to Perform A/B Testing Like an Expert in 5 Easy Steps

a/b testing

A/B testing, sometimes known as split testing, is a way to test two versions of the same thing to see which is the most effective. In content marketing, you might test web page design, landing pages, or headlines. Why A/B test? The answer is simple. It lets your consumers tell you what they will respond best to — no guessing involved.

To perform A/B testing in content marketing, you need two versions of the same marketing element. Typically your current version is assigned as the A version, or the control. A modified version of the same element becomes the B version.

Whatever platform you use to conduct the A/B test, such as dedicated testing tools like Optimizely or Google Optimize, will randomly serve up one of the two versions to visitors who visit your page. Many landing page builders such as Unbounce, Instapage or Landingi have built in A/B testing tools that also do the job.

When the A/B test is complete, you can analyze the results and use the element that gave you the best results.

What Should You Test?

You can assess the efficacy of many of your web page elements with A/B testing. Marketers commonly test elements such as headlines and calls to action, but they neglect other elements such as layout, design, images and navigation controls.

Duolingo’s VP of Growth Gina Gotthilf has her team running no less than five A/B tests at any time. She credits a large part of the company’s growth from 3 million to 200 million users on changes made to this language-learning app based on the test results.

Gotthilf’s most successful tests weren’t random; instead, they were trying to find a solution to a problem. One test, for example, was designed to stop the leak at the top of the company’s sales funnel, and this led to a test that showed huge success by letting users test drive the app before they sign up.

Related: What’s the Latest on Keyword Ratios, and How Do You Calculate Them?

How to Perform A/B Testing

Follow these basic steps to use A/B testing for content marketing and improving your website:

  1. Determine what you want to assess. Do you want to generate more leads? Do you want to increase sales? Your goal with each A/B test determines the specifics of the test. Don’t overthink each one, since you’re likely to do lots of A/B testing as you tweak your marketing approach. Start at the top of your sales funnel and work your way through it with subsequent tests.
  2. Decide what specifics you want to test. Is your headline iffy? Are you questioning whether the colors you’re using are right? Pay attention to the finest details. Start at the beginning from your user’s point of view, and work your way through each page and element of your site. You’re going to do a lot of A/B testing, and the important thing is to start somewhere.
  3. Develop the A/B test. Create a new version of whatever element you’ve decided to test. Try a new button color. Rewrite your headline. Change only one element at a time, or your test results may be skewed and you won’t know how to interpret them. Use resources such Google Analytics’ Content Experiments feature, Optimizely, Unbounce or Visual Website Optimizer to set up the tech you need for your A/B test.
  4. Gather data. Make sure you have an even amount of data for the A and B options before you start to analyze the results. Don’t pause the test while you’re gathering data, and don’t edit any of the elements you’re testing, even if you think you already see a clear pattern of results emerging. While you can use a time period (say, three weeks) as the determinant for data collection, a better choice is to set a sample size and wait until you’ve reached it. Use an online sample size calculator to determine the size you need, and aim for at least 95 percent accuracy.
  5. Analyze the results. Once you have all your data, use a split test calculator to help you confirm that the results are accurate and statistically significant, and take action to make changes to your content marketing accordingly.

Once you’ve completed A/B testing on one element of your marketing, move on to the next one until you’ve covered every aspect and honed your site to a fine polish.

The Most Important Lesson

Set realistic expectations before you start testing. The vast majority of A/B tests (typically nine out of 10) will show negligible or no results. Instead of getting discouraged and walking away, analyze those unexpected results and learn from them. Does the negative result tell you anything about your visitors? Did you start out with the wrong hypothesis?

Also keep in mind that contrary to the success stories you might read, A/B testing is a marathon and not a quick fix. Don’t expect to change your Sign Up button from red to green and see a 300% increase in conversions. Take the time to put together a comprehensive A/B testing strategy instead of randomly testing elements for the sake of testing, and you’ll see solid success over time.

David B

Article by

David has been a freelance online writer for a decade and has written for clients on four continents. He specializes in marketing content, long-form informative articles, real estate content, and travel articles that make him fantasize about where he'd like to live. In his down time, he confesses to a weakness for writing clickbait listicles.

Content Creation for Your Blog

Learn more
Social Media

The Secrets to Getting the Most Out of Your Social …

Continue reading

Content Marketing

Move Over, Mr. Patel — THIS Is How to Write an I …

Continue reading

0 thoughts on “How to Perform A/B Testing Like an Expert in 5 Eas …”

  • Avatar

    It’s a good thing you warned your readers of the high failure rate of A/B testing, David. Hopefully that will inspire at least some of them to persist. I know if I saw something fail 90 percent of the time and didn’t know that was the norm I would be quitting before long.

  • Avatar

    Your point on testing navigation tools I think is of the up most importance. Working out how consumers want to navigate your webpage means that you encourage them to return by making it as user friendly and suitable to your consumers as possible. It will also tell you what they want to look at most so you can take steps to make these aspects of a company the priority.

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes:

<a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>

More in Content Marketing
social media infographic
3 Things You Have to Get Right For Successful Info …

If a picture is worth a thousand words, the infographic is priceless. Strong infographics combine punchy, relevant written content with...

Close