Split testing made easy!

Split testing (also known as A/B testing) is one of those things a lot of marketers neglect to use, because they think it’s overly complicated or isn’t really necessary. And it’s understandable. It does seem like it would be a bit technical, but it’s actually a lot easier than you probably think!

As far as necessary—well, it’s as necessary as any other element of your business, and you’ll learn why later. Trust me, it is a vital component of your business. You might be able to succeed without it, but you could have even more success if you do use it!

So what is split testing, anyway?

It is the process of testing multiple versions of a particular piece of copy in order to find out which one converts best. For example, you could test multiple versions of a page’s headline, or multiple color variations of a sales page.

You can do this manually by simply running one version for a while and tracking results, then making a change and allowing it to run for a while and comparing results, or by using a special piece of software that shows the different versions to visitors on a rotating basis.

In this guide, you’re going to learn why this type of testing is so essential, and how you can use it to benefit your business.

So let’s begin.

Why Use Split Testing?

Perhaps the biggest argument people present when they try to explain why they aren’t using split testing is that they just don’t think it’s necessary. Why bother with something that might only increase your conversion rate by a percent or two?

Well, in the beginning, it might not seem like that big of a deal. If you’re only making $100 per month, it might not seem like such a huge thing to your bottom line.

BUT…

Don’t think I’m saying you shouldn’t use split testing just because you aren’t making much, yet! Just because it won’t add thousands of dollars magically to your income doesn’t mean you shouldn’t use it! Let me explain why.

First, it could actually double your income with very little effort. Yes, that’s right… I said it could double your income! The reason I said it might not seem like “that big of a deal” is because doubling your income from $100 to $200 might not seem that big, but when you consider you doubled your income practically overnight, it’s bigger than it seems! And if you’re making more than $100 per month, the potential is even more powerful.

Another important reason you might want to use this type of testing right from the start is to make sure your products convert as well as they can in order to attract affiliates.

If you create your own products, chances are, you’re going to want affiliates to promote those products for you. After all, it’s pretty much “free money”. Affiliates do the work, and you get paid.

But affiliates aren’t going to want to promote a product that doesn’t convert well. And if they try a product you create and it doesn’t convert, they will probably never promote another one of your products.

Starting to see why it actually IS a big deal, even in the beginning? Even if you’re not too worried about conversion rates for your own income, you have to worry about making sure your products convert for the sake of your affiliates!

As you can see, this type of testing isn’t something you should continue to ignore. No matter what type of business you’re running, split testing could help you increase your profits considerably!

Types of Things to Split Test

There are tons of different things you can test. Most people think of things like headlines and designs, but there are so many elements that can be tested.

Let’s take a look at some examples of the types of elements you could perform this test on. This will vary depending on the type of page you want to test, of course.

Things you should consider testing:

• Headline (text, color, size, font, etc.)
• Pricing (including base price, upsell prices, payment plans, etc.)
• Article titles (clickbait)
• Call-to-action (type, text, color, placement, etc.)
• Offers (eBooks, videos, webinars, etc.)
• Copy (different elements of your actual copy)
• Form fields (name, email, other information)
• Design of a lead-generating pop-up
• The page as a whole

Things you should not bother to test:

• Minor changes to text
• Minor changes to appearance, such as a change of bullet graphic
• Things visitors can’t always see, such as whether a site is mobile friendly. (Your site should always be mobile friendly!)

It should be fairly instinctual to figure out which elements are most important for you to test on your page. Whatever you’ve agonized over the most, such as price, headline, or design, is probably the first thing you should test.

Multivariate Testing

A/B testing refers strictly to testing two versions of a single element to see which one performs best. Sometimes you may test three versions of the same element, such as the headline, but this is usually only effective when you have a lot of traffic. If you don’t have much traffic, it’s important to limit the number of variations in order to get an accurate result as quickly as possible.

Multivariate testing is different, because you’re testing multiple elements concurrently. For example, you could test two versions of the headline, two versions of the price, and three versions of the call-to-action. These tests are all run side-by-side to uncover which version gets the best results when combined. For instance, the first headline might convert best with the third call-to-action and the second price, but that first headline might convert badly with the first call-to-action and the first price.

Multivariate testing is best done when you have a significant amount of traffic, because with so many versions to test, it’s difficult to get a statistically significant number without quite a lot of traffic. You’d need to get thousands of hits per day for multivariate testing to truly be effective for you.

In this guide, we’re specifically going to focus on A/B testing, because most people don’t have the level of traffic needed to conduct accurate multivariate tests.

Split Testing Best Practices

Testing can be a little technical, but as long as you follow the standard set of best practices, you should have little trouble.

Let’s take a look at the most important guidelines to follow:

1. One Test at a Time – If you’re testing manually, the most important thing to keep in mind is that you should only perform one test at a time, because you want to be certain which element it was that caused the increase or decrease in conversions. You can perform concurrent tests if you’re using automated software, because the program will detect which element was served and keep the results separate, but on your own, it’s not possible to run multiple tests simultaneously while getting accurate results.
2. One Variable at a Time – Unless you’re using automated software that lets you test multiple variables in a very controlled way, you should only test a single variable at a time. For example, test two different headlines in a single test, but wait until that test is finished to test two different calls-to-action. Again, automated software will let you test multiple variables at a time, but keep in mind that the more variables you test concurrently, the longer it will take to get statistically accurate results.
3. Test Small Stuff – A lot of people think only things like the headline and call-to-action are important to test, but even the smallest things can lead to better conversions.
4. Test The Whole Thing – While sometimes a single element on a page can make a big difference in conversions, making an entirely different version of a page can also make a huge difference. For example, once you’ve tested a couple of headlines and found one that converts, you can then test that headline in a completely different version of your page’s design.
5. Test Your Whole Funnel – A lot of people stop at testing the lead capture page or the sales page, but did you know that one lead page version might convert better, but result in fewer sales? It’s a good idea not only to test to see which version gets you the most opt-ins, but also which one results in the most sales later.
6. Send Quality Traffic – A lot of people think it’s okay to just send thousands of untargeted visitors to a page for split testing purposes, but this isn’t going to work. You need to drive truly targeted traffic to your pages when testing, because any sales from untargeted, low-quality traffic could be completely random and have nothing to do with the elements you’re testing.

Manual vs. Automated Testing

There are two main ways to perform the tests—either by hand, or with the use of software.

When you perform it by hand, you simply need to leave one version up until you have a statistically sound number of results, say 1,000 unique visitors, and write down your conversion rate. Then put up the second version you want to test, wait until you have another 1,000 unique visitors, and write down the conversion rate for the second version and compare the two.

This is a fairly complicated process, because you have to monitor your traffic carefully to ensure you don’t let the test run too long or not long enough, and that you’ve accurately counted the conversions generated only within each testing period.

Fortunately, there’s a better way to perform split testing. Software like Split Test Monkey make is easy to perform testing on a hands-off basis.

There are two ways to do this. You can either do A/B Dynamic testing, which tests individual elements on the same URL, or split URL/web page testing, which tests 2-6 completely different pages. This is done using a rotator link that you’ll send visitors to, showing visitors different versions of the page. Cookies are used to ensure visitors will see the same version of the page if they return later, too.

This is the type of thing that would be practically impossible to do by hand, and it saves you a ton of time, in addition to ensuring more statistically accurate results.

Can you imagine how long it would take to test just one different version of the headline, one different version of the call-to-action, and one version of the price of your product? You’d have to test the original version for a few days to get your control results. Then you’d have to test your first variation for a few days. Then your second. Then your third.

It could take you a couple of months to get accurate results for this many variations if you do it manually, especially if you’re not getting that much traffic.

That’s why software like Split Test Monkey works so well. You don’t have to spend so much time changing out pages and tracking results manually. It does everything for you.

You can take a look at Split Test Monkey and see what all you can do with it here:

>> http://www.splittestmonkey.com

Other popular tools for split testing include:

>> http://www.optimizely.com

>> https://vwo.com/

>> http://www.qubit.com/

>> https://en.abtasty.com/

>> http://www.adobe.com/marketing-cloud/testing-targeting.html

Real World Examples

Now that you’ve learned about the basics of split testing, let’s take a look at some specific examples in which split testing has yielded real world results for companies.

NuFACE is a skin care company that was getting good traffic, but people were abandoning their shopping carts at an alarming rate. They decided to do a split test to figure out if offering free shipping would decrease abandonment, and the results were astonishing!

They found that by offering free shipping, they increased their orders by an incredible 90%, and also increased their average order value considerably. Those are some pretty amazing results!

Electronic Arts decided to test a promotional offer for a pre-order of their new version of the SimCity game. They originally had a huge banner at the top of the screen offering $20 off the customer’s next purchase when they pre-ordered the game, assuming this would increase conversions, but what they found was exactly the opposite.

Their test revealed the variation with no promotional messaging actually drove 43.4% more sales! If they’d simply assumed the promotional offer would increase purchases, they would have lost a tremendous amount of money.

Express Watches (a UK-based watch retailer) added a “Seiko Authorized Dealer” to their product description pages to help boost buyer confidence that they are buying authentic brand-name watches. This boosted their conversions up to 107%!

ComScore decided to run a test with different variations of their testimonials in order to see which one got more attention and helped increase conversions the most. As you know, testimonials are great social proof. But the way those testimonials are presented can actually have dramatically different results.

ComScore found that using a vertical layout with the customer’s logo at the top increase conversions on product pages by 69% compared to their original version. Again, huge results!

As you can see from these few examples alone, split testing has extraordinary potential to increase your bottom line!

Conclusion

Split testing can be a little technical, but if you can create a website or blog—and you probably can since you’ve read this guide—it’s worth the little bit of effort it takes.

Even if you “only” manage to increase your conversions from 1% to 2%, you’ve doubled your conversions (income or leads) practically overnight! Not only is this beneficial to your own bottom line, but to any affiliates you might have, as well. No affiliate wants to send their hard-earned traffic, or even paid traffic, to a page that hasn’t been proven to convert well.

No matter what results you’re looking for—sales, email opt-ins, etc.—split testing can help you maximize those results.

And remember, you don’t have to do it all by hand. Split testing solutions like Split Test Monkey (http://www.splittestmonkey.com) make the job a quick and painless process, handling nearly every aspect of the process for you, while you just sit back and wait for the results!

Please don’t think that split testing is something reserved for the “big dogs”. Even if you only get a few hits per day, you can perform split testing. It may take a little longer to get the results you’re looking for, but it will still be worth it in the end!

Best of luck to you!