Split testing is one of the most effective ways to figure out how to improve your website. You pit two variants against each other and wait for one of them to come out on top. It sounds simple enough โ especially when using Divi Leads โ but there are some all-too-common pitfalls youโll need to avoid in order to maximize its effectiveness.
In this article, weโll introduce you to the Divi Leads tool and discuss how it can help you run your split tests, then offer six ways to avoid ruining yours. We have a lot of ground to cover, so letโs get started!
- 1 What the Divi Leads Tool Is (And Why You Should Use It)
-
2
How Not to Ruin Your Divi Split Tests (In 6 Ways)
- 2.1 1. Wait Until You Have Enough Traffic
- 2.2 2. Measure the Right Elements in Your Tests
- 2.3 3. Let Your Split Tests Run Long Enough
- 2.4 4. Take Holidays Into Consideration for Your Results
- 2.5 5. Consider Running Your Split Tests Simultaneously
- 2.6 6. Donโt Discount Small Margins in Your Results
- 3 Conclusion
What the Divi Leads Tool Is (And Why You Should Use It)
Divi Leads is a powerful split testing tool built into the Divi theme. It can help you toย build an effective landing page, measure your portfolioโs effectiveness, and even master conversion design. All in all, it can be one of your staunchest allies while using WordPress โ if you know how to use it, and what mistakes to avoid.
Of course, you wonโt need to figure out how to integrate split testing tools into WordPress, nor make sure theyโre tracking your results accurately. As long as youโre a Divi user, the โbaked-inโ Divi Leads system shouldย offer you everything you need to get started.
Key Features:
- Set your goals and analyze your results using the Divi Builder.
- Create unlimited variations for your tests and measure almost any element.
- Assign custom goals (or hypotheses) for your tests.
- Receive in-depth (yet easy to understand) statistics for completed tests.
Now you know what Divi Leads is, itโs time to lookย at how to use it optimally.
How Not to Ruin Your Divi Split Tests (In 6 Ways)
Numbers donโt lie, but they can certainly misdirect you if you donโt know how to interpret what theyโre telling you. This section is all about correcting the human error factor in split testing, or better yet, avoiding it in the first place.
With that in mind, the information below doesnโt only apply to Divi Leads โ theyโre basic pitfalls that can occur in every split test, regardless of which tool youโre using. Letโs kick things off by talking about traffic.
1. ย Wait Until You Have Enough Traffic
Before you can begin to think about executing a successful split test, youโllย need to consider your traffic โ or rather, your lack thereof.
Successful split tests rely onย a constant and healthy influx of visitors, otherwise you may never get a sample size large enough to make your results worth considering. This also opens you up to the risk of having outside factors affect your tests, such as holidays (more of which later).
While thereโs no hard rule for what constitutes enough traffic, we can give you a pretty good estimate. If your site receives more than around 2,000 hits per month, you should be good to go. With those numbers, it should take you about a month run a statistically significant test (one that is roughly 85% accurate). Remember, you can always check how many impressions your test is getting by checking theย Divi Leadsย Readsย tab. That way, youโll be able to stay on top of your testโs performance as it runs.
If youโre still not at a point where your site is popular enough to run a test with a high level of confidence, you should probably work on building up your trafficย โ one method is to consider sources you havenโt yetย taken advantage of.
Finally, if your siteย doesย have enough traffic (but youโre concerned about its quality), consider whether you canย segment it so your split tests will only count the visitors you want towards your results. That way, youโll get accurate results for the demographic you want to target.
2. Measure the Right Elements in Your Tests
One of the most common Divi split test mistakes is measuring the wrong elements of your site. To put it another way, you may be looking for answers to the wrong questions.
Every winning split test starts with a hypothesis. For example, you might say to yourself The location of my call to action is affecting my conversions. This a perfect example of questioning the right element and coming up with a hypothesis that isnโt too broad for a single test to measure (such as trying out an entirely new variant of a page, for example).
The right question wonโt only lead you to more accurate results โย itโll also enable you to improve your site in a methodical fashion. After all, if your Call to Action (CTA) fails to produce significant results, you can start to question other elements, such as the font youโre using.
Given this, the next time youโre considering a new split test, think small. Go for the most noticeable elements on your page first since theyโre the most likely to have an impact on your conversions, then build upon your results in small increments. Divi Leads enables you to select any of the themeโsย modules as your targets, meaning every aspect of each page is fair game.
3. Let Your Split Tests Run Long Enough
As we mentioned, having enough traffic is paramount to a successful split test, and this mistake ties in perfectly. If you donโt let your tests run for long enough, itโll be impossible for you to collect significant results.
Letโs consider the example we touched upon earlier, with a website that receives roughly 2,000 hits per month. In some cases, you couldย see a variant pull ahead drastically at the beginning of the month, giving you a false outcome if you decide to end the test. That would (of course) be a mistake since, statistically speaking, your results might not yet be accurate.
Patience is key to running any split test, whether youโre dealing with a low number of visitors or a steady flow. To put it simply, you need to let each test run its course until you have a statistically significant result, which depends on your traffic. We recommend capping off your split tests at around aย month, although you mayย also want to let tests on high traffic sites run longer than that โ after all, it will lend more weight to yourย end results.
Whenever youโre ready to end the test, simplyย access the Divi Leads module from the Divi Builder, and click on theย End Split Test and Pick a Winnerย button.
4. Take Holidays Into Consideration for Your Results
As you might have guessed, split tests are all about timing. In fact, one of the most easily missed Divi split test mistakes is not to account for holidays during the planning stage.
If you have any experience with marketing, you should know that holidays affect how customersย behave. Depending on the date, they may be more or less prone to converting, and this can obviously have an impact on your results.
The question is, how much of an impact do they have? When it comes to Christmas, for example, a lot of sites can expect to see a healthy boost in their conversions, which is something they need to account for. After all, those users might behave differently than on other dates.
The key here is to either plan your tests around holiday seasons,ย or let them run long enough to giveย your results time to even out (so to speak).ย Either way, if youโre not confident about your results, Divi Leadsย doesnโt impose any restrictions when it comes to repeating tests. You can always go for round two if you think an outside factor skewed your results.
5. Consider Running Your Split Tests Simultaneously
One common fallacy when it comes to split testing is to think that you can only run one test at a time. Thereโsย plenty of debate about whether this is a good practice or not, but here are a couple of reasons why you may consider doing so:
- If your site seesย lowย traffic, this can enable you to get more data in a shorter amount of time.
- Depending on how many pages your site has, itโs entirely possible to run multiple split tests without having them affect each otherโs results.
The last point brings us to the issue at the core of the debate. The traditional school of thought says that if you have two variants of the same page, it may affect user behavior on other pages (where you may be running a different test).
The problem is, itโs hard to nail down this effect, particularly when your variants donโt implement any drastic changes. For example, if youโre testing two versions of a CTA, they arenโt likely to affect a test with multiple variants of a paragraph on another.
In short, if the variations of your tests arenโt wildly different, itโs probably safe for you to run multiple tests at the same time, as long as theyโre not all on the same page. Whatโs more, Divi Leads doesnโt limit you to a specific number of simultaneous tests, and theyโre easy to set up on different pages. If you arenโt doing so yet, you may be losing out on valuable data.
There is one caveat, though. If your site consists of just a landing page, then you probably shouldnโt run multiple tests. After all, variations within the same page may be more likely to affect conversions on different tests.
6. Donโt Discount Small Margins in Your Results
For the last of ourย Divi split test mistakes, youโll want to think small. To put it another way, donโt discount the small margins and gains in your results.
When it comes to split testing, you wonโt always get drastic results. Your tests may find winning variants with single figure percentage margins, which is perfectly fine. Think about it from a monetary standpoint โ even a two percent increase in conversions should be a cause for celebration. After all, itโll still relate to more money in your pocket.
If youโve done everything correctly thus far, you should be highly confident that your tests are delivering the goods. As long as you have enough traffic, formulate your hypothesis well, and consider your timing, your results should be accurate. If you want to check up on your results, you can always check out how your test is proceeding by accessing the Divi Leads module from within the Divi Builder. Inside, youโll find side-by-side statistics for both your variants.
To put it differently, even if your results donโt hold up over time, youโll still have accrued enough data to refine your hypotheses for future ones. After all, split testing is a marathon, not a race!
Conclusion
If youโre a Divi user, youโll appreciate how easy it is to set up multiple split tests and analyze their results using the Divi Leads module. Youโll simply need toย keep an eye out for the most common errors in split testing, then avoid them, and your results will be well worth the effort.
Letโs recap the six tips you need to consider when running a Divi split test:
- Wait until you have enough traffic for a significant result.
- Measure the right elements in your tests.
- Let your split tests run long enough.
- Take holidays into consideration for your results.
- Always run your split tests simultaneously.
- Donโt discount small margins in your results.
What do you think is the most critical element when it comes to getting split testing right? Share your thoughts with us in the comments section below!
Article image thumbnail by Graphic farm / shutterstock.com
Hi John.
Thanks for the great and detailed post ๐ !
But I have a question (perhaps stupid): may I use a cache plugin on a page with split tests?
I ask that, because that kind of tests are not a problem when you have a very little website but how do you manage it, when you become to get around 5 000 users or more (really more ;))?
TIA.
You’re welcome, Pierre! Drop us a message directly and we’ll do our best to help you out: https://www.elegantthemes.com/contact/.
I’m wondering if the A/B variations and reporting are consistent on a site-wide basis – which is to say, if I have two variations on a landing page as well as on a products page and the home page, will a visitor’s unique visit result in all “A” versions or all “B” versions across the site? Or might they be mixed? And along the same lines, can I test two different site-wide color schemes?
Hi Peter! It’s hard to say without knowing your exact setup, but you can contact us directly for more help: https://www.elegantthemes.com/contact/.
These are some great recommendations. Having a solid testing roadmap is key to optimizing your website. Good stuff John!
These are some great recommendations. Having a solid testing roadmap is key to optimizing your website. Good stuff John!
Thanks, Bem! ๐