Setting Up A/B Split Testing

Check with support to see if this feature is enabled for your account. Some features may not be visible or available in your account.

A/B testing allows you to send 2 test variations of an email campaign to part of your target audience
then the winning variation is automatically sent to the rest of the target audience.

You can vary email campaigns using from address, subject lines, email content and delivery date & time.

You choose the winning criteria to be either opens or clicks.

• Go to Email Campaigns on the main navigation menu.
• Click on the Add Email Campaign icon
When creating the campaign, check the box to turn on A/B split testing for that campaign.

Below we have only outlined the differences in the Easy Email Studio when selecting to use A/B testing.
Go here for the complete Email Studio steps.

When using different From Address:
• In Step 1 – Design select the  From Address for the variable to test.
• In Step 2 – Content choose a subject line for From Address (Variation A) and From Address (Variation B)

When using different Subject Line:
• In Step 1 – Design select the Subject Line for the variable to test.
• In Step 2 – Content choose a subject line for Subject (Variation A) and Subject (Variation B)

When using different Content:
• In Step 1 – Design select Content for the variable to test.
– If you want to use the same design Template or Email for all variations select Use the same design for all Variations
– If you do not select the same design Template or Email you will have 2 tabs to switch between templates for Variation A and Variation B.
• In Step 2 – Content
– You will have 2 tabs to switch between content for Variation A and Variation B.

When using different Date & Time:
In Step 1 – Design select Delivery Date/Time for the variable to test.
In Step 4 – Schedule – Select a date and time for Variation A and Variation B.

For all  A/B Tests

In Step 3 – Contacts select which lists or lists you want to send your email campaign to. Then, under A/B Split Size select the test group sizes.
In Step 4 – Schedule pick a time and date to send your email.
a. Select how many days and/or hours the winner will be determined after the variation is sent.
b. Select how the winner will be determined with the highest percent of Clicks (clicks out of unique opens) OR Opens (percent of unique opens out of emails received).

After completing the Email Studio you can track the A/B test in the Email Campaign List and in Reports

In the Email Campaign List:

After you schedule your A/B test you will see it as Scheduled with the A/B icon indicator.
Hover your mouse over the A/B icon indicator to get additional information on the status of your A/B test.
Once both variations are sent, but not the winner, the status will change to Waiting On Winner.
Once the winner is sent, select the A/B icon to show information about each variation and the A/B winner.
The winner is indicated with a green badge.

In Reports:

After both variations are sent, but not the winner, your A/B email campaign will appear in Reports with the Waiting On Winner status.
Select the A/B icon to toggle information about each variation. A blank Sent Date indicates a variation has not been sent yet.
Once the winner is sent, select the A/B icon to show information about each variation and the A/B winner.
The winner is indicated with a green badge.

Was this article helpful?