A/B Testing for Email

Christy Cook Updated by Christy Cook

Create an A/B Test

Before you create a new A/B test, be sure you've created the email you want to test. Next, find the email you want to create in either it's Campaign or in your list of all emails from the Emails Page. Click on the More Options menu (3 dots) next to the email you want to create the A/B test for and select A/B Test.

Once you've created a new A/B test, give it a "Name" and optional "Description".

Create the variants you want to test

  1. Next to email A from the Variants list, click on the More Options menu (3 dots) and select New Variant.
  1. Once the variants are created, next to each new variant email, select Design Email from the More Options menu to open the designer and make the changes you are testing. Repeat this for each variant you create.
Remember to decide beforehand a hypothesis you are trying to prove, try to only test one variable at a time for best success.

Configure A/B Test

You can configure how your email is tested and sent by choosing When scheduled or When used in an automation.

When scheduled
  • Determine the percentage of your audience you want to receive the variations (10%-50%).
  • Determine how long you want to wait between sending each variant (1 hour to 1 week).
  • Determine how to send the winning variation to the remainder of your audience.
    • highest click rate
    • highest open rate
    • lowest opt-out rate
When used in an automation
  • Determine how to randomize the variants (100-100,000).
  • Determine how to send the winning variant (click rate, open rate, opt-out).
To understand more about how automations work, see our guide for Autopilot.

Schedule A/B Test

If you chose the When scheduled option in the configuration section, you need to schedule your first email to be sent. The scheduler is the same email and text message scheduler you're used to and follows all of the same guidelines regarding selecting your segments, etc.

Track your results

To track your results, navigate to your A/B Tests tab in the associated Campaign or from your all A/B Tests pages found by going to Content>A/B Tests.

Resources to help you get started with A/B Testing:

How Did We Do?

A/B Testing Guide

A/B Testing for Texts

Contact