Skip to main content

How to perform email campaign A/B testing?

A/B testing to compare different versions of email subjects and previews to improve email performance

A/B testing compares variants of an email campaign. Use it to test subject lines and preview text while keeping the message content consistent. You can also choose a verified sender and From name for an alternate variant.

Prepare the draft

  1. Open an unsent campaign in Email Campaigns.

  2. Save the target audience in Audience.

  3. Choose a verified email address in Sender.

  4. In Message, enter the main subject and preview text. Select Save and continue.

A subject and verified From address are required before A/B testing can be enabled.

Configure A/B testing

  1. Open the Testing step and enable A/B testing.

  2. Set the Test audience percentage. This is the share of the target audience that receives the test variants. Where available, Absolute lets you enter an exact count instead.

  3. Set Wait time before full send (hours). Use at least one hour. This is the time to collect opens before sending the winning version to the remainder.

  4. Review Variant A. It follows the campaign's main sender, subject, and preview text; change those in the main steps.

  5. Enter the alternate subject and preview text in Variant B. Its sender must also be a verified address.

  6. Use the variant's Merge Fields controls if you want personalization. Select Add Variant for more alternatives.

  7. Select Save and continue. Reload the draft and reopen Testing to check that the settings remain saved.

A/B testing and a manual test batch are separate sending modes. Enabling one switches away from the other. Saving a draft does not send the campaign.

How the winner is chosen

After an actual A/B test and its configured wait, Raise More chooses a winner using the open metrics available for that test and applies the winning settings to the remaining send. Tests using the newer open-status counters use Opened rate; older tests use total opens. A tied score keeps the first variant in creation order.

A draft has no test results or winner. When you are ready to send, complete the other campaign steps and follow the send or schedule guide.

Make the comparison useful

Change one thing at a time, keep subjects concise, and use preview text to add context. Leave enough room for resolved merge-field values. Review the audience size and results before applying lessons from a small test to future campaigns.

Did this answer your question?