How To Run A/B Tests

This support article is out of date - please click here to read about our new A/B testing framework!

A/B testing, also known as split testing, is when two different versions of an email are compared with each other. One version is the A variant and the other is the B variant. The winning version is typically determined by a higher conversion/purchase rate.

Test just about anything - from the timing of emails (e.g. 30 days after purchase vs. 50 days after purchase), subject lines, reward amounts (e.g. 10% discount vs. 30% discount), email templates, as well as conditions such as the purchase amount, whether a customer has purchased or not, life time value and more.

There are only three steps to start running A/B tests in Remarkety.

1. Determine what you want to test. Only test one thing at a time because if you test multiple things, it becomes hard to figure out why one variant performed better than another. For example, don't test both the subject line and send time together.
2. Create two campaigns. Ensure both campaigns are identical to start. You can do that by creating one campaign and then duplicating it. Then adjust the segmentation or subject line you want to test.
3. In the segmentation drop down, select 'A/B testing segment'. For each campaign enable the A/B testing feature and select “A” for one campaign and “B” for the other campaign.

Watch The How-To Video Here.

Note: each of these campaigns will be applied to half of your customers so it is a 50/50 split.