Zaymo's in-template A/B test lets you test the interactive version against a control with just the click of a button.

Unlike an A/B test in Klaviyo where you create two different email templates, a Zaymo A/B test runs inside of a single email template--no split in a flow or A/B test in a campaign required. The Zaymo email template is smart and will randomly show the non-interactive version to 50% of the population.

The results of the A/B test are shown in Zaymo's analytics page.

Why use a Zaymo A/B test?

1. Engagement data - Zaymo A/B tests track in-email engagement. Klaviyo can only track link clicks

2. Ease of use - The test happens within a single template. No need to set up separate messages in Klaviyo

How do I choose the control and treatment content?

A/B tests test the incremental change from changing one variable, so they require both a control and a treatment version.

Control email in the A/B test

The control in this test is simply the fallback version of the email. At the moment, you cannot edit the fallback version of the email in Zaymo. Instead, the fallback version of the email is the original template you import from Klaviyo.

Treatment email in the A/B test

The treatment version of the email is the email you built with the Zaymo block.

How do I set up the A/B test?

Setup

When you click Export in the Zaymo template previewer, you will be shown the export modal. In this modal, select Export as Zaymo A/B test.

Choose the relevant conversion metrics you want Zaymo to track during the test. Then, click Export. You're ready to go!

How do I measure the results?

Choose relevant conversion metrics

Zaymo can only track the Klaviyo metrics you choose before exporting. So, think carefully about the metrics that are relevant to the email your are sending. Zaymo will recommend some default metrics depending on the blocks used, but it is ultimately up to you to make sure the metrics are relevant.

See results in Zaymo analytics dashboard

Once the email is live in Klaviyo, you can track the outcome in the message analytics page.

You can identify an email as part of an A/B test by checking the analytics page. Next to the template title, a test tube icon labeled "A/B" indicates that an A/B test is currently active for this email. How to view which version won the test?

How do I turn off Zaymo A/B tests?

Zaymo A/B tests cannot be turned off from in Zaymo. Instead, simply re-export the same template from Zaymo without selecting Export as Zaymo A/B test.