An A/B test sends different versions of a campaign to a test audience, measures the response, and identifies a winning version. A/B testing requires Kelune CRM Pro.
Create and save the campaign first, then open its A/B test configuration.
Configure the test
- Enable A/B Testing.
- Choose the Winner Selection Metric: Open Rate or Click Rate.
- Set the Test Sample Size between 10% and 100%.
- Set the Winner Wait period in hours.
- Add one or more test variants.
Choose Open Rate when you are primarily testing the subject line or sender name. Choose Click Rate when the meaningful difference is in the email content or call to action.
Create each variant
Give the variant a short label, then choose its Test Type:
- Subject Line changes the subject only.
- Email Content changes the body of the message.
- From Name changes the displayed sender name.
- Full Email changes the subject and content.
Set the variant’s share of the test sample. The original campaign receives the remaining share, so check that the allocation produces the comparison you intend.
Understand the sample and winner
The test sample receives the original and variant messages according to their assigned shares. After the winner wait period, Kelune CRM compares the selected metric and can send the winning version to the remainder of the campaign audience.
If the test sample is 100%, the entire audience is used for the comparison and no remainder is left to receive the winner. Use a smaller sample when the purpose is to optimize delivery to the rest of the audience.
Start and monitor the test
Preview and test-send every version before activating the campaign. Confirm that the subject, sender, links, content, and sample allocation are correct.
Once sending starts, the test configuration becomes read-only. Use the campaign analytics to compare the original and variants. When the test state permits it, you can also use the manual winner action instead of waiting for automatic selection.