Keep track of the volume of prospects you reach out to when A/B testing in your sequences. As prospects move through a sequence step with an A/B test in it, Outreach randomly (but evenly) sends out a template to these prospects. For example: In an A/B test using 2 templates, your data will become valuable after at least 150 prospects have passed through the step, this is when the model starts learning; therefore, Outreach recommends applying 100-150 prospects per template for a total of 200 to 300 data points. Any less than this will not allow you to see enough relevant data to make an informed decision on the quality of the message.
A/B test where you want to improve
Because of how little effort goes into creating A/B tests for various message types, we recommend customers do it often and across all types of sequences. Constant testing and refining will lead to a deep understanding of your customers and the best language to address them going forward.
Test either the open rate OR reply rate, but NOT both at the same time
You should only test open rate OR reply rate at one time to ensure you are getting the purest results.
The open rate of your email will correspond with the subject line. We recommend starting by A/B testing the open rate of your first email by changing the subject lines and leaving the body of the email the same. The reply rate will correspond with the body of the email.
Don't test too many templates at once
If you are adding too many templates to your A/B test, it will take much longer to get valuable data and users run the risk of losing valuable analytic data.