So What Are A/B Content Splits?

With A/B Content Splits, you can quickly compare multiple versions of a message’s content against each other in a way that lets your contacts choose the best performing option.

Setting Up A/B Content Splits

1. Compose two or more version of the same message and make minor changes to the areas of the message content you want to test.
2. Select the message you want to perform the A/B Content Split on.
3. Click Send A/B Split from the Message Overview Page.
4. Choose Full Message Content from the Split Content drop-down box.
5. Choose the type of split you want to perform and then designate split groups.
   • A/B Winner – A/B-Winner splits involve testing messages with two or more groups to see which is most effective. After a set period of time, a winner is chosen based off of preselected criteria, such as highest open rate or highest number of clicks. After the winner is selected, the winning message is sent to the remainder of your targeted contacts.

   

   • Champion/Challenger – Champion/Challenger is quite similar to A/B-Winner, the difference being that you don’t have a winner group. In this type of test you have an established way of doing something, called the Champion, and you want to test if it is still the best by introducing a Challenger. An example of this is testing a new template design or header image compared to your current standard. In creating a Champion/Challenger split, it is common to send most of your contacts the champion while setting aside a smaller portion for the challenger. Once the test is run, there is no winner group who receives a message, but you do have a good idea about whether or not your champion is as good as you thought it was.
6. Click Next.
7. The message you choose in step 2 will automatically be used for split group A. You will need to choose the alternate versions of the message you created using the message selector for the other split groups.
8. From here, you need to specify the sender options, verify the selections you have made, and then schedule the actual delivery.
9. Later on, you can view a report for that delivery that will show you which version of the message garnered the most favorable reception.

Important Things To Consider

With A/B Content Splits, remember not to get pulled into the trap of using two drastically different versions of a message. Rather, use this type of test to examine how simple design tweaks, such as order and positioning of links and images, affects the amount of clicks and conversions your message receives. You may be surprised to see how simple changes, like moving your call to action to the area of the message above the fold, will help drive clicks and conversions in your message.

Have you successfully implemented the A/B content split feature in Bronto? Please share your comments with us below.

John Gunther
Technical Writer/eLearning Specialist at Bronto

Related posts:

1. Challenging the Status Quo: Champion-Challenger A/B Splits We’ve talked about A/B splits a number of times –...
2. Can’t Decide On A Subject Line? Split ‘Em! Do you ever have a problem deciding between a...
3. Testing, Testing 1, 2, 3: Sending Test Messages As a Bronto user, you have probably been sending test...

An Updated Interface and Help
An intuitive and informative application can have a big impact on your workflow. We have been hard at work updating our interface to provide you more information, including new dashboard pages, faster responses, and more streamlined processes.

This isn’t just about the look and feel, but also how things work. Well we’ve oiled the hinges and added some more easy to use features, like slide out quick help and page overviews that walk you through the application when you need it.

Easy Email Client Testing
Your emails need to look right in every client, it’s that simple. We understand that and that’s why we are introducing an Inbox Preview tool right inside of our current message overview page. You will be able to see how perfectly your email looks in every client with the click of a button.

A/B Splits
Step your testing up a level and perform some A/B splits. Whether it’s a subject line test or two entirely different emails, you’ll be able to quickly and easily carry out the test. With detailed reports that clearly show lift, you’ll be loving them in no time.

Reporting Made Even Easier
That isn’t the end of our additions to reporting, we’ve got more for both web analytics and existing response data.

For web analytics we now support full integration with Omniture, which includes easy remailing to abandoned carts and more. Using a different web analytics package? No worries as we are also adding a easy tool which will integrate with whatever web analytics tool you use.

We’ve got even more than that, so stay tuned for more information as we approach the release.

Adam Covati
Product Manager at Bronto

Related posts:

1. Get Ready: The Bronto Fall 2009 Release You may have noticed Halloween displays at the local...
2. Check Out The Fall 2009 Release Bronto’s Fall 2009 is here! If you would like to...