Website personalization performance

Once you’ve added a campaign goal (or goals) to a website personalization campaign, RightMessage will automatically A/B test personalized content against the control, or default, content.

If you haven’t yet set up campaign goals, head over to our guide on it and get those set up. Without goals in place, there’s nothing to report on.

Understanding how we A/B test personalization campaigns

By default, new personalization campaigns with an attached campaign goal are tested as follows:

• 90% of traffic will have the campaign attempt to personalize content.
• 10% of traffic will be “held back” and treated as the control group.

Regardless of whether a campaign is personalizing content, RightMessage will capture segmentation and event conversion information. This allows us to compare and contrast not only how the control group converts relative to the personalized group, but also how each segment within these groups convert relative to each other.

In short, you’ll be able to see how each segment converts compared to other segments, and overall stats on how effective personalization is for your business.

Selecting a campaign and, optionally, a goal

On the Dashboard, click the top right card – Conversion Rate Lift.

Ensure the time window for this campaign is set to reflect the window you want to report on. (By default, it’s the last 7 days.)

Your personalization vs. control conversion rate

This will view give you an overall understanding of how personalization is performing across all of your campaigns, along with which campaign is currently the front-runner.

In the (Drill down to a campaign) dropdown, select the campaign you’d like to dig into. You’ll now see an overall conversion rate for this campaign.

Comparing and contrasting segment performance

You can now drill down even further by selecting a campaign goal in the (Drill down to a goal) dropdown.

This will give you an overall comparison of all the various segments within the Segment Group that the campaign targets, along with how control groups (grey) compare to personalized groups (pink).