Skip to help content
RightMessage

Reporting and experiment questions

Find answers when your report numbers don't match, data is missing, or you're unsure what a conversion or test tells you.

Updated

View as Markdown

These answers help you choose the right measurement and make sense of the numbers you see. Start with the action you want visitors to take, then check the report's dates, audience, and counting rules.

How do I measure the conversion I care about?

Use form or offer reporting for a RightMessage submission or CTA click. For a page view, click, or form submission on your website, use a conversion goal. Attach that goal to a website campaign when you want to measure the campaign against it. Campaign results require Scale or Pro.

A page view, a recorded flow ending, and an email-platform update measure different actions. None automatically confirms a purchase or booked appointment in another system. See how your flow is doing before adding more experiments.

Is showing different content to each audience an A/B test?

No. A targeted variant shows content based on a visitor's conditions or answers. Those audiences can have different conversion rates before you change anything.

A resource split test assigns visitors to versions for comparison. A website campaign's holdback compares personalized content with the original page. See resource split-test reporting and campaign experiment decisions for their different measurement rules.

How do I compare personalization with the original page?

Use the campaign's Split Tests settings to set its original-content holdback and attach the goals you want to measure. Read the campaign's evidence status rather than choosing whichever version shows the largest lift.

A baseline of similar visitors isn't the same as a randomized holdback. If a report uses a prior unchanged experiment or a descriptive reference, read the explanation beside the comparison.

Can confidence change after reaching 95%?

Yes. A running resource split test's confidence can change as new observations arrive. Reaching 95% once doesn't guarantee how the test will end or how that version will perform in the future. Split-test statistical details require Pro.

Campaign experiments use a separate decision system with evidence windows and decision checks. Don't judge them by looking for the old 95% confidence panel. The split-test reference covers active and completed resource reports.

Where can I find completed tests?

Open A/B Testing and set Status to Completed for question, form, offer, or flow tests. Completed tests keep a reporting snapshot. If you manually kept a version, that records your choice rather than declaring a statistical winner.

For campaign verdicts, open the campaign's reporting and testing information. Campaign verdicts use different rules from question-test confidence, and not every test has a statistical-power control.

Why do two dashboard sections show different numbers?

They may use different dates, include different activity, or count different things. The dashboard picker changes Activity and Working, while saved summaries and recommendations keep their own evidence dates. All-time Contacts with answers differs from selected-period Contacts synced.

Daily visitor counts, channel visitors, and page visitors can overlap. Adding them won't necessarily give you the period's unique visitor total. See the dashboard reporting windows and website stats counting rules.

Why can't I see visitor data or an AI summary?

Your access, the activity RightMessage captured, and the report's loading state all affect what you can see. A visitor can remain anonymous while their answers are recorded. A summary can still be generating or unavailable while individual measurements are ready.

An unavailable metric isn't zero. Older snippets can lack events a newer report needs. Follow the report's coverage notice and check tracking after you publish. A missing summary alone doesn't tell you why data is missing.

Does website attribution update my email platform too?

Contact attribution depends on visitor identification and the supported attribution fields or actions you've configured for your connected platform. Website reports describe the visits and conversions RightMessage captured.

To confirm a field, tag, or list update, check the contact in your email platform. Lead attribution explains the setup, and checking an integration change walks through that test.

Is an answer the same as a segment or synced field?

No. A response records what someone submitted. A segment describes membership based on an answer or rule. A synced field is data sent to an identified contact in your email platform.

Typed answers don't automatically create a segment for each value. A visible response also doesn't confirm that RightMessage identified the visitor or that your platform accepted an update. See visitors, responses, segments, and contact fields.

Can I export responses, and how long are they kept?

You can use response or flow-table exports when your project has export access. Filtering, exporting, and deleting responses explains the options.

Reports don't necessarily keep unlimited history. Use their covered dates and your account's data controls. If you need a specific retention guarantee, confirm it with support before relying on RightMessage as your only archive.

Still need a hand?

Tell us what you’re trying to do and where you’re getting stuck.

support@rightmessage.com