Run multiple versions of a prompt against each other to see which one performs best. This guide walks you through setting a custom goal, building variations, allocating traffic, and launching your experiment.

Available to all customers on any Recurly Engage subscription plan

1Definition 2Key benefits 3Key details

Prerequisites

You must have Company or App Administrator permissions in Recurly Engage.

Limitations

At least one prompt must exist in draft or review status before you can create an experiment.

Definition

An experiment runs multiple versions (variations) of a prompt against each other — optionally including a control group — to measure performance against custom goals and decide which version to deploy.

Key benefits

Data-driven decisions Use real user interactions to choose the most effective prompt variant.

Controlled testing Isolate a single change — copy, design, or trigger — to understand its impact.

Seamless rollout Promote the winning variation automatically when the experiment completes.

Key details

Guide

Experiments follow these steps.

Add a custom goal (optional)

Define what success looks like — a click or a purchase, for example — before creating variations.

Add a tracker

In Recurly Engage, go to Settings > Usage Tracker and add a new tracker.

Attach the goal to your prompt

Return to your prompt and attach the custom goal under Goals.

Create the experiment

Start a new experiment

Open your prompt and click + New experiment.

Name your experiment

Give it a clear name — see the overview on experiments for naming best practices.

Configure variations

Default setup: your experiment starts with the Original prompt. If you added a custom goal, you can also include a Control group to measure the impact of showing the prompt versus hiding it.

Add a variation: click Add variation, name it to reflect the change (for example, "New headline"), and modify one or more aspects — text, design, triggers, or actions.

Use the editor to scroll down and adjust settings as needed.

Allocate traffic

Set the percentage of users who see each variation — make sure the total adds up to 100%.

Launch and monitor

Start the experiment

Click Start experiment and confirm.

Monitor performance

Click-through and conversion rates update in real time, within minutes depending on traffic.

Deploy the winner

When you're ready, click Use This on the winning variation to replace the control and end the experiment.

That's it — your experiment is live, and you can review the results to make data-driven optimizations to your prompts.