Glossary

Holdout group

A holdout group (or control group) is a random set of accounts deliberately left out of an intervention, so you can measure what the intervention changed by comparing outcomes.

Why use one

Without a comparison, a saved renewal could have renewed anyway. A holdout gives you the comparison: the same kind of accounts, at the same time, without the outreach.

Worked example

40 at-risk accounts get a playbook or outreach and 31 renew (77.5%). 16 similar accounts in the holdout stay on the normal process and 9 renew (56.3%). The difference, about 21 points, is the estimated effect of the outreach. (Example numbers. With groups this small, the result could still be chance.)

Doing it safely

See holdout measurement in Horizon.

Updated November 3, 2026

See which of your renewals are at risk.

A 30-minute call on a demo book, or on your own top 25 accounts.

Book a call