How it's calculated
The likely range is a 95% confidence interval for the difference between the two renewal rates. With small groups it's wide: with the example figures it runs from about −6 to +49 points, so 16 holdout accounts can't yet rule out chance. Read more about holdout groups and how Horizon measures them.
Setting up a fair test
- Pick the holdout at random, before any outreach. Choosing it afterwards, or by hand, lets other differences between the groups creep in.
- Make the groups big enough to read. The range narrows as the groups grow. With 4 times as many accounts in each group (160 and 64) and the same renewal rates, the range would be about +7 to +35 points, clear of zero.
- Answer the obvious objection. A VP or CFO may ask whether you're letting at-risk accounts churn on purpose. The holdout still gets your normal process; it only skips the new outreach you're testing, and until you test it you don't know whether that outreach helps.
Embed this calculator
Free to use on your blog, wiki or community page. Paste this where you want it to appear:
<iframe src="https://renewalfix.com/embed/retention-lift-calculator/" title="Retention lift calculator by Horizon" width="100%" height="760" style="border:0;max-width:760px" loading="lazy"></iframe>
<p><a href="https://renewalfix.com/tools/retention-lift-calculator/">Retention lift calculator</a> by Horizon</p>
<script>addEventListener("message",function(e){if(e.origin!=="https://renewalfix.com"||!e.data||!e.data.horizonEmbedHeight)return;document.querySelectorAll("iframe").forEach(function(f){if(f.contentWindow===e.source)f.style.height=e.data.horizonEmbedHeight+"px"})})</script>More on this topic: renewals, definitions, guides and tools.
Updated November 3, 2026