CRO

Sample Ratio Mismatch

Definition

A validity problem in A/B tests where traffic is not split in the expected ratio between variants — for example, a 50/50 test where one variant receives 47% and the other 53% of traffic. SRM typically signals a technical implementation problem: a flickering element, bot traffic imbalance, or incorrect trigger logic. Any test with SRM should be invalidated and rerun, as the results are statistically unreliable regardless of what the conversion data shows.

How Sample Ratio Mismatch works in practice

Sample Ratio Mismatch matters most when teams are trying to make better decisions around landing page clarity, conversion friction, trust, and user decision-making. The short definition gives the surface meaning, but the practical value comes from knowing when this concept should actually influence strategy and when it should not.

In real-world work, Sample Ratio Mismatch is rarely important on its own. It usually becomes useful when paired with cleaner measurement, stronger page or funnel structure, and a clear understanding of what business outcome needs to improve. It is closely connected to A/B Testing, Statistical Significance, Multivariate Testing because those concepts usually shape how Sample Ratio Mismatch is measured or applied in practice.

A good way to use Sample Ratio Mismatch is to treat it as a decision aid rather than a vanity number. If it helps explain why performance is improving, stalling, or getting more expensive, it is useful. If it is being tracked without any operational consequence, it is probably being overvalued.

Your digital consultant

Hi, I'm Wameq.

If traffic is coming in but conversions aren't, the page is doing something wrong — I can tell you what.

Let's talk →
Why this matters

This term sits in the CRO category, which means it is most useful when evaluating landing page clarity, conversion friction, trust, and user decision-making. The goal is not to memorize the label. The goal is to know when it should change a decision, a page, a campaign, or a measurement setup.