Sample Ratio Mismatch (SRM) occurs when observed allocation diverges from the intended split. Test your ability to detect causes and fix them fast.
SRM is most commonly detected with a ______ test comparing observed vs expected bucket sizes.
t-test on means
chi-square goodness-of-fit
ANOVA on medians
Jarque–Bera on skew
A frequent root cause of SRM is applying eligibility filters ______ assignment.
after
never
before
only in staging
Client-side randomization can suffer SRM if bots or ad-blockers ______ tracking events.
suppress
resize
compress
encrypt
Hash-based bucketing requires a stable ______ per randomization unit.
favicon
identifier
sprite
viewport
Caching or CDN rules can cause SRM when they ______ pages for one variant.
prettify
beautify
gzip
over-serve or pin
The quickest diagnostic is a live ______ chart of incoming assignments by bucket.
allocation
heat
sankey
treemap
Counting only converters when checking SRM is wrong; measure on ______ events.
exposure/assignment
sessions only
bounces only
revenue only
Geo or device gates must be mirrored ______ to avoid uneven bucket drops.
in QA only
in CDN only
both client and server
in CSS only
When SRM appears, the safest course is usually to ______ the test and fix instrumentation.
ignore
declare a winner
pause
increase traffic
A long-tailed bot surge can mimic SRM; cross-check with ______ metrics for anomalies.
image DPI
CSS z-index
traffic quality
font weights
Starter
New to sample ratio mismatch troubleshooting? Review the basics and try a few small, low-risk tests.
Solid
Good grasp of sample ratio mismatch troubleshooting. Tighten design choices and deepen your analysis habits.
Expert!
Excellent command of sample ratio mismatch troubleshooting. You are ready for scaled rollouts and mentoring others.
