The Complete Guide to A/B Testing: Sample Size, Duration, and Significance
How to size an A/B test, set the right duration, and judge significance: sample size, MDE, full business cycles, fixed stopping rules, multiple-testing fixes.
Oct 8, 2026
How to size an A/B test, set the right duration, and judge significance: sample size, MDE, full business cycles, fixed stopping rules, multiple-testing fixes.
Search ROI is hard to measure: a three-layer usage-quality-revenue measurement, contribution vs incremental conversion, an ROI formula, and four misjudgments.
Conversion rate down: diagnose first - confirm measurement, break down traffic and funnel, check trust and friction, then pinpoint the page and action.
Funnel analysis gives a conclusion, not a chart: where and why drop-off happens. Learn 3 funnel decisions, the drill-down to find loss, and 3 common pitfalls.
Recommendation placement design: pick the page, content, and attention share. Match each slot to page intent and measure cannibalization to confirm real gains.
How to design a membership program? Set the goal first, then structure: points drive behavior, tiers segment users, benefits deliver value, each owning one job.
Landing page optimization comes down to 12 elements: a hero that states value fast, proof that removes doubt, low-friction forms, and one clear primary CTA.
How to calculate search conversion rate: fix the numerator and denominator, read usage, zero-result rate and top-result CTR, then improve recall and ranking.
Traffic is up but orders are not. This CRO guide shows how to define the metric, find the top funnel leak, fix trust, friction and motivation, then A/B test.
Most 'not significant' A/B results are design flaws, not weak creative. 2026 data: low-power tests replicate at only ~28.4%; ~74.2% show no difference.
WeCom