A/B Test Statistical Significance: What It Really Means (And When to Stop a Test)
Stopping a test the moment p < 0.05 hits is the most expensive mistake in conversion optimization. Here's what significance actually means.
Stopping a test the moment p < 0.05 hits is the most expensive mistake in conversion optimization. Here's what significance actually means.
Variance and standard deviation measure the same thing — but only one is in the units you actually want. Here's how to know which to report.
Z-scores tell you how unusual a data point is. P-values tell you how unusual a result is. Here's how both work in plain English.
Surveying 100 people gives you a ±10% margin of error. 1,000 gets you to ±3%. Here's the math behind sample size — and why bigger isn't always worth it.
Correlation tells you if two variables move together. Regression tells you how much one moves when the other does. Here's how to choose.
Frequentist tests give you p-values. Bayesian tests give you 'probability B beats A.' Here's why most modern CRO teams are switching.