How to Detect Unwinnable Ad Experiments Before Launch

A developer shares a formula to compute the minimum detectable effect for A/B tests, showing that many inconclusive experiments were doomed from the start due to insufficient sample size. For a 3% conversion rate, detecting a 10% lift requires about 51,000 clicks per arm. The post also warns that real-world data violates independence assumptions, making standard power calculations optimistic.