The Phantom Conversion

A/B test shows treatment beating control by a 16% relative lift. Engineering wants to ship immediately. But the experiment ran for 30 days and something feels off — the numbers are too clean. Before you declare victory, check who was actually in each arm.