Flaky Tests Break AI Agents That Rely on Test Signals

Flaky tests are a minor annoyance for humans but catastrophic for AI agents, which treat every test failure as a real defect. Humans filter flaky results using team folklore and context, but agents lack that out-of-band knowledge. Without a flake filter, agents waste effort on false positives or miss real bugs when instructed to ignore certain tests.