Dev Tools · 1h ago
MCP server had 32 green tests that never actually tested anything
An open-source Safari MCP tool had 32 passing tests, but none verified that calling a tool actually worked. The tests only checked tool existence and schema validity, missing critical security boundaries like tab ownership. The developer realized the green suite gave false confidence, as a regression in security logic would not have been caught.
Meridian48 take
This is a cautionary tale about test coverage that looks good on paper but misses the real risks—a common pitfall in developer tools where integration testing is neglected.
Read the full reporting
My MCP server had 32 green tests. Not one of them had ever called a tool. →
DEV Community
testingsecurity