|Perl Monk, Perl Meditation|
Re^2: Test/ Code Ratioby BrowserUk (Pope)
|on Jan 28, 2005 at 16:24 UTC||Need Help??|
And that I think, for all the words I have written (but not yet published) attempting to explain my distaste for the Test::* modules, this is the crux of that distaste.
Test::Harness, and many of the others, tend to emphasis quantity over quality.
They also put the emphasis on percentage passed, rather than what failed.
Those two factors tend to combine to encourage the writing of lots of little tests, and ignore the effect of duplicate tests--"Hey, you can never have enough testing!".
The result is that the one failing test is swamped in the high volume of (often duplicate) tests passed.
So the headline is a feel-good "99.98% passed" rather than the realistic and crucial "1 test failed".
Testing is a bit like condoms...99.98% safe isn't any comfort when the 0.02% happens.
Examine what is said, not who speaks.
Silence betokens consent.
Love the truth but pardon error.