Re^4: Testing my tests

in reply to Re^3: Testing my tests
in thread Testing my tests (mutation testing)

I am not sure why do you see the requirements paradoxical. You were the closest by far to what I was thinking and brought an excellent example. I've updated the original post with that and some further explanation.

And you are right this probably requires the full introspection of all the code.

Comment on Re^4: Testing my tests

Replies are listed 'Best First'.
Re^5: Testing my tests by LanX (Saint) on Feb 27, 2017 at 06:04 UTC
> the requirements paradoxical. because without further explanation it sounded like wanting tests that never fail or having test heuristics intelligent enough to make you unemployed. at least now I'm sure what your up to. Regarding your update, you can't avoid false positive tests. But like I said you can reduce the likelyhood of them drastically for a reasonable prize by bundling many random test vectors. Some my produce false positives, but hardly all of them. In our case (2,0) may be OK but (666,42) would not. Cheers Rolf _{(addicted to the Perl Programming Language and ☆☆☆☆ :) Je suis Charlie!}	[reply]

Replies are listed 'Best First'.

Re^5: Testing my tests
by LanX (Saint) on Feb 27, 2017 at 06:04 UTC

> the requirements paradoxical.

because without further explanation it sounded like

wanting tests that never fail
or having test heuristics intelligent enough to make you unemployed.

at least now I'm sure what your up to.

Regarding your update, you can't avoid false positive tests.

But like I said you can reduce the likelyhood of them drastically for a reasonable prize by bundling many random test vectors.

Some my produce false positives, but hardly all of them.

In our case (2,0) may be OK but (666,42) would not.

Cheers Rolf
_{(addicted to the Perl Programming Language and ☆☆☆☆ :)

Je suis Charlie!}

[reply]

In Section Seekers of Perl Wisdom