How do I see what specific combinations of test inputs are covered by a set of tests?
The Matrix Chart in the "Analysis" screen gives a combination-by-combination view of test coverage.
Keywords: Matrix Chart, matrix
Click on the "Analysis" button to use this feature
Understanding the Matrix
No, you're not Neo, but this is like having super powers.
Each square of the matrix chart represents a pair.
How to read the chart:
- Read the values listed across the top
- Read the values listed down the left side
- Find an intersection of two values (one from top and one from side)
- If it is green: the pair is covered.
- If it is red: the pair is not covered.
- If it is black: the pair is marked as invalid.
Slide your way to precise coverage!
The slider at the top allows you to visualize which pairs are covered with each test.
When you arrive at the Matrix Chart screen, you'll automatically see the chart cycle from Test 0 through Test n (the final test in your set). The slider will slide back to the test that achieves around 80% coverage.
Communicate your testing coverage precisely
With the Matrix Chart, communicating your testing coverage has been made even easier! Imagine a scenario where you have created some tests and your manager comes by and says, "Development is running behind, so we'll only have time to execute 2/3s of your tests before Go-Live. What will be missed?" You can easily respond with a slide like the one below:
Can I see 3-way and higher interactions?
At this time, the Matrix Chart only supports demonstrating the pairs that are covered with each test.