How do I create extra-thorough sets of tests?

This lesson explains how to generate a set of tests that is more thorough than a standard set of pairwise tests.

Hexawise creates a pairwise set of test cases

Whenever you click on the "Create Tests" button, Hexawise will create a 2-way (AKA "pairwise") set of test cases. That means that every possible pair of values will appear together in at least one of the test cases Hexawise generates.

Details on pairwise and higher coverage

To get a detailed explanation of the difference between less thorough 2-way (AKA "pairwise" or "all pairs") tests and more thorough 3-way tests click the link shown in the graphic.

Requesting the explanation will pull up a description like this:

Requesting the explanation will pull up a description like this:

Selecting x-way test coverage

Now that you're familiar with the differences between simple pairwise tests and more thorough 3-way (and higher) sets of tests, if you want to generate a more thorough set of tests, click on the "Create Tests" button, and...

Selecting 3-way coverage

Within seconds, Hexawise will generate a new set of tests that will ensure coverage of your new, higher, coverage strength.

In this example, you would need more than 4 times the tests needed for 2-way coverage in order to ensure that every 3-way combination of test conditions were all covered together in at least one test case.  How many more tests will be needed depends on the total number of parameters and parameter values.

The number of tests will continue to increase as you increase your coverage thoroughness requirements.

5-way coverage

5-way coverage - an extraordinarily thorough coverage level by any measure - would require 1,562 tests (of the 11,520 possible tests in this example)

Hexa is a Greek prefix meaning "6." That explains the name of our test design tool: Hexawise.

Hexawise generates testing coverage all the way up to spectacularly thorough 6-way coverage.

Realistically speaking, you would not ever want to execute complete 6-way sets of tests like these unless you were (a) automating the test execution, or (b) sending astronauts into space - or some other similar life and death testing objective. Speaking of sending people into space, it is interesting to note that NASA regularly uses this test case prioritization approach to scientifically prioritize the software tests they choose to execute in order to test their systems absolutely as thoroughly as possible with a manageable subset of test cases.

You will also notice mixed strength text coverage option.  That allows you to select higher coverage for the parameters that are most critical.