18. Tip: Manage regression tests at the "model level" to save time and avoid ever-increasing numbers of tests
Managing test models is often much easier and faster than managing individual tests. This lesson explains some of the benefits and limitations of managing tests at the model level.
Imagine these were your test inputs before a new system release
From release-to-release, functionality of systems will change.
The next release will bring multiple changes to the System Under Test:
If you're managing tests individually, you face 3 problems:
Using Hexawise solves all 3 of these problems within a few seconds!
Even though there are more than 10,00 possible additional tests in Release 8, Hexawise only requires 3 more test to achieve pairwise coverage
And check out what happens to required tests and total possible tests if Release 9 adds a few new features...
Limitations to be aware of
Optimized test generation tools like Hexawise will create entirely new test sets each time you modify test inputs. You'll have entirely new tests for each release. That can cause problems if you need to spend a significant amount of time to redefine your Expected Results for each and every (brand new) test in every release.
For that reason, you should strongly consider using the Auto-Scripts feature of Hexawise and systematically-generate Expected Results.
Explore this concept of maintaining regression tests at the "model level" in more detail with free access to the interactive sample plans for Release 7, Release 8, and Release 9 discussed above
You can create an account at hexawise.com/free. (While some restrictions apply, that will grant you free access to the Hexawise test design tool).
Open your Hexawise account, then cut and paste this URL into your browser: https://app.hexawise.com/share/EU4EW3WZ Doing so will automatically add the three sets of tests mentioned above into your account. Feel free to modify them and explore Hexawise!