Test result management

After a few long days and even longer nights we have finally released the Test Result Management functionality.

This major update in functionality allows you to record the results of your testing back into e-LM.com including screenshots or output captures. e-LM.com also automatically tracks the time that it takes you to complete the testing. This information can then be used in planning future test-runs.

Create a new test-run

To start a new test-run navigate to the View Project page for the particular project that you want to do some testing for. Scroll down the page to the Test-runs section. Click on the New buttonCreate a new test-run button.

This will open a pop-up dialog where you can enter a Short Name and a Description for the new test-run, select the initial state of the test-run and select which test-cases to include in the test-run. Normally you would leave the initial state as "New". Finally click on the Create test-run button.

View the new test-run

The new test-run will appear in the Test-runs section of the project view page. Click on the name of the new test-run to go to the View Test-run page.

You will see the details of the new test-run including all of the test-cases that you selected to include in this test-run. These test-case results are actually copies of the original test-cases including all the attachments and comments. If the original test-case is changed then these copies will not be affected.

Click on the reference for one of the test-case results. You will see all of the details copied across from the original test-case. There is also a link to the original if you wanted to refer back to that. All of the test-steps from the test-case has also been copied over and are displayed in the Test step results section.

Start testing

Navigate to the test-case result that you want to start testing on first and scroll down to the Test step results section. Click on the Start buttonStart test step result button for the first test-step result in the list. This will set the state for the test-step result to "Started" and will set the clock ticking to measure how long the testing takes.

Notice that as soon as you started the test-step result the test-case result and the test-run states also changed to "Started".

Pause testing

Sometimes in testing you have to kick off a process, leave it for a while and then come back to it a while later. During this pause in the testing you can spend your time on other things or even other testing. This can be captured in e-LM.com by click on the Pause buttonPause button for the test step result that you are waiting on. If no other test step results are still in a "Started" state then the test-case result is paused automatically. Similarly for the test-run.

Duration and Effort

Periods that a test step result is paused counts toward to total Duration of the test step result but not towards the Effort. These counters are added up to determine the overall Duration and Effort for test-case results and ultimately for the test-run. These results help when planning future test-runs to determine the effort and probable duration of those test-runs.

The test results are also visible from the test-case and test step views. The View test-case page for example lists all of the test-case results for that test-case showing the outcome of each of the tests as well as the duration and effort for those tests.

Pass or Fail

Once you have completed a particular test step you can record the result by clicking on the Pass buttonPass or the Fail buttonFail buttons. If you click on the Fail button you can also enter the Actual Outcome of the testing as feedback to the developers.

When you pass or fail a test step result you will notice that the test-case result is automatically updated to show the overall Progress (% of test steps completed) and Passrate (% of test steps that passed) for that test-case result. This is also reflected in the Test Velocity chart.

Test Velocity Chart

Test velocity chartThe Test velocity chart shows the progress of testing over time including progress, passrate and during which periods testing was active.

The image on the right shows an example Test velocity chart.

The areas with the gray background shows periods during which the testing was active (i.e. at least on test was in the "Started" state). The red areas shows the progress of testing as a percentage of tests completed and the green area shows the passrate as a percentage of tests that have been completed successfully.

Conclusion

The Test results management module makes it so much easier to track and capture the results of your testing effort. These results can then be used to make the necessary fixes and to predict the effort and duration of future testing.

This was just an introduction to the functionality available in the Test results management module so log in and give it a whirl. There is online help available from all of the pages and dialogs but if you get stuck just give us a shout.

About the Author

Leave a Comment