Retest failed automated tests - Klaros Test Management - Forum - Klaros Test Management
Retest failed automated tests
Michael Dietrich-Spitzley, modified 7 Years ago.
Retest failed automated tests
Youngling Posts: 2 Join Date: 7/7/16 Recent Posts
Hi,
we plan the following process:
Kind regards,
Michael
we plan the following process:
- automated testresults are added using the REST-Intervace
- failed tests shall be retested manually
- We found no (efficient) way to find all failed automated tests within a job or a testsuite over all SUTs
- When a testcase is marked as "automated", the teststeps are deactivated
Kind regards,
Michael
Torsten Stolpmann, modified 7 Years ago.
RE: Retest failed automated tests
Jedi Council Member Posts: 755 Join Date: 2/12/09 Recent Posts
Hi Michael,
you should find the failed test case results in the results tab of the job or test suite in question. If there are too many objects to check for you this way, you may also have a look at the iteration you are currently working in.
If you are choosing to rerun your automated tests manually, there are basically two options available for you:
1. Switch the test case to manual mode
Switch the test case to Manual and execute the test using the manual test runner. When done, switch back to automated mode.
This is the simplest method to resolve this. Manual test results will show up like the previous automated test results in the result history.
2. Use a different revision of your test case
If a previous, manual revision of your test case exists (typically just before you have automated your test case), you may execute this revision instead. You may also choose to create a new, manual revision of your test case, especially if no such previous revision exists. Please note that each revision keeps a different set of test results, so you may have to take care of which revision you are looking at during evaluation.
The second method may leave a larger footprint in your system (a new revision is now possibly available), so I would recommend solution 1, especially when the manual retest is only a temporary solution.
All methods may require to add manual test steps to the test case. This indeed is only possible, when execution mode is set to manual. This page has been disabled intentionally in automated mode to not confuse the typical users of automated tests.
Kind regards,
Torsten
you should find the failed test case results in the results tab of the job or test suite in question. If there are too many objects to check for you this way, you may also have a look at the iteration you are currently working in.
If you are choosing to rerun your automated tests manually, there are basically two options available for you:
1. Switch the test case to manual mode
Switch the test case to Manual and execute the test using the manual test runner. When done, switch back to automated mode.
This is the simplest method to resolve this. Manual test results will show up like the previous automated test results in the result history.
2. Use a different revision of your test case
If a previous, manual revision of your test case exists (typically just before you have automated your test case), you may execute this revision instead. You may also choose to create a new, manual revision of your test case, especially if no such previous revision exists. Please note that each revision keeps a different set of test results, so you may have to take care of which revision you are looking at during evaluation.
The second method may leave a larger footprint in your system (a new revision is now possibly available), so I would recommend solution 1, especially when the manual retest is only a temporary solution.
All methods may require to add manual test steps to the test case. This indeed is only possible, when execution mode is set to manual. This page has been disabled intentionally in automated mode to not confuse the typical users of automated tests.
Kind regards,
Torsten
Michael Dietrich-Spitzley, modified 7 Years ago.
RE: Retest failed automated tests (Answer)
Youngling Posts: 2 Join Date: 7/7/16 Recent Posts
Hi Torsten,
thanks for quick reply.
I also prefer the first variant, but it is connected to a lot of manual administration effort. Is there a switch or something like this available to configure the behavior?
Of course, automated tests should not appear during a testrun. But for retesting purpose it should be possible to see the teststeps and add/update results for the current testrun.
Kind regards,
Michael
thanks for quick reply.
I also prefer the first variant, but it is connected to a lot of manual administration effort. Is there a switch or something like this available to configure the behavior?
Of course, automated tests should not appear during a testrun. But for retesting purpose it should be possible to see the teststeps and add/update results for the current testrun.
Kind regards,
Michael