Error handling settings allow users to specify behavior of Qualitia when there is any error during execution of "Actions".
Note:
- Error handling settings are applied only for error conditions and not defects.
For example, execution status of following step is "Defect" and not "Error".
CompareString "a" "ab" "true"
- Error handling settings do not apply if the expression in IF/ELSE IF steps is invalid.
OnError settings at step level
Qualitia keywords are provided to specify error handling at step level. Users can select keywords from Action drop-down for Test case as well as task steps.
The keywords for steps are:
- ExitTask:
If this keyword in specified, execution of next step is skipped and execution continues with the next task.This keyword is not available for test case level step.
- ExitTCIteration
If this keyword is specified, execution will skip the current iteration of test case and execute next iteration. If there is only one TC iteration, then the test case execution will stop.
- ExitSuite
If this keyword is specified, execution will stop and no further test cases will be executed.
OnError settings for dry run
On TestCase screen, the second column of grid indicates "OnError" setting. Refer following screenshot, three options can be set for "OnError". Double click the flags shown to edit/change this setting. Default is set to "Continue".
- ExitTestCase
- If this setting is specified, execution will skip the current iteration of test case and execute next iteration. If there is only one TC iteration, then the test case execution will stop.
- Stop execution of TestCase if any step in this test case fails.
- ExitTask
- If any step of this task fails, skip all following steps and execute next task
- Continue
- On any error in any step, do not exit. Continue execution of next steps and tasks.
OnError settings for Suite execution
On Suite screen, users can set following OnError options:
- ExitSuite: In case of any failure in any step of any task of a TestCase, stop suite execution.
- ExitTetCase: If this setting is specified, execution will skip the current iteration of test case and execute next iteration. If there is only one test case iteration, then the test case execution will stop and next Test Case in suite will be executed.
- Continue: Continue execution of suite in case of any failures.
Combination of OnError setting on TestCase and Suite screen
- OnError settings at step level always override all other error handling settings.
Following rules apply assuming there are no step level settings explicitly specified for user
- If on Suite screen, user specifies value as "Continue" and on TestCase screen, values specified are "ExitTask" or "ExitTestCase", then settings on TestCase screen would be applicable.
- For values other than "Continue", the setting on Suite screen overrides the setting on test case screen.
- Hence if any task in a TestCase has "ExitTestCase" / "ExitTask" / "Continue" on TestCase screen, but has "ExitSuite" on Suite screen, then in case of any error in Test Case (excluding invalid expression), Qualitia will effectively do "ExitSuite".
On Error Condition |
| Overriding screen | Resulting setting |
TC screen | Suite screen | Setting |
|
Continue | Continue | TC | Continue |
ExitTask | Continue | TC | ExitTask |
ExitTestCase | Continue | TC | ExitTestCase |
Continue | ExitTestCase | Suite | ExitTestCase |
ExitTask | ExitTestCase | Suite | ExitTestCase |
ExitTestCase | ExitTestCase | Suite | ExitTestCase |
Continue | ExitSuite | Suite | ExitSuite |
ExitTask | ExitSuite | Suite | ExitSuite |
ExitTestCase | ExitSuite | Suite | ExitSuite |