On Error Settings for Dry Run
On the Test Cases screen, the second column of grid indicates "OnError" settings. Refer to the following screenshot, three options can be set for "OnError".
- Double-click the flags shown to edit/change this setting.
Default is set to "Continue".
- ExitTCIteration
- If the test step fails, Qualitia skips the current iteration of the test case and execute next iteration. If there is only one TC iteration, then the test case execution stops.
- ExitTask
- If any step of this task fails, Qualitia skips all following steps and executes next task.
- Continue
- If any step of this task fails, Qualitia does not exit and Continues execution of next steps and tasks.
OnError Settings for Suite Execution
On the Suites screen, you can set following OnError flags as per the test case requirements:
- ExitSuite: In case of any failure at any TC level or task level step of a Test Case, the suite execution will be stopped.
- ExitTCIteration: In case of any failure, execution will be skipped for the current iteration of the test case and execution will be continued for next iteration. If there is only one test case iteration, then the test case execution will stop and next Test Case in suite will be executed.
- Continue: Continue execution of suite in case of any failures.
Combination of OnError setting on the Test Cases and Suite Screen
- OnError settings at step level always override all other error handling settings.
Following rules apply assuming there are no step level settings explicitly specified for user
- If on the Suites screen, user specifies value as "Continue" and on the Test Cases screen, values specified are "ExitTask" or "ExitTCIteration", then settings specified on the Test Cases screen will be applicable.
- For values other than "Continue", the setting on Suites screen overrides the settings specified on the Test Cases screen.
- If any task in a Test Case has "ExitTCIteration" / "ExitTask" / "Continue" on the Test Cases screen, but has "ExitSuite" on Suites screen, then in case of any error in Test Case (excluding invalid expression), Qualitia will effectively exists the suite execution.
On Error Condition | Overriding Screen | Result | |
---|---|---|---|
TC Screen | Suite Screen | Setting | |
Continue | Continue | TC | Continue |
ExitTask | Continue | TC | ExitTask |
ExitTCIteration | Continue | TC | ExitTCIteration |
Continue | ExitTCIteration | Suite | ExitTCIteration |
ExitTask | ExitTCIteration | Suite | ExitTCIteration |
ExitTCIteration | ExitTCIteration | Suite | ExitTCIteration |
Continue | ExitSuite | Suite | ExitSuite |
ExitTask | ExitSuite | Suite | ExitSuite |
ExitTCIteration | ExitSuite | Suite | ExitSuite |