A test suite is a collection of test cases defined in a sequence for execution. Test suite executions results are displayed in Real Time Reporting and Dashboards portal. Test Suites are created to perform regression testing, smoke testing of an application, as well as functional testing of an application.

Within a test suite, you can anytime set a test case as:

Marked: To include the selected test case in the test suite execution.
UnMarked: To skip the selected test case in the test suite execution.

When a user marks or unmarks the test cases in a test suite, Qualitia Automation Studio saves the marking and unmarking of test cases in the test suite for that user only.

Creating a Test Suite

You can create a new test suite and add test cases that you want to execute to

Error handling is a pre-defined behaviour of suite execution when any step fails. For every test case of a test suite, you can define the following types of error handling:

ExitSuite: To stop the suite execution.
ExitTCIteration: To skip the remaining steps of the test case iteration and start with the subsequent test case iteration. If there is no subsequent test case iteration, the execution for the next test case starts.
Continue: To continue the test suite execution.

For more information on Error Handling Flags, refer to Adding Error Handling Flags .

To create a test suite:

Click Execute.
The Suite screen is displayed.
In the left pane, right-click Suites , and then click New Suite.
The New Suites window is displayed.
Enter a name for the suite in the Suite Name field and enter description for the suite in the Description field.
Click OK.
The new suite appears in the left pane under Suites.
Double-click the suite you have created.
To add a test case, do the following in the order listed:
1. Click Add to add a test case.
2. Select a test case, and click Ok.
  The selected test case is added to the suite.
  Similarly add more test cases that you want to add to the test suite. You can select one test case multiple times.
3. To include a test case for execution, select the test case, and click Mark.
  A+ (plus sign) indicates test case is selected for execution.

Executing a Test Suite

You can execute a test suite at any point of time or schedule a recurring test suite execution.

A test suite execution covers all the task iterations and test case iterations for every test case as per the set of values defined in the associated Test Data.

Before executing a test suite, ensure that you have defined the necessary settings in the associated execution profile.
For more information, refer to Working with Execution Profile.

If you do not map an execution profile with the test suite, the default execution profile is used for execution.

To execute a test suite on mobile platform, ensure that you have configured the system requirements and settings in the associated execution profile. For more information, refer to Requirements and Configuration Settings for Mobile Environments.
To execute a test suite on remote or cloud platforms, you must follow the appropriate environment guidelines. For more information, refer to Supported Environments Guidelines.

To execute a test suite:

Click the Execution tab.
From the left pane, select the test suite.
The right pane displays the test cases selected for the selected suite.
Perform this step only if you want to include or skip any of the selected test case.
Under the Mark column, a + (plus sign) indicates that the test case is selected for execution, and a - (minus sign) indicates that the test case is not selected for execution.
1. To include a test case for execution, select the test case, and click Mark.
2. To skip a test case for execution, select the test case, and click UnMark.
  Note: At least one test case must be marked for execution.
To use a specific execution profile, from the Execution Profile list, select the execution profile.
Note: To execute a test suite for a desktop project, the settings defined in the System Execution Profile settings for the project are used. For more information, refer to Configuring the System Execution Profile Settings for a Desktop Project.
Do one of the following:
- Click Run Now to execute the test suite immediately.
- Click Schedule to schedule a recurring suite execution. The Schedule List screen is displayed:
  Do in the following order listed:
  1. Click Add.
  2. Enter the build number and release number.
  3. Enter the start date and start time.
  4. Do one of the following:
    1. Select Daily and then select Every Day to execute the test case daily, or select Every "N" days to execute the test after a specific number of days. For example, to execute the test suite after every three days, select Every and then select 3 from the drop-down list.
    2. Select Weekly to execute the test suite on specific days of a week.
    3. Select Monthly to execute the test suite on specific day of a month. Select a specific date of a month along with an appropriate month checkbox. Or, select a specific day of a week along with appropriate month checkboxes, such as every first Monday of January, February, and March.
  5. Click OK. Qualitia Automation Studio starts execution of the marked test cases.
To stop the test execution at any step, click Stop.

If certain test cases execute on a mobile device, ensure that the mobile device or emulator is connected to your computer at the time of execution.

Viewing a Test Suite Execution Report

If you have selected RealTime Reporting checkbox in the associated execution profile, then you can view the test suite execution report in the Real Time Reporting Portal, which updates the execution results after every test case iteration is completed.

Alternatively, every test suite execution creates a test suite execution summary report as per the location defined in Execution Result Path on the General Settings tab. The test suite execution summary report updates the results into this folder after every task iteration execution is completed.

If the local suite execution report is not displayed on Real Time reporting., after the suite execution is completed, you can upload the locally saved report into the Real Time Reporting portal.

For instructions on how to upload a suite execution report, refer to Uploading a Report into Real Time Reporting Portal.

Sync Test Cases during Suite Execution

During a suite execution, a compile error list is displayed for a list of test cases whose tasks have changed but not synced in the associated test cases. After viewing the list of test cases impacted due to task edit, you can sync all the displayed test cases using Sync button on the Compile Error List pop-up.
This feature allows you to sync test cases at the time of Suite execution without having to navigate to each of the associated test cases.

To sync test cases:

Navigate to a task from Develop > Tasks module and edit the task, or, open a test case that has a task used in multiple test cases.
Make some changes to the task and save.
Navigate to Execute module.
From the Execute module, line up the suite for execution.
Click the Run Now button. The Compile Error list popup is displayed.
Click the Sync button.
All listed test cases are synchronized. Sync All will be performed only on test cases marked for execution in a Suite. Unmarked test cases at any point will not be updated via the Sync operation.

Removing a Suite

You can remove a suite if the suite is no longer in use.
To remove a suite:

Click Execute.
The Suite screen is displayed.
Select the required suite on the left pane.
Right-click the required suite and click Remove from the context menu.
The system asks for confirmation about the removal of the required suite.
Click Yes.
The suite is removed from the project. It is no longer available on the left pane.

On this Page:

Browser not supported