A Test Suite is a collection of test cases defined in a sequence for execution. Test suite executions results are displayed in Real Time Reporting and Dashboards portal. Test Suites are created to perform regression testing, smoke testing, and functional testing for the application under tests that you have.

Within a test suite, you can anytime set a test case as:

• Marked: To include the selected test case in the test suite execution.

• UnMarked: To skip the selected test case in the test suite execution.

Creating a Test Suite

You can create a new test suite and add test cases that you want to execute to.

Error handling is a pre-defined behaviour of suite execution when any step fails. For every test case of a test suite, you can define the following types of error handling:

1. ExitSuite: To stop the suite execution.

2. ExitTCIteration: To skip the remaining steps of the test case iteration and start with the subsequent test case iteration. If there is no subsequent test case iteration, the execution for the next test case starts.

3. Continue: To continue the test suite execution.

For more information on Error Handling Flags, refer to Adding Error Handling Flags .

To create a test suite:

1. From the Expand Menu, click Execute.
2. In the left pane, click the New Suite button ().

3. Enter the details in Suite Name and Description fields.

4. Click Save.
   The new suite appears in the left pane under Suites.

5. Double-click the suite you have created.

6. To add a test case, do the following in the order listed:

   1. Click the Add Test Case button to add a test case.

   2. Select a test case, and click Ok.
      The selected test case is added to the suite.
      Similarly add more test cases that you want to add to the test suite. You can select one test case multiple times.

   3. To include a test case for execution, select the test case, and click Mark.
      A+ (plus sign) indicates test case is selected for execution.

Executing a Test Suite

You can execute a test suite at any point of time or schedule a recurring test suite execution.

A test suite execution covers all the task iterations and test case iterations for every test case as per the set of values defined in the associated Test Data.

Before executing a test suite, ensure that you have defined the necessary settings in the associated execution profile.
For more information, refer to Working with Execution Profile.

To execute a test suite:

1. From the Expand Menu, click Execute.
2. From the left pane, select the test suite.
   The right pane displays the test cases selected for the selected suite.

3. Perform this step only if you want to include or skip any of the selected test case.
   Under the Mark column, a + (plus sign) indicates that the test case is selected for execution, and a - (minus sign) indicates that the test case is not selected for execution.

   1. To include a test case for execution, select the test case, and click Mark.

   2. To skip a test case for execution, select the test case, and click UnMark.
      Note: At least one test case must be marked for execution.

1. To use a specific execution profile, from the Execution Profile list, select the execution profile.
   Note: To execute a test suite for a desktop project, the settings defined in the System Execution Profile settings for the project are used. For more information, refer to Configuring the System Execution Profile Settings for a Desktop Project.

2. Do one of the following:

   • Click the Run Now button (Image Added) to execute the test suite immediately.

   • Click the Schedule button (Image Added) to schedule a recurring suite execution. The Schedule List screen is displayed:
     Do in the following order listed:

     1. Click Add.

     2. Enter the build number and release number.

     3. Enter the start date and start time.

     4. Do one of the following:

        1. Select Daily and then select Every Day to execute the test case daily, or select Every "N" days to execute the test after a specific number of days. For example, to execute the test suite after every three days, select Every and then select 3 from the drop-down list.

        2. Select Weekly to execute the test suite on specific days of a week.

        3. Select Monthly to execute the test suite on specific day of a month. Select a specific date of a month along with an appropriate month checkbox. Or, select a specific day of a week along with appropriate month checkboxes, such as every first Monday of January, February, and March.

     5. Click OK. Qualitia Automation Studio starts execution of the marked test cases.

3. To stop the test execution at any step, click Stop.
   
   

Viewing a Test Suite Execution Report

If you have selected RealTime Reporting checkbox in the associated execution profile, then you can view the test suite execution report in the Real Time Reporting Portal, which updates the execution results after every test case iteration is completed.

Alternatively, every test suite execution creates a test suite execution summary report as per the location defined in Execution Result Path on the General Settings tab. The test suite execution summary report updates the results into this folder after every task iteration execution is completed.

If the local suite execution report is not displayed on Real Time reporting., after the suite execution is completed, you can upload the locally saved report into the Real Time Reporting portal.

For instructions on how to upload a suite execution report, refer to Uploading a Report into Real Time Reporting Portal.

Removing a Suite

You can remove a suite that is no longer required.
To remove a suite:

1. From the Expand Menu, click Execute.
2. Select the required suite on the left pane.
3. Right-click the required suite and click Remove from the context menu.
   The system asks for confirmation about the removal of the required suite.
4. Click Yes.
   The suite is removed from the project.