A Test Suite is a collection of test cases defined in a sequence for execution. Test suite executions results are displayed in Real Time Reporting and Dashboards portal. Test Suites are created to perform regression testing, smoke testing, and functional testing for the application under tests that you have.

Within a test suite, you can anytime set a test case as:

• Marked: To include the selected test case in the test suite execution.

• UnMarked: To skip the selected test case in the test suite execution.

Creating a Test Suite

You can create a new test suite and add test cases that you want to execute to.

You can set Error Handling Flags for the added test cases. For more information on Error Handling Flags, refer to Error Handling Flags.

To create a test suite:

1. From the Expand Menu, click Execute.

2. In the left pane, click the New Suite button ().

3. Enter the details in Suite Name and Description fields.

4. Click Save.
   The new suite appears in the left pane under Suites.

5. Double-click the suite you have created.

6. To add a test case, do the following in the order listed:

   1. Click the Add Test Case button ()to add a test case.

   2. Select a test case, and click Ok.
      The selected test case is added to the suite.
      Similarly, add more test cases that you want to add to the test suite. You can select one test case multiple times.

   3. To include a test case for execution, select the test case, and click the Mark button ().
      The yellow sign () indicates test case is selected for execution.

Executing a Test Suite

You can execute a test suite at any point of time or schedule a recurring test suite execution.

A test suite execution covers all the task iterations and test case iterations for every test case as per the set of values defined in the associated Test Data.

Before executing a test suite, ensure that you have defined the necessary settings in the associated execution profile.
For more information, refer to Working with Execution Profile.

If you do not map an execution profile with the test suite, the default execution profile is used for execution.  

Watch the video tutorial about how to execute a test suite here:

To execute a test suite:

1. From the Expand Menu, click Execute.

2. From the left pane, select the test suite.
   The right pane displays the test cases selected for the selected suite.

3. Perform this step only if you want to include or skip any of the selected test case.
   Under the Mark column, a  (plus sign) indicates that the test case is selected for execution, and a  (minus sign) indicates that the test case is not selected for execution.

   1. To include a test case for execution, select the test case, and click the Mark button ().

   2. To skip a test case for execution, select the test case, and click the UnMark button () .
      Note: At least one test case must be marked for execution.

4. To use a specific execution profile, from the Execution Profile list, select the execution profile.

   
   
   

5. Do one of the following:
   
   

   • Click the Run Now button () to execute the test suite immediately.

   • Click the Schedule button () to schedule a recurring suite execution. The Schedule List screen is displayed:
     Do in the following order listed:

     1. Click Add.

     2. Enter the build number and release number.

     3. Enter the start date and start time.

     4. Do one of the following:

        1. Select Daily and then select Every Day to execute the test case daily, or select Every "N" days to execute the test after a specific number of days. For example, to execute the test suite after every three days, select Every and then select 3 from the drop-down list.

        2. Select Weekly to execute the test suite on specific days of a week.

        3. Select Monthly to execute the test suite on specific day of a month. Select a specific date of a month along with an appropriate month checkbox. Or, select a specific day of a week along with appropriate month checkboxes, such as every first Monday of January, February, and March.

     5. Click OK. Qualitia Automation Studio starts execution of the marked test cases.

6. To stop the test execution at any step, click Stop.

If certain test cases execute on a mobile device, ensure that you have configured the settings in the associated execution profile as per the requirements.. For more details, refer to Requirements and Configuration Settings for Mobile Environments.

Viewing a Test Suite Execution Report

If you have selected RealTime Reporting checkbox in the associated execution profile, then you can view the test suite execution report in the Real Time Reporting Portal, which updates the execution results after every test case iteration is completed.

Alternatively, every test suite execution creates a test suite execution summary report as per the location defined in Execution Result Path on the General Settings tab. The test suite execution summary report updates the results into this folder after every task iteration execution is completed.

If the local suite execution report is not displayed on Real Time reporting, after the suite execution is completed, you can upload the locally saved report into the Real Time Reporting portal.

For instructions on how to upload a suite execution report, refer to Uploading a Report into Real Time Reporting Portal.

Removing a Suite

You can remove a suite that is no longer required.
To remove a suite:

1. From the Expand Menu, click Execute.

2. Select the required suite on the left pane.

3. Right-click the required suite and select Remove.
   The system asks for confirmation about the removal of the required suite.

4. Click Yes.
   The suite is removed from the project.