Working with test suites is crucial for ensuring that applications function as intended. A test suite contains a sequence of test cases that you want to run, and this guide will help you understand how to create, execute, and manage them efficiently.
Understanding Test Suites
When testing a new feature, you want to ensure this feature works as expected without breaking existing functionalities. A test suite helps you group related test cases to validate this.
A test suite is a set of test cases you want to execute in sequence.
You can see the results of your test suite runs in the Real Time Reporting portal.
Test suites can be used for regression, smoke, and functional testing of your application.
Managing Test Cases in a Suite
Your application has multiple modules. While some are stable, others are frequently updated. You may want to exclude stable modules from daily testing to save time. You have the following options:
Mark a test case: This includes the test case in the suite's execution.
Unmark a test case: This skips the test case during the suite's execution.
Your markings are saved in Qualitia Automation Studio for your reference.
📚Prerequisites
Familiarity with the application you're testing.
Access to Qualitia Automation Studio - Client.
Basic understanding of test cases.
Availability of existing test cases
Privileges to execute Tests.
➕ Create a Test Suite
You are introducing a new module in your application. To ensure it integrates well, you decide to create a new test suite for it.
Login to QAS - Client.
Access Execute from left navigation to view the Test Suite Explorer screen, where you can view the existing suites.
When no Suite exist, you are prompted to Create Suite in the Test Suite Explorer.
You can also click + Create Suite from the top-right corner of the tabular section.
Clicking Create will open a Create Suite window with the following fields:
Name: Enter an intuitive name for the suite that is easy to recognize.
Maximum length permitted is 300 characters including spaces.
Description: A brief description about the suite.
Once completed, click Save to proceed; otherwise, click Discard.
Click +Add Test Case to Suite to add a test case within a suite.
Select the test cases and confirm.
Use the Mark button to include the test case for execution.
▶️ Execute a Test Suite
After creating a test suite, you are now ready to run or execute it.
📚Prerequisites
Ensure test cases are marked.
Before running a test suite, set up the necessary settings in the associated execution profile.
If not mapped to an execution profile, the default one will be used.
To run on mobile or cloud platform, follow the specific guidelines.
To execute a test suite:
Login to QAS - Client.
Access Execute from left navigation to view the Test Suite Explorer screen, where you can view all the available Test Suites.
You can use Search and Find on the Test Suite Explorer screen to select the desired test suite.
Select the test cases for execution.
Use Mark to include in test case execution and UnMark to skip them.
Ensure at least one test case is marked.
Select the execution profile from the top menu if needed.
Refer to the Execution Profiles section for more information.
You will see two options:
Execute: Hover over Execute
Select Execute to start the execution immediately.
Select Execute the Published Test Cases to start the execution of the published test cases.
Schedule: Schedule for future runs.
To schedule execution:
Click Schedule.
Enter Scheduler Name and select one or more System Execution Profile as well as Suite. Click Next, it will open the Add Schedule window.
Enter the Release Number and Build Number.
Enter the Start Date and Start Time.
Do one of the following:
Select Daily and then select Every Day to execute the test case daily or select Every "N" days to execute the test after a specific number of days. For example, to execute the test suite after every three days, select Every and then select 3 from the dropdown list.
Select Weekly to execute the test suite on specific days of a week.
Select Monthly to execute the test suite on specific day of a month. Select a specific date of a month along with an appropriate Month checkbox. Or select a specific day of a week along with appropriate Month checkboxes, such as every first Monday of January, February, and March.
Click Save to continue; click Back to go to the previous window; otherwise, click Discard.
Added Scheduler will be displayed inside Schedule tab.
The test cases need to be published before scheduling an execution. If the test cases are not published, you won’t be able to schedule an execution using Scheduler.
You can also perform the following actions:
Move Line Up: Click Move Line Up to shift the test case one line up.
Move Line Down: Click Move Line Down to shift the test case one line down. You can change sequence of test cases in a suite by using the Move Line Up and Move Line Down options from the top menu bar.
Flag: You can apply flags for each test case or a global flag to mark multiple test cases. You can select from the options Continue, Exit Test Case, or Exit Suite. If a test case fails, the execution can either Continue, Exit Test Case Iteration, or stop by exiting of the entire suite.
Export: This option allows you to export the execution files. Hover over Export Execution File and you will see two options:
Export Execution Files: Select Export Execution Files if you want to export the direct files.
Export the published test cases: Select Export the published test cases if you want to export the published test cases.
Refresh: If multiple users are working on the Suite, and one of the users update the suite you will see a Red Dot near the Refresh button. The Red dot indicates update in the suite. Click Refresh if you want to incorporate the changes else continue.
You can view the published test case details, such as the published date-time and the username, under the Published Status column on the Suite screen. Hover over the
in the Published Status column to view the details.
On the Suite Explorer screen, when you click on the parent Suite you will see two tabs.
Suites: Clicking Suites will show the list of existing suites under the selected project. It will display the Suite Name, Description, Updated On, and Updated By details. You can also Edit, Delete, and Schedule a new schedular from the top menu bar.
Schedules: On this screen, you can view the list of schedules available for the project. It will display details such as Scheduler Name, Test Suites, Scheduler with Run, Frequency, Created On, and Created By.
👁️ View Test Suite Execution Report
After executing the test suite, you want an overview of the results to identify any issues or areas of improvement.
If RealTime Reporting is enabled, view the report directly in the Real Time Reporting portal.
Every test suite execution also saves a summary report at a specified location.
If not on Real Time reporting, you can upload the local report.
🔄Update Test Suite
To update an existing test scenario:
Login to QAS - Client.
Access Execute from left navigation to view the Test Suite Explorer screen, where you can view the existing suites.
Hover mouse over a test suite to view the Edit option.
Click the Pencil icon and you are prompted to update:
Suite Name
Description
Click Save to update the scenario; otherwise, Discard.
❌Delete
When a feature is no longer available, its associated test suite is no longer relevant.
Login to QAS - Client.
Access Execute from left navigation to view the Test Suite Explorer screen, where you can view the existing suites.
Hover mouse over a test suite to view the Delete option.
Click the Bin icon to delete.
🔧 Got a problem? Let’s fix!
Scheduler not working for mobile execution: If scheduler execution is not working for mobile test case, it is due to the long Qualitia path name which is more than 250 characters.
For example: C:\Users\user1\AppData\Local\Qualitia Automation Studio - Client\workspace\projects\SFDC_T\local.
For successful execution, replace the above path with the D folder path, which is equal to or less than 250 characters.Scheduler not working in Qualitia v9: If you are facing an issue where the scheduler is not working in Qualitia v9; however, it works fine in v8, on the same system.
The error appears to be related to your organization's policy restrictions, which prevent file execution. Try to lower down the policy for the scheduler to work as expected in v9.
Known Issue:
The Scheduler execution is not working on Safari browser due to failure of Webdriver object creation.
📞📚 Here to Help: Support and Resources
Need some assistance? Don't hesitate to contact your Qualitia Relationship Manager. For additional resources, our official Qualitia documentation and community website are just a few clicks away! Experience an effortless journey with Qualitia Design Studio.