Working with test suites is crucial for ensuring that applications function as intended. A test suite contains a sequence of test cases that you want to run, and this guide will help you understand how to create, execute, and manage them efficiently.
Understanding Test Suites
When testing a new feature, you want to ensure this feature works as expected without breaking existing functionalities. A test suite helps you group related test cases to validate this.
A test suite is a set of test cases you want to execute in sequence.
You can see the results of your test suite runs in the Real Time Reporting portal.
Test suites can be used for regression, smoke, and functional testing of your application.
Managing Test Cases in a Suite
Your application has multiple modules. While some are stable, others are frequently updated. You may want to exclude stable modules from daily testing to save time. You have the following options:
Mark a test case: This includes the test case in the suite's execution.
Unmark a test case: This skips the test case during the suite's execution.
Your markings are saved in Qualitia Automation Studio for your reference.
📚Prerequisites:
Familiarity with the application you're testing.
Access to Qualitia Automation Studio Client.
Basic understanding of test cases.
Availability of existing test cases
Privileges to execute Tests.
Ensure test cases are published in the Ready for Execution tab before marking or unmarking in the suite.
Procedural Steps
In this section, you can find step-by-step walk through Create a Test Suite, Execute a Test Suite, View Test Suite Execution Report, Editing a Test Suite, and Removing a Test Suite.
➕ Create a Test Suite
You are introducing a new module in your application. To ensure it integrates well, you decide to create a new test suite for it.
Login to QAS - Client.
Access Execute from left navigation to view the Test Suite Explorer screen, where you can view the existing suites.
Click the New Suite button and you can view popup window.
On the popup window, enter the suite name and description.
Click Save to save your suite.
Click Add Test Case to Suite to add a test case within a suite.
Select the test cases and confirm.
Use the Mark button to include the test case for execution.
▶️ Execute a Test Suite
After creating a test suite, you are now ready run or execute it.
📚Prerequisites:
Ensure test case are published.
Ensure testcases are marked.
Before running a test suite, set up the necessary settings in the associated execution profile.
If not mapped to an execution profile, the default one will be used.
To run on mobile or cloud platforms, follow the specific guidelines.
Steps to execute:
Login to QAS - Client.
Access Execute from left navigation to view the Test Suite Explorer screen, where you can vew all the available Test Suites.
Select the desired test suite.
Select the test cases for execution.
Use Mark to include in test case execution and UnMark to skip them.
Ensure at least one test case is marked.
Select the execution profile if needed.
Refer to the execution profiles section for more information.
You will see two options:
Run Now: Click Run Now to start the execution immediately.
Schedule: Schedule for future runs.
In case of Scheduling:
In case of Scheduling:
Click on a parent suite.
You can view two tabs - Suite and Schedules.
Click Schedules.
You can view Edit, Delete, and Schedule icons.
To schedule execution:
Click Schedule.
Enter Scheduler Name and Select one or more suites.
Enter the Build Number and Release Number.
Enter the Start Date and Start Time.
Do one of the following:
Select Daily and then select Every Day to execute the test case daily or select Every "N" days to execute the test after a specific number of days. For example, to execute the test suite after every three days, select Every and then select 3 from the dropdown list.
Select Weekly to execute the test suite on specific days of a week.
Select Monthly to execute the test suite on specific day of a month. Select a specific date of a month along with an appropriate Month checkbox. Or select a specific day of a week along with appropriate Month checkboxes, such as every first Monday of January, February, and March.
Added Scheduler will be displayed inside Schedule tab.
Scheduler always runs only on the default system execution profile.
You can change sequence of test cases in a suite by using the Move Line Up and Move Line Down options.
Users can apply flags to each test case. If a test case fails, the execution can either continue, resume from that specific test case iteration, or stop by exiting of the entire suite.
👁️ View Test Suite Execution Report
After executing the test suite, you want an overview of the results to identify any issues or areas of improvement.
If RealTime Reporting is enabled, view the report directly in the Real Time Reporting portal.
Every test suite execution also saves a summary report at a specified location.
If not on Real Time reporting, you can upload the local report.
Update Test Suite
From the Expand icon, go to Execute tab.
Select the suite you want to Edit.
Make the necessary updates.
Click Save to proceed; otherwise, click Cancel.
Remove Test Suite
When a feature is no longer available, its associated test suite is no longer relevant.
From the Expand icon, go to Execute tab.
Choose the suite you wish to delete.
Right click and select Remove.
Confirm the delete action.
💡 Golden Nuggets: Best Practices for Workspace Management
🔧 Got Trouble? Let's Fix!
📞📚 Here to Help: Support and Resources
Need some assistance? Don't hesitate to contact your Qualitia Relationship Manager. For additional resources, our official Qualitia documentation and community website are just a few clicks away! Experience an effortless journey with Qualitia Design Studio.