The following section provides information about how to set up and execute an offline package as a part of an Azure DevOps pipeline.
The advantage of the Offline Package integration is that you can set up and configure the required Qualitia and ADO components easily and quickly. You can map an Azure DevOps pipeline with an offline suite that contains the associated test cases, which are not updated regularly.
...
Hence, Qualitia also supports the Azure DevOps Advanced integration that solves all the above mentioned problems. For detailed instructions, refer to Azure DevOps Advanced Integration.
Pre-Requisites
Ensure that your computer:
...
Process | Description |
---|---|
Creating an Offline Package | Offline package creation is a one-time activity on your computer to execute offline suites. For detailed instructions on offline suite creation, refer to Creating an Offline Package. |
Configuring the Offline Package File | Specify in the Offline Package that the associated CI Tool is Azure DevOps. This is also a one-time activity. For detailed instructions on configuring the Offline Package file, refer to Configuring the Offline Package File. |
Creating an Offline Suite | Create a test suite that includes the test cases relevant to the pipeline. After a test suite is created, create an offline suite. For detailed instructions on offline suite creation, refer to Creating an Offline Suite. |
Mapping an Azure DevOps Pipeline with an Offline Suite | Create two tasks in the Azure DevOps pipeline and configure them to map with the Offline Package and the associated offline suite. For detailed instructions, refer to Mapping an Azure DevOps Pipeline with an Offline Suite. |
Configuring the Offline Package File
...
Whenever the test cases of the corresponding test suite are updated in QAS, perform the following steps:
Create the offline suite again.
Save the new offline suite in another location of your computer.
Open the Azure DevOps pipeline to replace the mapped offline suite.
To allow the suite execution results to display in the Real Time Reporting portal, ensure that you specify the Qualitia Server URL and select the Real Time Reporting checkbox in the mapped execution profile.
Before executing a pipeline, ensure that the mapped execution profile of the corresponding offline suite is configured as per the requirements. For detailed instructions, refer to Configuring the Settings for an Offline Suite.
To execute a pipeline on different browsers, environments, and other execution settings. Create different execution profiles in the QAS client and export them into the Offline Suite folder of your computer. For detailed information on execution profile, refer to Working with Execution Profiles.
You can edit the test data for an offline suite and execute the pipeline again to cover more test scenarios. For detailed instructions on editing test data for an offline suite, refer to Editing the Test Data for an Offline Suite.
Viewing the Suite Execution Reports
If you have configured the Qualitia Server URL in the mapped execution profile, you can track the Azure DevOps offline execution in the Real Time Reporting Portal.
The suite execution result is displayed as Offline | Azure DevOps next to the suite execution name.
...
Limitations
Whenever any test case is updated or created, you must create the associated offline suites again and also map the associated pipelines with new offline suites.
You cannot have parallel executions of test cases.
QAS does not send the suite execution results to Azure DevOps.