Working with Qualitia Test cases In Azure DevOps

After you setup the environment in Azure DevOps and link the Qualitia test cases to it, you can start executing test cases as your build or release pipelines.

Also, you can access execution reports of Qualitia automated test cases from the Azure DevOps tests.

Executing Qualitia Automated Tests

After you set up the environment in Azure DevOps and linked Azure DevOps tests to Qualitia automated test cases, you can trigger the test case execution using build or release pipelines.

Additionally, you can trigger the test case execution from the test plan section of Azure DevOps.

Before you execute Qualitia automated tests as your build or release pipelines, ensure you have configured your build and release pipelines accordingly. Also, for on-demand executions, you must prepare a Visual Studio test task under the release pipeline accordingly.

For more information on how to configure these tasks, refer to the Configuring Azure DevOps for Test Executions section.

Execute Qualitia Automated tests using Build Pipelines

Sign in to the Azure DevOps instance.
From the top menu items, click Build and Release.
Under the Builds section, click the edit icon (...) and select Queue new build... option.
The new build will be added in a queue which will eventually initiate execution of Qualitia automated tests.

Execute Qualitia Automated tests using Release Pipelines

Sign in to the Azure DevOps instance.
From the top menu items, click Build and Release.
Go to the Releases section, click +Release > New release.
In the Create new release section, select the desired environment.
Artifacts are selected by default.
Add Release description, if required.
Click Create.
This will create a new release and will execute Qualitia automated tests.

On Demand Test Runs from Azure DevOps

Sign in to the Azure DevOps instance.
From the top menu items, click Tests > Test Plans.
Select the desired Test Suite in the left pane.
Right-click the test which you want to run and select Run with options from the context-menu.
On the Run with options screen, select Test type and runner, Build, Release Definition, and Environment to execute Qualitia automated tests.
Click OK.
This will execute Qualitia automated test linked to this Azure DevOps test.

Accessing Qualitia Test Execution Reports in Azure DevOps

After executing Qualitia automated tests, Qualitia test execution reports are attached to the respective test in Azure DevOps test. You can access these reports from the Test run section.

Azure DevOps assigns run ID each time when you run Qualitia automated tests for easy identification.

Note

The test results zip file that is attached to an Azure DevOps pipeline does not contain the screenshots. This is due to size limitations defined by Azure DevOps.

To access Qualitia test execution report:

Sign in to the Azure DevOps instance.
From the top menu items, navigate to Test > Runs.
Double-click the Run ID to view more information about that particular instance.
Select Test results.
A list of tests appears which were executed in the selected run instance.
Double-click the test to view more information about it.
In the Attachments section, you will find Qualitia test case result in a zip file.
Download and extract the zip file and open summary.html using Internet Explorer or Mozilla Firefox to view the detailed results.