Document toolboxDocument toolbox

Header

(v9.0) Azure DevOps Integration

Owned by Shruti Agrawal
Last updated: May 09, 2024
3 min read

Visual Studio from Microsoft helps product teams with tools and technologies in all the stages of application development. Qualitia Automation Studio (QAS) helps replace the manual testing procedures in the application development processes by tightly integrating with Azure DevOps. This makes the application development process robust and simple. 

Qualitia's integration to Azure DevOps lets organizations leverage their existing investments as part of an integrated platform for automation testing development and allows managing automated test cases prepared by Qualitia inside Azure DevOps.


The advanced integration with Azure DevOps has the following advantages over the offline package integration:

  1. Synchronizes the updated and new test cases easily when a pipeline is associated with several test cases. 

  2. Supports parallel execution of test cases to reduce the duration of pipeline executions.

  3. Allows to view the pipeline execution results from the Azure DevOps server too.

With Azure DevOps advanced integration, you can:

  • Map Qualitia Project to Azure DevOps Project

  • Map Qualitia automated test case to Azure DevOps test case

  • Execute Qualitia test cases locally in Azure DevOps (using self-hosted agents)

  • Run Qualitia test cases as part of your build pipelines

To integrate QAS with Azure DevOps, you need to first set up the environment.

Azure DevOps Integration

Let’s set up the environment, to get started with the Azure DevOps Integration. This section depicts information related to all the prerequisites and procedures to get prepared for Qualitia's integration to Azure DevOps.

This section describes how Azure DevOps interacts with QAS components to execute QAS test cases successfully.

Qualitia has the following components:

  • Qualitia Server

  • Qualitia Client

Whereas Azure DevOps provides the following two components:

  • Azure DevOps as the Cloud Version

  • Azure DevOps Self Hosted Agent

The whole integration process of QAS with Azure DevOps is divided into 3 steps:

  • Association between Qualitia Automation Studio and Azure DevOps (initiated from Qualitia Automation Studio)

  • Associate Qualitia Automation Project with Azure DevOps Project

  • Associate Qualitia Automated test cases with Azure DevOps manual test cases and Association of Qualitia Suite and Azure DevOps Suite.

  • Execution of associated Qualitia Automation tests from Azure DevOps (One-time setup on Azure DevOps side)

  • Execution involves following one time setup activities to be done

  • Setup build/release pipeline for execution associated Qualitia test cases

  • Task Extension is used for Qualitia Custom tasks for pipeline installation

  • Setup Azure DevOps agent

  • Setup agent pool with agents setup for Qualitia executions

  • Result Publish of the Qualitia Automation tests

  • Publish results to test cases against the test runs (for each pipeline execution)

  • Publish test case results to Qualitia Automation Studio

The following table explains how different components of Azure DevOps and Qualitia interact with each other.

Component

Roles Played in Different Stages

Azure DevOps

Association

  • Responds to Qualitia server using standard out of box APIs offered by Azure DevOps.

Execution

  • Configuration of build/release pipelines.

  • Agent pool configurations.

  • Initiate pipeline execution.

Result Publish

  • Host results of pipeline execution.

Azure DevOps Agent

Association

None

Execution

  • Executes of the jobs in the pipeline and the contained tasks.

  • Select Test Plan and Test Suite which contains Automated test cases and Suites in Azure DevOps projects.

Result Publish

  • Execution of the Publish Result task of Qualitia to publish results to Qualitia Server and Azure DevOps Test Runs.

  • Uses Qualitia Server APIs to publish result.

Qualitia Server

Association

  • Interacts with the Azure DevOps server to update Automation Status of Azure DevOps test cases.

Result Publish

  • Receives test case results directly from the Qualitia Client with the help of Qualitia APIs.

Qualitia Client

Association

  • Allows the authorized users to view Azure DevOps projects and associate projects and test cases.

Execution

  • Publishes the test case to Qualitia project repository. The published test case is used in the Azure DevOps pipeline execution.

Result Publish

  • Shows the status of Test cases executed through Azure DevOps pipeline in Real Time Reporting Portal.

Configuring Azure DevOps for Test Executions

QAS provisions to execute automated test cases from Qualitia mapped to Azure DevOps, as a part of your build and release pipelines. In order to do so, you first need to add Qualitia - Test Execution extensions in Azure DevOps instance.

You can add these extensions in Azure DevOps by following the steps mentioned herein.

Before initiating Azure DevOps integration with Qualitia, you must share Azure DevOps organization details with Qualitia. Qualitia will then share the extensions which will help you to integrate Azure DevOps projects to Qualitia projects.

After Qualitia shares these extensions, you can add and install these extensions to use them in the build and release pipeline.

Once this task is shared by Qualitia in Azure DevOps instance, you may add, install, and use them in build and release pipelines.

 To add the Qualitia – Test Execution extensions into Azure DevOps instance:

  • Sign in to your Azure DevOps instance.

  • From the top right corner, navigate to Marketplace > Manage Extensions.
    You will find Qualitia - Test Execution extension shared by Qualitia.

  • Click the Qualitia - Test Execution and install it.

  • Navigate back to Extensions > Manage Extensions.

Your Azure DevOps instance is now ready for Qualitia integration.

Footer