Document toolboxDocument toolbox

Overview of Qualitia Integration with TFS/Azure DevOps

Owned by ravi.chandran (Unlicensed)
Last updated: Jan 08, 2020
3 min read

This section describes how TFS/Azure DevOps components interact with Qualitia components to successfully execute Qualitia Test Cases.

Qualitia has the following three components:

  • Qualitia Server

  • Qualitia Client

  • Qualitia Remote Agent

Whereas TFS/Azure DevOps provides the following two components:

  • TFS as a Local Server or Azure DevOps as the Cloud Version

  • TFS/Azure DevOps Agent

 

The whole integration process of Qualitia Automation Studio with TFS/ Azure DevOps is divided into 3 steps:

  • Association between Qualitia Automation Studio and TFS/Azure DevOps (initiated from Qualitia Automation Studio)

    • Associate Qualitia Automation project with TFS/Azure DevOps Project

    • Associate Qualitia Automated test cases with TFS/Azure DevOps manual test cases

  • Execution of associated Qualitia Automation tests from TFS/Azure DevOps (One-time setup on Azure DevOps side)

    • Execution involves following one time setup activities to be done

      • Setup build/release pipeline for execution associated Qualitia test cases

        • Two Qualitia Custom tasks for pipeline installation

          • Get Assembly Task

          • Publish Results Task

      • Setup TFS/Azure DevOps agent

        • Setup Qualitia Remote Agent on the Azure DevOps agents used for Qualitia test execution

        • Setup agent pool with agents setup for Qualitia executions

  • Result Publish of the Qualitia Automation tests (incorporated in pipeline task created by Qualitia)

    • Publish results to test cases against the test runs (for each pipeline execution)

    • Publish test case results to Qualitia Automation Studio

The following table explains how different components of TFS/Azure DevOps and Qualitia interact with each other.

Component

Role Played In Different Stages

Component

Role Played In Different Stages

TFS/Azure DevOps Server

Association

Responds to Qualitia server using standard out of box APIs offered by Azure DevOps

Execution

Configuration of build/release pipelines

Agent pool configurations

Initiate pipeline execution

Result Publish

Host results of pipeline execution

TFS/Azure DevOps Agent

Association

None

Execution

Executes of the jobs in the pipeline and the contained tasks

Executes Visual Studio Test Task used for test execution

Filters Automated test cases in TFS/Azure DevOps projects matching search criteria

Invokes the Qualitia Remote Agent for executing  Qualitia Test Cases

Result Publish

Execution of the Publish Result task of Qualitia to publish results to Qualitia Server and TFS/Azure DevOps Test Runs.

Uses Qualitia Server APIs to publish results

 

Qualitia Remote Agent

Association

None

Execution

Receives request from TFS/Azure DevOps agent

Gets the linked test cases from the QAS server

Executes test cases

Result Publish

Saves the Test execution results on a predefined location used by TFS/Azure DevOps agent.

Both TFS/Azure DevOps Agent and Qualitia Remote Agent must be installed on the machine.

Qualitia Server

Association

Interacts with the TFS/Azure DevOps server to update Automation Status of TFS/Azure DevOps test cases.

Saves the published versions of Qualitia test cases

Execution

Sends the published test cases to Qualitia Remote Agent.

Result Publish

Receives test case results directly from the TFS/Azure DevOps Agent with the help of Qualitia APIs.

Consolidates the individual test case results in a single suite report

Qualitia Client

Association

Allows the authorized users to view TFS/Azure DevOps projects and associate projects and test cases.

Execution

Publishes the test case to Qualitia server. The published test case is used in the TFS/Azure DevOps pipeline execution.

Result Publish

Shows the status of Test cases executed through TFS/Azure DevOps in reports.