This section describes how TFS/Azure DevOps components interact with Qualitia components to successfully execute Qualitia Test Cases.
Qualitia has the following three components:
Qualitia Server
Qualitia Client
Qualitia Remote Agent
Whereas TFS/Azure DevOps provides the following two components:
TFS as a Local Server or Azure DevOps as the Cloud Version
TFS/Azure DevOps Agent
The whole integration process of Qualitia Automation Studio with TFS/ Azure DevOps is divided into 3 steps:
Association between Qualitia Automation Studio and TFS/Azure DevOps (initiated from Qualitia Automation Studio)
Associate Qualitia Automation project with TFS/Azure DevOps Project
Associate Qualitia Automated test cases with TFS/ Azure DevOps manual test cases
Execution of associated Qualitia Automation tests from TFS/Azure DevOps (One-time setup on Azure DevOps side)
Execution involves following one time setup activities to be done
Setup build/release pipeline for execution associated Qualitia test cases
Two Qualitia Custom tasks for pipeline installation
Get Assembly Task
Publish Results Task
Setup TFS/Azure DevOps agent
Setup Qualitia Remote Agent on the Azure DevOps agents used for Qualitia test execution
Setup agent pool with agents setup for Qualitia executions
Result Publish of the Qualitia Automation tests (incorporated in pipeline task created by Qualitia)
Publish results to test cases against the test runs (for each pipeline execution)
Publish test case results to Qualitia Automation Studio
The following table explains how different components of TFS/Azure DevOps and Qualitia interact with each other.
Component | Role Played In Different Stages |
---|---|
TFS/Azure DevOps Server | Association Responds to Qualitia server using standard out of box APIs offered by Azure DevOps Execution Configuration of build/release pipelines Agent pool configurations Initiate pipeline execution Result Publish Host results of pipeline execution |
TFS/Azure DevOps Agent | Association None Execution Executes of the jobs in the pipeline and the contained tasks Executes Visual Studio Test Task used for test execution Filters Automated test cases in TFS/Azure DevOps projects matching search criteria Invokes the Qualitia Remote Agent for executing Qualitia Test Cases Result Publish Execution of the Publish Result task of Qualitia to publish results to Qualitia Server and TFS/Azure DevOps Test Runs. Uses Qualitia Server APIs to publish results |
Qualitia Remote Agent | Association None Execution Receives request from TFS/Azure DevOps agent Gets the linked test cases from the QAS server Executes test cases Result Publish Saves the Test execution results on a predefined location used by TFS/Azure DevOps agent. Both TFS/Azure DevOps Agent and Qualitia Remote Agent must be installed on the machine. |
Qualitia Server | Association Interacts with the TFS/Azure DevOps server to update Automation Status of TFS/Azure DevOps test cases. Saves the published versions of Qualitia test cases Execution Sends the published test cases to Qualitia Remote Agent. Result Publish Receives test case results directly from the TFS/Azure DevOps Agent with the help of Qualitia APIs. Consolidates the individual test case results in a single suite report |
Qualitia Client | Association Allows the authorized users to view TFS/Azure DevOps projects and associate projects and test cases. Execution Publishes the test case to Qualitia server. The published test case is used in the TFS/Azure DevOps pipeline execution. Result Publish Shows the status of Test cases executed through TFS/Azure DevOps in reports. |
Add Comment