Versions Compared

Old Version 3

changes.mady.by.user Shruti Agrawal

Saved on

compared with

New Version 4

changes.mady.by.user Shruti Agrawal

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Visual Studio, a product from Microsoft, helps product teams with tools and technologies in all the stages of application development. Qualitia Automation Studio (QAS) helps replace the manual testing procedures in the application development processes by tightly integrating with Azure DevOps. This makes the application development process robust and simple. 

Qualitia's integration to Azure DevOps lets organizations leverage their existing investments as part of an integrated platform for automation testing development and allows managing automated test cases prepared by Qualitia inside Azure DevOps.The advanced integration with Azure DevOps has the following advantages over the offline package integration:

...


Key Benefits of QAS and Azure DevOps Integration:

  1. Seamless Synchronization: Effortlessly synchronize updated and new test cases easily , even when a pipeline is associated with involves several test cases. 

  2. Parallel Test Execution: Supports parallel execution of test cases to reduce the duration of pipeline executions.Allows to view the , reducing pipeline execution time.

  3. Result Visibility: View pipeline execution results from the both Azure DevOps server too.and within QAS.

Features:

With Azure DevOps advanced integration, you can:

  • Map Qualitia QAS Project to Azure DevOps Project.

  • Map Qualitia automated QAS test case to Azure DevOps test case.

  • Execute Qualitia QAS test cases locally in Azure DevOps (using self-hosted agents).

  • Run Qualitia QAS test cases as part of your Azure DevOps build pipelines

To integrate QAS with Azure DevOps, you need to first set up the environment.

Azure DevOps Integration

Let’s set up the environment, to get started with the Azure DevOps Integration. This section depicts information related to all the prerequisites and procedures to get prepared for QualitiaQAS's integration to Azure DevOps.

This section describes how Azure DevOps interacts with QAS components to execute QAS test cases successfully.

Qualitia has the following componentsComponents:

  • Qualitia Server

  • Qualitia Client

Whereas Azure DevOps provides the following two componentsComponents:

  • Azure DevOps as the Cloud Version

  • Azure DevOps Self Hosted Agent

The whole integration process of To integrate QAS with Azure DevOps is divided into 3 , follow these three key steps:

Association

...

Between Qualitia Automation Studio and Azure DevOps

...

This step involves initiating the association from within Qualitia Automation Studio (QAS)

...

Associate Qualitia Automation Project with Azure DevOps Project

...

, mapping projects and test cases between QAS and Azure DevOps.

Key Activities:

  • Map QAS Project to Azure DevOps Project: Establish a link between your project in QAS and the corresponding project in Azure DevOps.

  • Map Automated Test Cases: Link QAS automated test cases with Azure DevOps manual test cases and Association of Qualitia Suite and Azure DevOps Suite.Execution of associated Qualitia Automation tests from , ensuring that test cases are synchronized across both platforms.

  • Associate Test Suites: Map Qualitia Suites to Azure DevOps Test Suites to group relevant test cases for streamlined execution.

Execution Setup in Azure DevOps (One-

...

Time Setup)

...

This one-time setup

...

Setup build/release pipeline for execution associated Qualitia test cases

ensures that QAS test cases can be executed directly from Azure DevOps pipelines.

Key Activities:

  • Setup Build/Release Pipelines: Create and configure build or release pipelines in Azure DevOps to execute the associated QAS test cases.

  • Task Extension for Custom Tasks: Install the Qualitia Task Extension, which allows custom Qualitia tasks to be included in the pipeline installation. (Task Extension is used for Qualitia Custom tasks for pipeline installationSetup )

  • Configure Self-Hosted Agents: Set up a self-hosted Azure DevOps agent for executing the QAS test cases locally.

  • Agent Pool Setup: Create and configure an agent pool with agents setup for Qualitia executions

  • Result Publish of the Qualitia Automation tests

  • Publish results to test cases against the test runs (for each pipeline execution)

  • Publish test case results to Qualitia Automation Studioin Azure DevOps to manage agents responsible for running QAS executions.

Result Publishing and Execution

This step ensures that the results of the executed test cases are published and available both in Azure DevOps and within QAS.

Key Activities:

  • Publish Results in Azure DevOps: After each pipeline execution, results of the QAS test cases are published to Azure DevOps test cases and test runs.

  • Result Sync with QAS: Test case results are synchronized with Qualitia Automation Studio to provide a holistic view of the automation results within QAS.

The following table explains how different components of Azure DevOps and Qualitia QAS interact with each other.

Component

Roles Played in Different Stages

Azure DevOps

Association

  • Responds to Qualitia QAS server using standard out of the box APIs offered by Azure DevOps.

Execution

  • Configuration of build/release pipelines.

  • Agent pool configurations.

  • Initiate pipeline execution.

Result Publish

  • Host results of pipeline execution.

Azure DevOps Agent

Association

None

Execution

  • Executes of the jobs in the pipeline and along with the contained tasks.

  • Select Test Plan and Test Suite which contains Automated that contain the automated test cases and Suites in suites within the Azure DevOps projects.

Result Publish

  • Execution of the Publish Result task of Qualitia QAS to publish results to Qualitia QAS Server and Azure DevOps Test Runs.

  • Uses Qualitia QAS Server APIs to publish result.

Qualitia Server

Association

  • Interacts with the Azure DevOps server to update Automation Status automation status of Azure DevOps test cases.

Result Publish

  • Receives test case results directly from the Qualitia QAS - Client with the help of Qualitia QAS APIs.

Qualitia Client

Association

  • Allows the authorized users to view Azure DevOps projects and associate associated projects and test cases.

Execution

  • Publishes the test case cases to Qualitia QAS project repository. The published test case is cases are used in the Azure DevOps pipeline execution.

Result Publish

  • Shows the status of Test test cases executed through Azure DevOps pipeline in Real Time Reporting Portal.

Prerequisites

Prerequisites for Azure DevOps

Azure DevOps Version

  • Azure DevOps (Cloud Version)

  • Azure DevOps Server 2019

 Qualitia Plugins

Share Azure DevOps URL to Qualitia team to get the Get Assembly task plugin.

 Roles and Privileges

  • Azure DevOps Administrator must install the plugins from Shared Extensions.

  • Qualitia does not recommend this option for PAT generation as it changes the access levels for all the users in the group.

Note: Please connect with your Azure DevOps Admin team to discuss the PAT generation and access level management.

Qualitia integration with Azure DevOps expects that the user has “Update Work Items” access that is used to generate the PAT (Personal Access Token).

The PAT with required access can be procured in one of the following ways:

  • Generate the PAT with a user that is part of the Project Administrators group.
    Qualitia recommends this option for generating a PAT.

  • Allow Bypass Rules on Work Items Updates
    Perform the following steps:

    • In Azure DevOps project, ensure that the user that is used to generate PAT is member Contributors group / Project Team members group.

    • Click Project Settings > Permissions.

    • Select the user group that has the user to whom you want to provide access (Contributors/Project Team members).

    • From the Bypass rules on work items updates list, select Allow.
      Refer to the following screenshot.

  • Have project access to create the following:

    • A new pipeline (Build/Release)

    • An Agent Pool

Prerequisites for Qualitia

Roles and Privileges

  • You must have administrative privileges to access Qualitia Project that you want to integrate with Azure DevOps tests.

 Network Access

  • Ensure that the Qualitia Server URL is reachable from the Qualitia Client, Azure DevOps Server, and Azure DevOps agent.

Configuring Azure DevOps for Test Executions

QAS provisions to execute automated test cases from Qualitia QAS mapped to Azure DevOps, as a part of your build and release pipelines. In order to do so, you first need to add Qualitia - Test Execution extensions in Azure DevOps instance.

You can Follow the steps to add these extensions in Azure DevOps by following the steps mentioned herein.:

  • Before initiating Azure DevOps integration with Qualitia, you must share Azure DevOps organization details with Qualitia. Qualitia will then share the extensions which will help you to integrate Azure DevOps projects to Qualitia projects.

  • After Qualitia shares these extensions, you can add and install these extensions to use them in the build and release pipeline.

  • Once this task is shared by Qualitia in Azure DevOps instance, you may add, install, and use them in build and release pipelines.

 To add the Qualitia – Test Execution extensions into Azure DevOps instance:

...