Document toolboxDocument toolbox

Header

(8.5.X) Configuring a Release Pipeline

Executing the Qualitia test cases mapped to Azure DevOps tests in the release pipeline requires you to configure the release pipeline accordingly. You must add and configure a visual studio test task to get all the required information from Qualitia and execute Qualitia test cases as a release pipeline. 

To configure a Release Pipeline:

  1. Launch Azure DevOps instance.
  2. Edit existing release pipeline or create new release pipeline.
  3. Create an Agent Job.
  4. (Optional) To execute test cases in parallel, click Execution> Parallelism, click the Multi-Agent button, and enter the number of Azure DevOps agents that you want to use, in Number of agents.

    Qualitia recommends not to configure more than 5 Azure DevOps agents on a system for parallel execution.

    Ensure that the number of Azure DevOps agents must be same and running on the system where you want to execute .

  5. Add a Visual Studio Test Platform Installer.
  6. Add a Get Assembly Task.
    For more information, refer to Configure Qualitia-Get Test Assembly Task.
  7. Add a new Visual Studio Test Task and fill up the details as mentioned in the table below for the Test Selection section:
Display NameEnter the desired display name.
Test Selection
Select tests using 

Select the method using which you want to select Qualitia automated test cases for execution:

  • Test plan: Use this option to execute tests from the test plans which have Qualitia automated test cases attached to it. (recommended)
  • Test run: Use this option when you are setting up an environment to run tests from test plans.
Test PlanSelect a test plan containing test suites with Qualitia automated test cases
Test SuiteSelect test suites containing Qualitia automated test cases. You can select more than one suites here. 
Test ConfigurationSelect test configuration.
Search folder

This is the directory system will search for the test assemblies. This field comes pre-populated.

For more information on updating value set under this variable, refer to Azure DevOps documentation.

Test mix contains UI testsThis option enables to run UI tests. This option has no significance with reference to Qualitia automated test cases and is deselected by default. For more information on configuring agent to run in interactive mode, refer to the Azure DevOps documentation.


For executing Qualitia automated test cases as a release pipeline, it is mandatory to fill up the information for these fields as mentioned in the table above. You may fill up the information in other sections like Execution options, Reporting options, and Control options, and so forth based on the project and release pipelines requirements. 

Footer