Configuring a Build Pipeline

Executing Qualitia test cases mapped to Azure DevOps tests in the build pipeline requires you to configure the build pipeline accordingly. Configuring a build pipeline includes adding a Visual Studio Test Task and configuring it for the build pipeline.

You must add and configure a visual studio test task to get all the required information from Qualitia and execute Qualitia test cases as a build pipeline.

To configure a Build Pipeline:

Launch Azure DevOps instance.
Edit existing build pipeline or create new build pipeline.
Add a Visual Studio Test Platform Installer.
Add a Get Assembly Task.
For more information, refer to Configure Qualitia-Get Test Assembly Task.
Add an Agent Job.
(Optional) To execute test cases in parallel, click Execution> Parallelism, click the Multi-Agent button, and enter the number of Azure DevOps agents that you want to use, in Number of agents.

Qualitia recommends not to configure more than 5 Azure DevOps agents on a system for parallel execution.
Ensure that the number of Azure DevOps agents must be same and running on the system where you want to execute.
Add new Visual Studio Test Task and fill up the details as mentioned in the table below for the Test Selection section:

Test Selection
Display Name	Enter the desired display name.
Select tests using	Select Test Plan option to execute tests from the test plan which have Qualitia automated test cases attached to it. Qualitia supports this option only.
Test Plan	Select a test plan containing test suites with Qualitia automated test cases.
Test Suite	Select test suites containing Qualitia automated test cases. You can select more than one suites here.
Test Configuration	Select test configuration.
Search folder	This is the directory system will search for the test assemblies. This field comes pre-populated and should be same as the Path to save Qualitia Test Project settings set under Qualitia-Get Test Assembly task. For more information on updating value set under this variable, refer to Azure DevOps documentation.
Test mix contains UI tests	This option enables to run UI tests. This option has no significance with reference to Qualitia automated test cases and is deselected by default. For more information on configuring agent to run in interactive mode, refer to the Azure DevOps documentation.

For executing Qualitia automated test cases as a build pipeline, it is mandatory to fill up the information for these fields as mentioned in the table above. You may fill up the information in other sections like Execution options, Reporting options, and Control options, and so forth based on the project and build pipelines requirements.