Document toolboxDocument toolbox

Updating Test Execution Properties Run-time

Owned by ravi.chandran (Unlicensed)
Jul 14, 2021

Qualitia gives you the provision to override the basic set of configurations provided under Qualitia Remote Agent. This gives you the flexibility to change the configurations settings for executing test cases at run-time based on the release/build requirements without updating configuration settings under Qualitia Remote Agent every time before you run the build or release pipelines.

In order to do so, you must configure the Visual Studio Test task under release and build pipelines accordingly.

Important Note

By default, Azure DevOps considers settings provided in the .runsettings file while test case execution. It is important to have this file in your source code of the application under test so that Azure DevOps can access and use settings provided in this file while executing Qualitia automated test cases.

  1. Copy the content provided in the box below, add it in an empty file.
  2. Save this file in the source code directory with .runsettings extension.

<?xml version="1.0" encoding="utf-8"?>
<RunSettings>
<TestRunParameters>
    <Parameter name="QualitiaRuntimeSettings" value="" />
    <Parameter name="QualitiaEnvironmentSettings" value="" />
</TestRunParameters>
</RunSettings>

The same file can also be used to update the environment variables runtime which were created and used while developing test cases in Qualitia automation studio.   

Add the desired values in key=value pairs against QualitiaEnvironmentSettings in the .runtimesettings file in the following format and you are good to go. 

Configuring Visual Studio Test Task

You must configure Execution options in the visual studio test task under build and release pipelines to be able to update execution properties run-time. 

To configure Execution options under Visual Studio Test task:

  1. Launch Azure DevOps instance.
  2. Edit existing or create new build/release pipeline.
  3. Click the Visual Studio Test task and its details will appear in the right pane.
  4. In the Execution Options section, enter the detail as explained in the table below:
Execution Options
Settings File 

Select the .runsettings file you added in the source code directory. You can select this file using the browse button.

Override test run parameters

Enter the parameters you want to override from the configuration settings provided under Qualitia remote agent. Parameters should be given in the key=value pairs enclosed in the double inverted comma in the following format. Multiple parameters should be given in separated by a semicolon (;). You can give as many parameters as you want using this method.

-QualitiaRuntimeSettings "BrowserName=googlechrome;chromedriverpath=C:\Program Files (x86)\Common Files\Qualitia\WD\QualitiaIntegrationRemoteAgent\WebDriver\Selenium\chromedriver.exe"
-QualitiaEnvironmentSettings "AppUrl=http://www.dev.google.com;username=devuser01;"

Alternatively, you can perform through Azure DevOps by performing the following steps:

  1. Define a Pipeline variable as URL along with its value. If this variable already exists, then it is overridden.
  2. In the Pipelines, open the VsTest - testAssemblies, in the Override Test run parameters, enter the following details:
    1. Name as QualitiaEnvironmentSettings
    2. Value as OpenURL=$(URL), in which OpenURL is the Qualitia Environment variable and URL is the Azure DevOps variable.

You can leave all the other fields to their default options or you may configure it based on the release or build pipeline requirements.