Versions Compared

Old Version 14

changes.mady.by.user Dhiraj Chandanshive (Unlicensed)

Saved on

compared with

New Version Current

changes.mady.by.user Dhiraj Chandanshive (Unlicensed)

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

The following section provides information about how to set up and execute an offline package as a part of an Azure DevOps pipeline. 

The advantage of the Offline Package integration is that you can set up and configure the required Qualitia and ADO components easily and quickly. You can map an Azure DevOps pipeline with an offline suite that contains the associated test cases, which are not updated regularly. 

...

To configure the Offline Package file:

  1. Open the extracted Qualitia Offline folder.

  2. Open the config folder.

  3. Open the startupSettings file in a text editor, such as Notepad or Notepad++.

  4. Set the value of CI_Tool to Azure DevOps.

Mapping an Azure DevOps Pipeline with an Offline Suite

...

To map an Azure DevOps pipeline with an offline suite:

  1. Open the pipeline in Azure DevOps.

  2. Add

...

  1. Command Line Prompt Utilities pipeline

...

  1. task.
    To know how to add pipeline tasks, refer to https://docs.microsoft.com/en-us/azure/devops/?view=azure-devops

  2. Open the

...

  1. task and enter the following information in the Script:

    1. Enter the location of the 64-bit Java executable path enclosed with inverted commas.

    2. Add -jar separated by a space next to the Java path

    3. Add Qualitia offline suite jar path enclosed within inverted commas next to -jar.
      For example, "C:\Program Files\Java\jre1.8.0_261\bin\java.exe" -jar "D:\offlinesuites\Qualitia Offline\qualitiaoffline-8.3.1.jar"

    4. Optionally, you can enter the CLI Commands to override either the execution profile or specific settings of the mapped execution profile, such as browser type. For detailed instructions on how to use CLI Commands to override the settings, refer to Step 4 of Executing an Offline Suite using CLI Commands.

  2. Expand Advanced, enter the location of the offline suite enclosed within inverted commas in the Working Directory.
    For example, "D:\offlinesuites\PaymentModule\Qualitia Offline".

Info

Post the task execution, the following pipeline variables are available for reference in successive tasks of the pipeline:

  • TOTALTCCOUNT: Total number of tests in the offline suite

  • PASSEDCOUNT: Total number of tests passed

  • FAILEDCOUNT: Total number of tests failed

  • DEFECTCOUNT: Total number of tests resulted in defect

  • NECOUNT: Total number of tests that were not executed

Execution Guidelines and Best Practices

After mapping an Azure DevOps pipeline with an offline suite, you can now execute the mapped pipeline. To know how to execute an Azure DevOps pipeline, refer to https://docs.microsoft.com/en-us/azure/devops

...

If you have configured the Qualitia Server URL in the mapped execution profile, you can track the Azure DevOps offline execution in the Real Time Reporting Portal.

The suite execution result is displayed as Offline | Azure DevOps next to the suite execution name.

However, in certain cases, the offline suite execution results are not pushed to Qualitia Server or are partially pushed when the connection to Qualitia Server fails during the execution. In such cases, you can upload the locally saved suite execution reports to the Real Time Reporting Portal. For more details, refer to the following topics:

Limitations

  • Whenever any test case is updated or created, you must create the associated offline suites again and also map the associated pipelines with new offline suites.

  • You cannot have parallel executions of test cases.

  • QAS does not send the suite execution results to Azure DevOps.