Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Introduction: For Software Development Engineers in Test (SDET), executing tests offline provides flexibility, especially when there 's is no immediate access to the main software or in environments with limited connectivity.

This guide will walk walks you through the process of working with offline suites in the Qualitia Automation Studio (QAS) using Command Line Interface (CLI) commands.

📚Prerequisites:

  • Access to the Qualitia Automation Studio ( QAS ) Client.

  • An offline package saved on your computer.

  • Basic familiarity with Command Line Interface ( CLI ) operations.

🔂

...

Procedure

...

Execute Offline Suite using CLI Commands

You want to run tests offline using command prompt due to limited access to the QAS client.

...

The offline package runs the chosen offline suite with its set execution profile, which can be customized to override pre-configured settings.

  1. If testing on a mobile platform, ensure the execution profile has the right system requirements and settings.

  2. For remote or cloud executions, follow the guidelines for the respective environments. 

To execute an offline package using CLI commands.

  1. Open the Command Prompt.

  2. Navigate Go to the location of your where you have saved the offline package.

  3. InputEnter the following code: java -jar qualitiaoffline-89.60.x.jar to execute the

    1. The offline package

    with
    1. is executed using the

    default
    1. settings

    .However, if you wish to override certain settings
    1. defined in the Qualitia Offline Configuration Manager.

  4. Override any of the following parameters:

    1. Mapped Execution Profile :– Enter the location of the execution profile Execution Profile you want in the following ways:

      1. The location of the execution profile must be enclosed by double inverted commas. Note that you do not require any key.

      2. It Your first argument must be the first argument. For exampleas follows: java -jar qualitiaoffline-89.60.x.jar "D:/ABCsettings.JSON"

    2. Offline Suite : – Enter the location of the offline suite as SuitesDir="Suite_Path".
      For example, java -jar qualitiaoffline-89.60.x.jar SuitesDir="D:/OfflineSuite/Suite1"

    3. Environment Variable : Enter – Enter the environment variables and their associated values in the following format: java -jar qualitiaoffline-89.60.x.jar env.var1=value1 env.var2=value2. Here, var1 and var2 denote the environment variables, and value1 and value2 denote the associated values. For example, java  java -jar qualitiaoffline-89.60.x.jar env.username=john.smith env.password=12345

    4. Other Parameters defined in the Selected selected Execution Profile: – Enter the parameters preceded by their hierarchy in name=value format as command-line arguments. For example, to use a specific version of Google Chrome, enter the command line argument as follows :- java -jar qualitiaoffline-89.60.x.jar googleChrome.version=81.0.1.36 . In this example, googleChrome Google Chrome is the topmost parameter and then followed by its version. You can may provide multiple property=-value pairs separating them with space, as shown in the following example :
      - java -jar qualitiaoffline-89.60.x.jar googleChrome.version=81.0.1.36 PageTimeoutInSeconds=10.

      1. If you are overriding the mapped execution profile, enter it as the first

      argument, as shown in the following example:
      1. argument as this - java -jar qualitiaoffline-

      8
      1. 9.

      6
      1. 0.x.jar "D:/ABCsettings.JSON" googleChrome.version=81.0.1.36 PageTimeoutInSeconds=10

      2. If a key has a dot in its name, you need to put backslash before the dot, such

      as 
      1. as  chrome.chromedriverVersion, which is under

      androidChrome,
      1. Android Chrome as shown

      in the following example:
      1. here -
        java -jar qualitiaoffline-

      8
      1. 9.

      6
      1. 0.x.jar androidChrome.chrome\.chromedriverVersion=83

  5. Press Press Enter to initiate start the offline suite execution.

...

View Offline Suite Execution Report

After running the tests, you need would want to review a comprehensive report to analyze the results.

  • Instantly You can check the results on the Real Time Reporting Portal.

  • Additionally, the offline suite creates a detailed summary report based on the location set in the Qualitia Offline Configuration Manager 's > General Settings tab.

  • If the report isn't You can manually upload the locally saved report, if it is not available on the Real-Time Reporting Portal after completion, because of for any of the following reasons:

    • Qualitia Server URL is not configured in the offline suite.

    • Connection to Qualitia Server fails during offline suite execution.

you can manually upload the locally saved report.

...

Edit Test Data for

...

Offline Suite

Before re-running tests or for a different testing scenario, you might need to change some test data.

One way to modify is through the Qualitia Client:You can edit test data for an offline suite either using Qualitia Client or test data Excel file present in Offline Suite folder.

Editing the Test Data using Qualitia Client

  1. Open your test case from the client.

  2. Access the Test Data Explorerexplorer to edit.

  3. After changes, recreate Once done, re-create the offline suite.

    1. Refer to the section Work with Offline Packages.

...

Edit Test Data using Test Data File

You can also edit the test data directly in the Excel file located in the Offline Suite Folder folder. But, using However, it is recommended to edit through the Qualitia Client is recommended as it provides error alerts for incorrect data modifications.By following this guide, you can efficiently set up, execute, review, and modify offline tests in QAS, ensuring a versatile and adaptable testing process.

Info

 Qualitia recommends using the Qualitia Client because it displays ❌ error message when change in test data is incorrect.

Editing Test Data in Offline Suite Test Data File

In scenarios where access to the Qualitia Client is limited, the offline suite provides flexibility by allowing you to directly modify test data . This guide simplifies the process for you, ensuring that they can quickly and effectively adapt their test cases as neededthrough the Excel file present in Offline Suite folder.

After the offline suite is created, for every test case that contains test data, the associated test data as excel files are created in the same folder with the same names as given to their associated test cases. You can modify the test data such as replace the existing test data and enable or disable TC iterations.

...

You want to quickly adjust test data without altering the structure of the file.

Note
  1. Don 't not add or remove columns, or change the column order.

  2. Use $NULL$ where you don 't not want to set a value for a parameter.

  3. Delete rows for unwanted task or test case (TC) iterations.

Steps to Modify Test Data for an Offline Suite

  1. Go to the offline suite Offline Suite folder.

  2. Backup the test data file you 'll want to edit.

  3. Open the test data Excel file.

  4. From the third row, tweak values as needed. The first row shows tasks in grey, with the second row detailing their parameters.You can update the values for the below fields, as needed.

    1. TC Iteration: Shows the number for every TC Iteration. There must be at least one TC Iteration for executing the test case.

    2. Selection: Shows as True  or False for for the enabled or disabled iterationstest case iterations; Otherwise, it shows False. You can modify the values . This is applicable for TC iterations onlyonly for test case iterations.

    3. DataSetTag: Optionally, enter a label for identifying the dataset in the test case execution report. You can modify the values.

  5. To add a TC iteration, insert a row with values for TC Iteration Number, Selection, and DataSetTag (optional).

  6. For adding a task iteration, insert a row with values for associated parameters.

  7. Save the Excel file after editing.

...

The first row of the Excel file shows tasks in grey and the second row shows the corresponding task parameters. So, these rows are not editable. You can edit test data from the third row onwards.

Execute Offline Suite on a Shared Drive

You want to execute tests located in a shared location, either for collaborative purposes or due to infrastructure constraints. You can run an offline suite can execute an Offline Suite present in a shared drive for web and mobile applications in two one of the following ways: by

  • By mapping the shared drive to

...

  • the local computer

...

  • .

  • Without mapping the shared drive to the local computer.

...

Execute a Shared Offline Suite by Mapping

...

For a more seamless experience, you might prefer mapping the shared drive to your local system.

  1. Copy both the offline package and suite to the shared drive ensuring .

    1. Ensure you have the read and write permissions.

  2. Map this shared drive to your local computer.

  3. Adjust Update the offline suite settings, as neededrequired.

    1. For

    a detailed guide, look into
    1. details, refer to Configuring the Settings for an Offline Suite.

  4. To execute: Use , follow one of these approaches:

    1. Using the Command Prompt,

    navigate
    1. go to the mapped location

    ,
    1. and execute the offline package with the right command.

    Refer
      1. For details, refer to section Executing Offline Suite using CLI Commands.

    Or
    1. Open the mapped driver and simply double-click the offline package (9.x.x jar)

    in the mapped drive.

By following this guide, you can efficiently manage, adjust, and execute their test scenarios, ensuring accurate results even in offline or shared environments.

...

    1. .

Execute a Shared Offline Suite Without Mapping the Shared Drive to the Local Computer

To execute a shared drive without mapping the shared drive to the local computer:

  1. Copy the offline package along with the offline suite to the shared drive with .

    1. Ensure you have the read and write

    access
    1. permissions.

  2. Open the shared location and double-click the offline package (9.x.x jar).

Info

Note: You cannot execute an offline suite using the command prompt by specifying the complete UNC (Shared location).

Execute Offline Suite

...

for Desktop Applications on a Shared Drive

You can execute an offline suite present in a shared drive for desktop applications.

...

  1. Configure the offline suite as per the requirements. For detailed instructions, refer to Configuring the System Execution Profile Settings for a Desktop Project.

  2. Do one of the following: 

    • Open command prompt, navigate to mapped drive location that contains the offline package and offline suite.

    • Navigate to the mapped drive location that contains the offline package and the offline suite and double-click the offline package (9.x.x jar).

...

Execute Offline Suites

...

Introduction:

...

using CLI

Qualitia supports integration with Continuous integration tools like Jenkins, TeamCity, and Bamboo. It enables developers to find and solve defects in a code base rapidly and to automate testing of their builds.

When you want to execute your test cases using CI tools, you must set the CI_Tool property in the mapped execution profile.

If your test case is for mobile applications, Appium Server is internally hosted on Qualitia client. However, still you can use a custom Appium server if you want to test on another Appium version. 

Executing an Offline Suite from a Shared Drive without Local Mapping:

Method: Direct execution from the shared drive. Steps:

  1. Copy both the offline package and suite to the shared drive, ensuring you have read/write permissions.

  2. Directly access the shared location and initiate the offline package by double-clicking on the 89.60.x jar file.

Info

Note: Using the command prompt with the full UNC path for execution isn't supported.

Execution using Continuous Integration Tools:

Method: Integration via QAS settings.

...

  1. Open the Command Prompt.

  2. Navigate to the directory containing the offline package.

  3. To run on Chrome, use: java -jar qualitiaoffline-xxxx.jar googleChrome.chromeOptions.args=--headless

  4. For Firefox execution, input: java -jar qualitiaoffline-xxxx.jar firefox.firefoxOptions.args=--headless

...

  1. headless

...