Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. Through a QAS - Client. It directly shows you the Suite of Suitesscreen.

  2. Through an Offline Suite. It shows you a login screen if the offline suite is present on your machine and connected to the QAS’s Server. Ensure you have access to the associated project to monitor the progress of the test suite execution.

Info

Real-Time Reporting only shows the reports of test cases executed through a TFS or Azure DevOps pipeline after the pipeline execution is completed. It does not support test cases run through HP ALM.

Accessing Real-Time Reporting Portal

To access the Real-Time Reporting portal, you need to get the Reports and Dashboards URL from your Qualitia Admin who installed the Qualitia Server. Alternatively, you can also access the Real-Time reports from the Reports tab in the QAS - Client.

📚Prerequisites:

Before running your test suite either through the Qualitia Client or an Offline Package, ensure the following:

  1. Real-Time Reporting is enabled in the Execution Profile Settings.

  2. The Real-Time Reporting Server has enough drive space to display the test suite results.

  3. For offline suite execution, your computer is connected to the QAS - Server, and the Qualitia Server URL is set in the Settings tab of the Qualitia Offline Configuration Manager.

Additional Configurations for Log Files

You can change the logs generated with suite execution results in the execution profile settings. The settings you can change are:

Setting

Description

Enable Real-Time Reporting

You can view the test execution results in the Real-Time Reporting Portal. If the Web Dashboards feature is enabled, these records can be viewed in the Dashboard portal.

Maximum Size Per Log File

You can set the maximum size for every log file of a test suite execution. The default value is 1MB.

Application Step Log Size

You can set the maximum size for logs of a step. The default is 1MB and the maximum you can set is 2MB.

Application Log Level

You can choose the type of logs to generate the following: Info Logs, Error Logs, and All Logs.
If you do not want any, select None.

Suite of Suites Screen

On the Suite of Suites screen, you can view a list of test suite executions associated with the projects you have access to. You can filter the view to show test suite executions that are in progress, completed, aborted, or all of them. Additionally, it provides real-time updates on the progress of test suite executions, including their completion percentage.

For each test suite, you can view the following:

  • You can view the Test Suite Environment Details, such as:

    • Test suite name

    • Machine name

    • IP address

    • Project name

Test suite execution through QAS - Client is marked as Qualitia and test suite execution through offline suite is marked as Offline. In the case of offline suite executions via a Continuous Integration (CI) tool, the name of the CI tool used is specified alongside the suite execution result.

Hover over the Environment icon to view the operating system and browsers utilized for test case execution.

  • Total execution duration

  • Test suite execution details, such as:

    • Total number of test cases.

    • Breakdown of test cases - Passed, Failed, with Defects, and Not Executed.

    • Progress chart indicating the completion percentage of ongoing executions.

The Real-Time Reporting portal displays execution results in accordance with your local computer's time.

If a suite execution's progress displays a red dot, it signifies that the results are not updated in the last five minutes. In such cases, you should verify whether the test suite execution is still in progress or if there is a loss of connection to the Qualitia Server.

The Real-Time Reporting portal marks the suite execution results as Aborted if there is no update for more than an hour. For additional information, refer to Aborted Test Suite Executions.

Server Space Notifications

As the number of suite executions increases, the available storage for Real-Time Reporting assets diminishes. The Real-Time Reporting portal triggers notifications based on the available drive space:

...