With the Real-Time Reporting portal in Qualitia Automation Studio (QAS), you can monitor your test suite that are in progress or completed. It updates the results of a test suite execution in Real-Time after each step in the test case iteration is executed.
The portal opens automatically when executing a test suite in the following ways:
Through a QAS - Client. It directly shows you the Suite of Suites Screen.
Through an Offline Suite. It shows you a login screen if the offline suite is present on your machine and connected to the QAS’s Server. Ensure you have access to the associated project to monitor the progress of the test suite execution.
Real-Time Reporting only shows the reports of test cases executed through a TFS or Azure DevOps pipeline after the pipeline execution is completed. It does not support test cases run through HP ALM.
Accessing Real-Time Reporting Portal
To access the Real-Time Reporting portal, you need to get the Reports and Dashboards URL from your Qualitia Admin who installed the Qualitia Server. Alternatively, you can also access the Real-Time reports from the Reports tab in the QAS - Client.
📚Prerequisites:
Before running your test suite either through the Qualitia Client or an Offline Package, ensure the following:
Real-Time Reporting is enabled in the Execution Profile Settings.
The Real-Time Reporting Server has enough drive space to display the test suite results.
For offline suite execution, your computer is connected to the QAS - Server, and the Qualitia Server URL is set in the Settings tab of the Qualitia Offline Configuration Manager.
Additional Configurations for Log Files
You can change the logs generated with suite execution results in the execution profile settings. The settings you can change are:
Setting | Description |
Enable Real-Time Reporting | You can view the test execution results in the Real-Time Reporting Portal. If the Web Dashboards feature is enabled, these records can be viewed in the Dashboard portal. |
Maximum Size Per Log File | You can set the maximum size for every log file of a test suite execution. The default value is 1MB. |
Application Step Log Size | You can set the maximum size for logs of a step. The default is 1MB and the maximum you can set is 2MB. |
Application Log Level | You can choose the type of logs to generate the following: Info Logs, Error Logs, and All Logs. |
Suite of Suites Screen
On the Suite of Suites screen, you can view a list of test suite executions associated with the projects you have access to. You can filter the view to show test suite executions that are in progress, completed, aborted, or all of them. Additionally, it provides real-time updates on the progress of test suite executions, including their completion percentage.
For each test suite, you can view the following:
You can view the Test Suite Environment Details, such as:
Test suite name
Machine name
IP address
Project name
Test suite execution through QAS - Client is marked as Qualitia and test suite execution through offline suite is marked as Offline. In the case of offline suite executions via a Continuous Integration (CI) tool, the name of the CI tool used is specified alongside the suite execution result.
Hover over the Environment icon to view the operating system and browsers utilized for test case execution.
Total execution duration
Test suite execution details, such as:
Total number of test cases.
Breakdown of test cases - Passed, Failed, with Defects, and Not Executed.
Progress chart indicating the completion percentage of ongoing executions.
The Real-Time Reporting portal displays execution results in accordance with your local computer's time.
If a suite execution's progress displays a red dot, it signifies that the results are not updated in the last five minutes. In such cases, you should verify whether the test suite execution is still in progress or if there is a loss of connection to the Qualitia Server.
The Real-Time Reporting portal marks the suite execution results as Aborted if there is no update for more than an hour. For additional information, refer to Aborted Test Suite Executions.
Server Space Notifications
As the number of suite executions increases, the available storage for Real-Time Reporting assets diminishes. The Real-Time Reporting portal triggers notifications based on the available drive space:
10-30%: When the available space falls within the range of 10% to 30%, an amber warning message appears at the top of the portal. This message specifies the available drive space alongside the percentage. It is crucial to monitor the drive space and ensure it does not drop below 10%.
Less than 10%: If the available space is less than 10%, a red warning message will appear at the top of the portal. This message indicates that real-time reporting cannot provide information on new suite executions. Additionally, you cannot upload or save reports.
In both scenarios, reach out to the Qualitia Admin to initiate the process of purging reports. For detailed instructions on how to purge reports, refer to the Purging Reports section.