You can access a Summary report of your test suite execution by clicking on it in the Suite of Suites screen.
This report will show you the execution status of every test case and their iterations. It also shows how long each test case took to run, including the start and end timestamps. In this report, you can view a tally of all test cases, and breaks it down into how many passed, failed, had defects, and didn't run.
Here’s some more info you’ll see in the report:
Detail | Description |
Status icon | This shows the number of test case iterations that failed or had defects, and the total number of iterations. A refresh icon means a relevant test case iteration is currently running. If your project is linked with a defect management system, a bug icon will appear for any automatically or manually logged defects. Hover over the bug icon to see all related defect IDs and their links. It will also show whether the defect was logged automatically. |
Test Case Element | This is the test case name or a test case iteration number. |
Module | This is the name of the module linked with the test case. |
Epic | This is the name of the associated epic. |
Story | This is the name of the related story. |
Scenario | This is the name of the associated test scenario. |
Manual TC Id | This is the associated manual test case ID. |
Note: the time it took to launch UFT is not included in the execution time for suites run on desktop applications.
Also, the Module, Epic, and Story columns appears if the test suite's associated project is linked with a Qualitia Design Studio project.
If your test suite execution is still running, a blue sticky status bar will appear at the bottom of your screen. This bar will show you:
The name of the test case currently running
The number of the current iteration and the total number of iterations
A timer showing how long the execution has been running.
Customizing and Sharing the Test Suite Execution Summary Report
You have a lot of options when it comes to managing your Test Suite Execution Summary Report. Let's go through them:
Filtering the Report
You can create a more focused list of test cases in your report by applying filters. This can be done based on their status, associated test case, modules, epics, stories, scenarios, and Manual TC Ids.
Here's how you do it:
Click the Filter button.
Pick the filters that suit your needs.
You also have the option to filter the report by clicking on a status in the top-right corner.
Exporting the Report
If you need to share the report in an Excel format, you can do this too.
To export the report:
Click the three dots and select Export to Excel.
Sharing the Report
You can share the report link, complete with any filters you've applied, with other Qualitia users who have access to the same project.
To share the report:
Click the three dots and select Share Link.
Click Copy to get the link.
Wrapping up the Report
If any cell in the report shows more than 100 characters, you can use the Wrap Text button to see all the data in the cell.
Customizing the Report
If you want to change which columns are visible in your report:
Click the three dots and select Table Config.
Saving the Report
You can save your report as an offline HTML file on your local machine.
To do this:
Click the three dots and select Save As Report.
The report will be saved in your browser's specified Download folder.
Manually Logging a Defect
For any test case iteration that has a Pass, Fail, or Defect status, you can manually log a defect. Your project should be set up with a Defect management System like Jira or TFS/Azure DevOps for this. For more information, refer to the Integrating a Qualitia Project with Defects Management guide.