After execution of tests, reports are required for analysis. Test execution reports help you to understand the application stability to drive further plan of actions.
Qualitia test execution report offers you information regarding time of test execution, status summary, and status of each step in the test execution process.
Accessing Reports
After every test execution, Qualitia generates the test execution report. You can view the test execution report for a specific Release Number, Date, or Executions of the application under test.
Software Release: A software release is the private or public distribution of an initial or upgraded version of a software product.
Software Build: Builds are enhancements and fixes made on the application under test within a release, which are delivered to the test team to perform test on these builds.
To view a test execution report:
- Click Report.
The Reports screen is displayed. This is a Report List. The status of the latest twenty suites within the current project is listed in a tabular format. These Suites are sorted on the Generation Date in descending order.
You can apply filters based on Generated on Date, Release, and/or the Suite to view a specific report. - Click the Show Calendar drop-down arrow and select the Date, if required.
- Click the Select Release drop-down arrow and select the Release Number.
- Click the Select Suite drop-down arrow and select the Suite.
- Click Go.
The list of Text Execution Reports related to the selected values is displayed in a screen. - To view a detailed Test Execution Report of an execution, double-click a specific execution in report list.
A detailed test execution report and logs for a specific execution are displayed on the screen.
Understanding Test Execution Report
Qualitia displays the report on test execution results after the tests are executed. The test execution report is displayed even if the test is not concluded successfully.
Details of Report List
The Report list is displayed showing the status of the latest twenty executions within the current project in a tabular form. These executions are sorted on the Generation Date in descending order.
The Report list describes Suite Name, Schedule Name, Build, Release, Iteration Number, User Name, Generated On, and Status of each Suite of the current project.
Details of a Test Execution Report
The Test Execution Report displays a detailed summary of the test execution performed of a specific suite. It includes Project Name, Suite Name, Build Number, Release Number, Iteration, Start Time of the Execution, End Time of the Execution, Passed Test Cases, Failed Test Cases, Not Executed Test Cases, and Defected Test Cases.
The details log gets generated during execution process which is integrated within the execution report to quickly analyze the results and identify application defects and resolve automation failures.
It also displays a tabulated tree list of test cases associated with the executed suite. This list includes Name of the Test Case, its Status, its Scenario, Task and Step details (Object and Action), and Test
Data used to perform the test.
The tree can be expanded/collapsed at every test case level to view/hide the task and steps within a test case. Clicking on any particular step in the report will navigate to the logs information specific to that step to analyze the results.
It displays Info Log, Error Log, and Debug Log on the bottom pane of the screen.
The following table describes the details of columns displayed in report.
Heading | Description |
Test Case Name | The status of the selected test case and the sequence and status of tasks associated with the selected test case |
Status | The status of the selected scenario and the sequence and status of test cases associated with the selected scenario |
Scenario | Indicates the name of the scenario |
Object | Indicates the Object name |
Action | Indicates the action associated with an object |
Data | Indicates the data associated with an action |
Understanding Report Legends
In Qualitia, color coding used in various reports is described as follows:
Export To Excel
Export to Excel feature enables you to export the summary report in a spreadsheet to a desired location. This feature exists in the Report tab of Qualitia Automation Tool.
You need to enable macros in Microsoft Excel before using this feature of Qualitia Automation Tool.
To export the summary report to Microsoft Excel:
1. Go to the Report tab in Qualitia and open any report whose summary report is to be exported in a spreadsheet.
2. Click the link "Export To Excel" available on the right most upper corner in the Report tab. A spreadsheet opens up showing the summary report.
3. To save this spreadsheet, use Save As option available in the Microsoft Excel. Give the desired name and select the file type .xlsx only.
- Save the spreadsheet only in .xlsx file format.
- We recommend that you use only Microsoft Excel to save the summary report as the feature has not been tested with other spreadsheet format.
- This feature does not support old reports and will display an error message, "Export of this report is not supported by the current version. Please check the release note."