This view of the dashboard helps for the deeper analysis of the test execution results based on the test execution environment related factors. These factors include the browsers and operating systems used for the test executions.
Important Notes
- Dashboard data is available for duration mentioned above the date selector. You can select dates from that duration to view expected results in the dashboard.
- Use the clear (
) button to remove all the selections for that filter. Clicking this option selects all the available options for the corresponding filter. - To select multiple options for any filter:
- If you are using Microsoft Excel 2013, press and hold the Ctrl key and select required options from the list.
- If you are using Microsoft Excel 2016,
- either press and hold the Ctrl key and select required options from the list or
- use the multi-select (
) icon and then select required options from the list.
- If there is no data present for the selected filter criteria, dashboard are displayed empty.
- To view the detailed information about any bar/line from the chart, hover your mouse pointer over that bar/line.
- If a test case is executed multiple times in a selected time frame, multiple occurrences are counted while loading the metrics and charts.
- Based on the selection of items from lower filters (for example, Suite/Browser/Operating System, if applicable), Qualitia alters the project's list depending on the data availability. This condition is not applicable if any particular chart or matrix works only on the project selection.
- By default, the dashboard Excel file opens in a full screen mode due to which you may not see the menu options. However, you can continue using standard Excel shortcuts as usual, such as CTRL + P to print, CTRL + S to save and so forth.
- For charts with radio buttons, after changing any filters, reselect the radio buttons to view the expected data. Due to limited event handling procedures in Excel, you may not see refreshed data immediately after changing the filters.
Filters
- Date:
The date selector allows you to filter results based on the date of the test case execution. You can select either a single date or a date range using this date selector. You can select tenure from the available list. Available options are Days, Months, Quarters, and Years.
Dashboard data is available for duration mentioned above. You can select dates from this duration to view expected results in the dashboard.
- Project:
You can filter the results displayed on dashboard using this project selector if you want to view results for a specific project or a group of projects from all the available list of projects.
- Suite:
You can filter the results displayed on dashboard using this Suite selector if you want to view results for a specific Suites from the selected project(s). Suite names will be displayed only once if multiple suites with the same name exist across multiple projects.
- Browser:
You can filter the results based on the browser which has been used for the test cases executions. You can select one or multiple browsers from the list.
- Operating System:
You can filter the results based on the operating Systems in which the test cases has been executed. You can select one or multiple OSs from the list.
- Host Type:
This filter gives you provision to view results for selected host types on which test cases are executed. You can select one or multiple host types from the list.
The background colors of the filter options indicate different states of these options:
- Blue background indicates that this option is selected.
- Grey background indicates that this option is not selected but the data exists for that option.
- White background indicates that this option is not selected and data does not exist for that option.
Test Execution Results Trend
This chart displays the trend of test case execution results by time. In this stacked column chart, each bar represents a single date (mentioned on the x-axis) and test execution results are stacked on each other. You can filter this chart for specific Date, Project, Test Suite, or Status based on your requirements by selecting corresponding options from the filters. Colors of these stacks represent Qualitia test case execution results as follows:
- green refers to the passed test cases,
- red refers to the test cases with defects,
- amber refers to the failed test cases, and
- grey refers to the test cases that are Not Executed.
If test cases are marked for the execution and are not executed due to ongoing error flags or any such reasons, they are reported as Not Executed.
Failures by Browser
The horizontal bar in this chart displays the number of failed tests against the browsers on which the test cases were executed. You can click any bar from the chart to view the detailed list of test cases and other related information. For the purpose of this chart, test cases with occurrences of both, Defects and Failures, have been included to determine the number of failures. This chart enables you to quickly identify whether there are any browser(s) on which test cases have higher incidence of defects or failures.
Failures by Operating System
The horizontal bar in this chart displays the number of failed tests against the operating system on which the test cases were executed. You can click any bar from the chart to view the detailed list of test cases and other related information about the same. This filter considers all the test cases that are failed or have defects in them.This chart enables you to quickly identify whether there are any operating systems on which test cases have higher incidence of defects or failures.
Sometimes, comparison and drill down with the help of bars may be difficult due to low number of test cases for any operating system or browser. In such cases, you may use the status filter to select and drill down to the detailed information about such test cases.
