- Test Case / AC Ratio - It represents the automation coverage for all the epics in terms of implemented Qualitia test cases against the total acceptance criteria. A higher value indicates that an epic is covered from the test automation perspective.
- Defects / AC Ratio - This metric is represented through the ratio of number of defects for an epic to the number of acceptance criteria for that Epic. A high value indicates a higher defect density and potential quality concerns.
Data in this section is available only if there are any Qualitia projects integrated with Qualitia Design Studio.
Important Notes
- If there is no data present for the selected filter criteria, dashboard are displayed empty.
- To view the detailed information about any bar/line from the chart, hover your mouse pointer over that bar/line.
- By default, the dashboard Excel file opens in a full screen mode due to which you may not see the menu options. However, you can continue using standard Excel shortcuts as usual, such as CTRL + P to print, CTRL + S to save and so forth.
- These metrics will be calculated from when you start using the dashboard. The date from which the data is available is mentioned above the date selection.
- Acceptance criteria which were implemented and later deleted from Design Studio without any test case executions are not included while calculating the data (as the denominator in both the charts).
Date:
The date selector allows you to filter results based on the date. Please select any single date from here to load the dashboard results accordingly. In case you select multiple dates, charts displays details for the last selected date only.
Dashboard data is available for the duration mentioned above. You can select any date from this duration to view expected results in the dashboard.
Project:
You can filter the results displayed on dashboard using this project selector if you want to view results for a specific project.
After you select date and project, click the Refresh Charts for Selected Projects button to view the expected details in the charts.
Epic Comparison By Automation Coverage Percentage
This clustered column chart gives you an overview of the test case coverage for the selected epic. The percentage of the test coverage is calculated by test cases implemented for an epic divided by the number of AC for the epic.
While calculating the ratio, acceptance criteria which have been deleted without any test case execution are ignored in the denominator. For the numerator, only distinct test cases mapped to acceptance criteria are included in the count.
You can choose between top 5/10 or bottom 5/10 epics to be considered by selecting an appropriate option.
In the case of multiple epics having the same data, the information will be displayed only for top alphabetically matching epics in ascending order.
Epic Comparison by Defects / Acceptance Criteria Ratio
While calculating the count of defects in numerator, only the defects existing in the last execution of the test case on selected date are considered.
When generating dashboard for the first time, the data corresponding to latest execution of test cases comprising an epic is considered.
For example, suppose, an epic comprising of one acceptance criteria is implemented with 2 test cases; TC1 and TC2, TC1 is executed on 8th August and TC2 on 9th August. When dashboard is generated for the first time, on 10th August, the execution on the latest date for the epic (that is 9th August), corresponding to execution of TC2 will be used to determine whether there is any defect or not.
Also, for subsequent syncs, the metric will be calculated for all epics irrespective of whether the test cases from the selected projects' epic were actually executed / not on selected date. If the test cases for an epic were executed on selected date, latest execution on that day will be considered. If test cases are not executed on that day, the status from the latest execution prior to the selected date will be considered for the calculation of the metric.
While calculating the data:
- Only the test cases that are executed on the selected date are considered.
- If a test case is executed multiple times, only the last execution status will be considered.
- Partially executed* AC are also considered.
Only few test cases from the AC are executed and not all.
You can choose between top 5/10 or bottom 5/10 epics to be considered by selecting an appropriate option.
In the case of multiple epics having the same data, the information will be displayed only for top alphabetically matching epics in ascending order.
