- AC / Test Case ratio - It represents the coverage of acceptance criteria comprising the epic in terms of Qualitia test cases. A higher value indicates that an epic may not adequately covered from the test automation perspective.
- Defects / AC Ratio - This metric is represented through the ratio of number of defects for an epic to the number of acceptance criteria for that Epic. A high value indicates a higher defect density and potential quality concerns.
Data in this section is available only if there are any Qualitia projects integrated with Qualitia Design Studio.
Important Notes
- If there is no data present for the selected filter criteria, dashboard are displayed empty.
- To view the detailed information about any bar/line from the chart, hover your mouse pointer over that bar/line.
- By default, the dashboard Excel file opens in a full screen mode due to which you may not see the menu options. However, you can continue using standard Excel shortcuts as usual, such as CTRL + P to print, CTRL + S to save and so forth.
- These metrics will be calculated from when you start using the dashboard. The date from which the data is available is mentioned above the date selection.
- Test cases which were implemented and later removed for one reason or another are not included in the number of acceptance criteria considered in the numerator of the 1st chart and denominator of the 2nd chart.
Date:
The date selector allows you to filter results based on the date. Please select any single date from here to load the dashboard results accordingly. In case you select multiple dates, charts displays details for the last selected date only.
Dashboard data is available for the duration mentioned above. You can select any date from this duration to view expected results in the dashboard.
Project:
You can filter the results displayed on dashboard using this project selector if you want to view results for a specific project.
After you select date and project, click the Refresh Charts for Selected Projects button to view the expected details in the charts.
Epic Comparison by AC / Test Case Ratio
This clustered column chart gives a view on the size and complexity of epics based on the coverage through Qualitia test cases. It displays the ratio between the number of acceptance criteria and the number of test cases implemented against the acceptance criteria for an epic (displayed on the x-axis).
You can choose between top 5/10 or bottom 5/10 epics to be considered by selecting an appropriate option.
Epic Comparison by AC / Defects Ratio
While calculating the count of defects in numerator, only the defects existing in the last execution of the test case on selected date are considered. When generating dashboard for the first time, the data corresponding to latest execution of test cases comprising an epic is considered.
For example, suppose, an epic comprising of one acceptance criteria is implemented with 2 test cases; TC1 and TC2, TC1 is executed on 8th August and TC2 on 9th August. When dashboard is generated for the first time, on 10th August, the execution on the latest date for the epic (that is 9th August), corresponding to execution of TC2 will be used to determine whether there is any defect or not.
Also, for subsequent syncs, the metric will be calculated for all epics irrespective of whether the test cases from the selected projects' epic were actually executed / not on selected date. If the test cases for an epic were executed on selected date, latest execution on that day will be considered. If test cases are not executed on that day, the status from the latest execution prior to the selected date will be considered for the calculation of the metric.
You can choose between top 5/10 or bottom 5/10 epics to be considered by selecting an appropriate option.
