Versions Compared

Old Version 17

changes.mady.by.user Sagar Dubewar

Saved on

compared with

New Version 18

changes.mady.by.user Sagar Dubewar

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
This section of the dashboard facilitates comparison of epics through metrics associated with quality and test coverage. Following two ratios have been defined for this purpose:
  • AC / Test Case ratio - It represents the coverage of acceptance criteria comprising the epic in terms of Qualitia test cases. A higher value indicates that an epic may not adequately covered from the test automation perspective.
  • Defects / AC Ratio - This metric is represented through the ratio of number of defects for an epic to the number of acceptance criteria for that Epic. A high value indicates a higher defect density and potential quality concerns.

Note

Data in this section is available only if there are any Qualitia projects integrated with Qualitia Design Studio.


Info
titleImportant Notes
  • If there is no data present for the selected filter criteria, dashboard are displayed empty.
  • To view the detailed information about any bar/line from the chart, hover your mouse pointer over that bar/line.
  • By default, the dashboard Excel file opens in a full screen mode due to which you may not see the menu options. However, you can continue using standard Excel shortcuts as usual, such as CTRL + P to print, CTRL + S to save and so forth.
  • These metrics will be calculated from when you start using the dashboard. The date from which the data is available is mentioned above the date selection.
  • Acceptance criteria which were implemented and later deleted from Design Studio without any test case executions are not included while calculating the data (as the numerator of the 1st chart and denominator of the 2nd chart).


Date:

The date selector allows you to filter results based on the date. Please select any single date from here to load the dashboard results accordingly. In case you select multiple dates, charts displays details for the last selected date only.
Dashboard data is available for the duration mentioned above. You can select any date from this duration to view expected results in the dashboard.

Project:

You can filter the results displayed on dashboard using this project selector if you want to view results for a specific project.

After you select date and project, click the Refresh Charts for Selected Projects button to view the expected details in the charts.

Epic Comparison

by Acceptance Criteria / Test Case Ratio

By Automation Coverage Percentage

This clustered column chart gives a view on the size and complexity of epics based on the coverage through Qualitia test cases. It displays the ratio between the number of acceptance criteria and the number of test cases implemented against all acceptance criteria for an epic (displayed on the x-axis).

Acceptance criteria with no test cases will also be considered while calculating the data.

You can choose between top 5/10 or bottom 5/10 epics to be considered by selecting an appropriate option.

Epic Comparison by Defects / Acceptance Criteria Ratio

While calculating the count of defects in numerator, only the defects existing in the last execution of the test case on selected date are considered.

When generating dashboard for the first time, the data corresponding to latest execution of test cases comprising an epic is considered.

For example, suppose, an epic comprising of one acceptance criteria is implemented with 2 test cases; TC1 and TC2, TC1 is executed on 8th August and TC2 on 9th August. When dashboard is generated for the first time, on 10th August, the execution on the latest date for the epic (that is 9th August), corresponding to execution of TC2 will be used to determine whether there is any defect or not.

Also, for subsequent syncs, the metric will be calculated for all epics irrespective of whether the test cases from the selected projects' epic were actually executed / not on selected date. If the test cases for an epic were executed on selected date, latest execution on that day will be considered. If test cases are not executed on that day, the status from the latest execution prior to the selected date will be considered for the calculation of the metric.

While calculating the data:

  • Only the test cases that are executed on the selected date are considered.
  • If a test case is executed multiple times, only the last execution status will be considered.
  • Partially executed* AC are also considered. 

(info) Only few test cases from the AC are executed and not all.

You can choose between top 5/10 or bottom 5/10 epics to be considered by selecting an appropriate option.