Document toolboxDocument toolbox

Header

OV_⚖️Suite Stability

Owned by Shruti Agrawal
Last updated: May 23, 2024
1 min read

Comparison of Suite Stability

This column chart is a tool to identify test suites with high failure rates across their executions. You can filter this chart by project, dates, and test suite(s). The X-axis displays the names of the test suites, while the Y-axis represents the failure rate in percentage.

The failure percentage is calculated as [(Number of occurrences of Test Cases with Fail Status) / (Number of occurrences of Test Cases with Pass, Fail, or Defect status)] * 100.

You can:

  • Hover over a column to view the name of the test suite and its percentage of failure.

  • Click the column to view detailed information about the suite.

  • Click the icon to go to another page with more charts focused on suite executions.

Trend of Suite Stability

This line graph plots the percentage of failures across suite executions over time, showing the trend in this metric. The trend line allows users to see if the number of failures is rising or falling over time, thereby identifying whether the suite is stabilizing. The Y-axis represents the failure percentage, and the X-axis shows the dates of suite execution.

Failures are counted using the formula = [(Total number of occurrences of Test Cases with Fail Status) / (total number of occurrences of Test Cases with Pass, Fail, or Defect status)] * 100

You can:

  • Filter this chart based on the date range and test suite. Charts are sorted in ascending order of dates.

  • Hover on a point to view the date and exact percentage of failure.

  • Click the line to go to the details of the test case execution for that suite.

 

Footer