Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Test Execution Results Trend

This chart shows how test case results have changed over time. It's a stacked column chart, where each bar represents a date (shown on the x-axis) and the test results are piled on top of each other. You can change the filters to see data for a specific date, project, or test suite(s). The default view is for one day, but you can switch to view by week, month, etc. using the Group by filter. The color of the stacks represent test case results:

  1. Green stands for passed test cases.

  2. Red stands for test cases with defects.

  3. Amber stands for failed test cases.

  4. Grey stands for test cases that haven't been run.

...

This chart only shows data for web environment test cases. If the browser used during a test run isn't identified, it's listed under 'unidentified'.

 

Failures by Operating System

 

This chart uses vertical stacked columns to show how many tests failed on different operating systems. All test cases that failed or have defects are included. Click any stack in a column to see a detailed list of test cases and more info. This chart helps you quickly spot if there are any operating systems where test cases fail more often.

This chart only shows data for web environment test cases. If the operating system used during a test run isn't identified, it's listed under 'unidentified'.

 

Sorting Test Cases by Failure Rate

 

This chart categorizes test cases based on how often they fail over a selected period. Its purpose is to identify and list the test cases that fail most frequently. The Y-axis of the chart shows the number of test cases, while the X-axis displays the frequency of failure used to categorize the test cases.

 

The  The failure rate of test cases is calculated as follows:

Failure Rate = (Total occurrences of 'Fail' status / Total occurrences of 'Passed', 'Failed', and 'Defected' statuses) * 100

 

Note: In this calculation, test cases with a status of 'Not Executed' are not considered. Additionally, if a test case has been run multiple times, each instance is included in the failure rate calculation. 

Hover over any bar in the chart to see the number of test cases with that failure rate. 

By clicking on any bar, you can view a complete list of test cases that fall under the selected failure frequency rate.

 

This page shows the most recent status of a test case and the trend of its execution per iteration across all suites. You can filter the list of test cases based on Suite Name. In the 'Iteration Trend', it displays the status of all the test case's runs along with the iteration number.

...

The statuses of different test case executions are represented with the following colors:·      

  1. Greenstands for passed test cases.

...

  1. Redstands for test cases with defects.

...

  1. Amber stands for failed test cases.

...

  1. Greystands for test cases that have not been run.

...

By clicking an iteration, the drill-down displays complete information about the corresponding test case iteration in a grid view.