(v1) 🆚Comparison Reports

Test Case Behavior Across Two Suite Iterations

This horizontal bar chart helps analyze the behavior of test cases that were part of a test suite across two successive iterations. You can select two iterations of the Test Suite for comparison using the drop-down options, with the latest two suite iterations selected by default. The chart classifies test case behavior into four categories:

• Pass to Fail: Test cases that passed in the first selected iteration and failed (or had a defect) in the second selected iteration.

• Fail to Fail: Test cases that failed in both iterations.

• Fail to Pass: Test cases that failed in the first iteration and passed in the second iteration.

• Pass to Pass: Test cases that consistently passed in both iterations.

This chart allows you to prioritize which test cases need attention. In the context of this chart, a test case is considered failed if it either failed or had a defect. Hovering over a bar shows the category and the number of test cases in that category.

Suite Execution Time Statistics Over Last 5 Iterations

This dual Y-axis combo column chart displays execution time in seconds on the left Y-axis and the number of test cases executed on the right Y-axis. It shows data for a test suite across the last five iterations. You can select the desired suite from the top right corner of the page. If a Suite has fewer than five iterations for the selected date range, then the chart will display as many iterations are available for that Suite during that period. The column represents the execution time metric, and the line shows the number of test cases executed as part of the suite. The X-axis displays iteration numbers. Hovering over the column shows the name of the metric, its value, and the iteration number of the suite.