Document toolboxDocument toolbox

A new version of Qualitia Automation Studio for Web and Mobile 7.2.x is now available. We highly recommend you upgrade. Find more details here.

Management View

The Management view is a complete consolidated overview of the test execution results across projects. You can filter these details based on the timeline and projects. This view also helps in the comparison of number of defects and test execution time across Suites from the selected projects.

Additionally, the doughnut chart displays percentage of tests that are failed, passed, have defects, or not yet executed.


Important Notes

  • Dashboard data is available for duration mentioned above the date selector. You can select dates from that duration to view expected results in the dashboard.
  • Use the clear () button to remove all the selections for that filter. Clicking this option selects all the available options for the corresponding filter. 
  • To select multiple options for any filter:
    • If you are using Microsoft Excel 2013, press and hold the Ctrl key and select required options from the list.
    • If you are using Microsoft Excel 2016,
      • either press and hold the Ctrl key and select required options from the list or
      • use the multi-select () icon and then select required options from the list.
  • If there is no data present for the selected filter criteria, dashboard are displayed empty.
  • To view the detailed information about any bar/line from the chart, hover your mouse pointer over that bar/line.
  • If a test case is executed multiple times in a selected time frame, multiple occurrences are counted while loading the metrics and charts.
  • Based on the selection of items from lower filters (for example, Suite/Browser/Operating System, if applicable), Qualitia alters the project's list depending on the data availability. This condition is not applicable if any particular chart or matrix works only on the project selection.
  • By default, the dashboard Excel file opens in a full screen mode due to which you may not see the menu options. However, you can continue using standard Excel shortcuts as usual, such as CTRL + P to print, CTRL + S to save and so forth. 
  • For charts with radio buttons, after changing any filters, reselect the radio buttons to view the expected data. Due to limited event handling procedures in Excel, you may not see refreshed data immediately after changing the filters.

Filters

  • Date:

The date selector allows you to filter results based on the date of the test case execution. You can select either a single date or a date range using this date selector. You can select tenure from the available list. Available options are Days, Months, Quarters, and Years
Dashboard data is available for duration mentioned above. You can select dates from this duration to view expected results in the dashboard.  

  • Project:

You can filter the results displayed on dashboard using this project selector if you want to view results for a specific project or a group of projects from all the available list of projects.

The background colors of the filter options indicate different states of these options:

  • Blue background indicates that this option is selected.
  • Grey background indicates that this option is not selected but the data exists for that option.
  • White background indicates that this option is not selected and data does not exist for that option.

Metrics

The boxes present at the top display following information for selected date(s) and project(s):

  • Tests Executed: Displays the total number of test cases that have been executed.
  • Total Pass: Displays the total number of passed test cases.
  • Total Fail: Displays the total number of failed test cases.
  • Total Defects: Displays the total number of test cases that have defects.
  • Tests Not Executed: Displays the total number of test cases that are marked for execution but did not get executed due to one reason or another.

30-Day Trend

The green line in each box indicates trend of these test cases for the 30-day period prior to the selected end date.

Charts

Number of Test cases with Defects by Test Suite

This chart enables comparison of Test Suites by the number of defects reported after execution of Test Suite. Each bar corresponds to one Test Suite. These suites are grouped by projects. You can click any bar to view the detailed list and other related information on test cases present in Test Suite. It is recommended to select limited projects to enhance the readability of this chart. You can use Zoom In/Zoom Out buttons to further increase the size of the chart.     

(info) Few of the bars may not have Test Suite names mentioned on the x-axis. Hover your mouse pointer over such bars to view the suite related information. 

(warning) In case you change the suite name, the latest name appears in the chart and drill-down views. Both the instances, with old and new name, will be considered while calculating the data. 

Test Execution Time Statistics

Using this chart, you can view the top 5 longest and shortest run test suites. The average execution time is computed for each Test Suite from selected Project(s) across all execution iterations during the selected date range. The black line across the bars indicates the count of test cases in the corresponding Test Suite (presented on the right side Y-axis). You can click any bar to view the detailed list and other related information on test cases present in the test suite.

In the case of multiple suites having the same data, the information will be displayed only for top alphabetically matching suites in ascending order.

Test Execution Status

This chart displays the percentage of Passed, Failed, Defected, and Not Run test cases against the total number of test cases from the selected projects and date range.

Also, the segment colors represent various test execution statuses. Green represents pass, red represents defect, amber represents fail, and the grey color represents the Not Executed status.

Not finding what you need?