Document toolboxDocument toolbox

Defect Management Systems

Qualitia Automation Studio supports integration with the following defect management systems:

  • Jira

  • TFS/Azure DeveOps

You can configure a QAS project to log a defect in the defect management system for a test case iteration execution.


When a defect is logged automatically or manually for a test case iteration, Qualitia does not verify whether the defect for that iteration is already created.

Integrating a QAS Project with a Defect Management System Project

You can integrate a QAS project with any Jira or TFS/DevOps project for defect management.

If you enable the Auto-Log mode, then after the suite execution, QAS creates defects automatically in the mapped Jira/TFS project for the test case iterations whose suite execution status is defectElse, after the suite execution, you need to manually create a defect in the test case iteration report.

To integrate a Qualitia Project with a defect management system:

  1. Do one of the following to access the Project Settings dialog box.
    1. Go to Admin Project, under the Configuration column, click Configure next to a project that you want to integrate with a defect management system.
    2. Go to Settings > Project Settings..
  2. Click the Defects tab.
  3. Do one of the following:
    • Click the Jira tab to integrate with a Jira project.
    • Click the TFS tab to integrate with a TFS/Azure DevOps project.  
  4. Perform this step only if you want to integrate with a Jira project.
    • Jira URL: Specify the Jira Server URL to which you want to connect for logging the defects.
    • User Id: Specify your Jira User Id to connect with the Jira Project
    • Password: Specify your Jira password to authenticate the Jira Project.
      Note: If you do not enter a Jira User id and password, then Qualitia uses the credentials of the first user who had configured the Qualitia project with the selected Jira Project.
    • Connect: Click to connect to the Jira server.
    • Jira Project: Select the Jira project that you want to use to log defects for the selected Qualitia project.
  5. Perform this step only if you want to integrate with a TFS/ Azure DevOps project. 
    • Server URL: Specify the TFS/Azure DevOps URL.

    • PAT: Specify the unique Personal Access Token (PAT) provided by Microsoft Azure DevOps.

    • Get Projects: Click this button to display the list of the available projects in TFS/Azure DevOps Server

    • Project: Select the project that you want to use to log defects for the selected Qualitia project.

  6. Enable Auto-Log Mode to allow Qualitia to auto-log the defects for the test case iterations with execution status “Defect”.
  7. Under Mandatory Defects Fields, enter the default values for the mandatory fields defined in the defect management system that must be used to auto-log the defects.
    For example, if your Jira project defines Severity and Priority for the defects as mandatory fields, then these two fields are displayed on this dialog box. You must enter the default values for these two fields to be used while auto-logging the defects.
    Note: Qualitia supports only basic data types such as Number and List/Option, for integration with Defect Management Systems (Jira and TFS). Qualitia does not support complex data types such as custom user-defined data types, nested objects, and dates.
  8. Click Save to save the settings.

Replacing the Mapping for a Qualitia Project with another Defect Management Systems Project

Important

You cannot directly change the settings in the Defect tab of Project Settings if you want to replace the mapping of a Qualitia Project to another Jira/TFS project. 

Perform the following steps to change the defect management systems project.

To replace the mapping for a Qualitia project with another defects management system project:

  1. Do one of the following:

    • Go to Admin Project, under the Configuration column, click Configure next to a project.

    • Go to Settings > Project Settings.

  2. Click the Defects tab.

  3. Select the Target Defect Management System to None.

  4. Click Ok.

You can now integrate the Qualitia project with another defect management system project. For more information, refer to Integrating a Qualitia Project with a Defect Management System Project.

Logging a Defect Manually from a Test Case Iteration Report

Qualitia does not support auto-logging of defects in the following scenarios:

  • Test case iteration, which are defects whose execution status is Pass, Fail, or Not Executed

  • The test case iteration execution status is Defect, but the Auto-Logging Mode was disabled at the time of the suite execution.

  • The Test Case Suite Execution report did not display in the Real Time Reporting portal.
  • The test case was executed through a TFS/Azure DevOps pipeline.

In such scenarios, you can log defects manually from the test case iteration report. 

If the Test Case Suite Execution did not display in the Real Time Reporting portal, you need to upload in the Real Time Reporting Portal. For more information, refer to Uploading a Test Suite Execution Summary Report.

You cannot log defects for the test case iterations whose execution status is "Not Executed".

To log a defect manually:

  1. Login to Reports and Dashboard Portal.
  2. Click Real Time Reporting Portal.
  3. From the Suites of Suites screen, open the test execution for which you want to create a defect.
  4. From the Test Suite Execution Summary Report, open the Test case, and then click the test case iteration for which you want to create a defect.
    Note: The status of test case iteration must not be Not Executed.

  5. Click the three dots, and depending on the defect management system you use, click Log JIRA defect or Log TFS defect. 

  6. Do the following in the order listed:

    1. The Defect Title is automatically generated with details of the test case iteration number and if space is left, it will contain the Scenario name and Test Suite name.
      Note: You can edit the Defect Title, but you cannot add more than 255 characters including blank spaces in it. 
    2. Enter the required information associated with the defect, in Defect Description.
      The default content for this field automatically displays environment details such as browser name, which you can edit.

    3. Enter the default values for the mandatory fields.
  7. Click Create
    A notification message with the defect Id and its URL is displayed.
  8. Click the Defect URL to view this defect in the configured defect management system.
    The logged defect contains the link to the corresponding Qualitia test case iteration report.

Viewing Defects in Real Time Reporting Portal 

Open the test suite execution report in which a defect is created automatically or manually.

Under the Status column, a bug icon indicates the associated test case iteration report has a defect logged with the integrated defect management system. Upon hovering on the icon, all the associated defect IDs along with their links are displayed. You can also identify whether the defects were created automatically or manually.

On this Page: