Qualitia Automation Studio 8.0.0 Beta Release

Taking another step towards our goal of making test automation faster, simpler and more reliable, we are proud to announce the release of Qualitia Automation Studio- 8.0.0 Beta.

Qualitia Automation Studio Recorder

Now record operations performed on the application under test and convert them into ready-to-execute automation test cases.

How Does It Help?

• Faster Automation: Users do not need to worry about writing test cases manually. The object identification also happens during the recording process itself. The whole process of automation becomes considerably faster, thereby significantly reducing time-to-market.

• Easy-to-use: The recording of a test case happens while the application under test is being used. Any user with less or no knowledge of automation can use this feature to record ready-to-execute automation test cases.

• Lesser Manual Error: By eliminating the need to write test cases manually, Qualitia ensures that the test cases are less prone to manual error.

• Validate the Test Cases: The user can validate the automation test cases by replaying the recording.

For more information, refer to Qualitia Automation Recorder .

Real-time Reporting

Get suite execution results in real-time. There is no longer a need to wait for the entire suite to complete execution. Our real-time reporting portal shows the execution results of multiple suites being executed in parallel by CI tools. 

How Does it Help?

• Reduced Wait-time for Analysis: The automation cycle is often delayed because execution results of long-running test suites with multiple test cases is only available when the entire execution is complete. Qualitia provides real-time reports for each test case immediately. Now analyse defects/failures as soon as the test case is executed.

• Compatibility with Browsers: Our real-time execution results can be seen across all widely used Web browsers. 

• Storage of Screenshots and Logs: Capture, compress, and store screenshots and logs associated with test executions, so that they can be stored and transmitted.

• Pinpoint the Failures with Analysis: Traverse through the execution results to find and analyze points of failures and defects. This makes it easy to understand and troubleshoot issues efficiently.

For more information, refer to Real Time Reporting Portal .

Executions on Remote and Cloud Environment through Qualitia Client

In addition to executing test cases on remote and cloud environments using the offline package, you can now execute test cases on remote and cloud environments right from the Qualitia Client.

Qualitia supports the following cloud environments:

• Saucelabs

• Browserstack

• Perfecto

• Testobject

For more information, refer to Supported Environments and Guidelines .

Execution Profile

An execution profile lets you define a set of configuration settings for test suite executions. You can add multiple execution profiles with a different combinations of configuration settings for different environments.
Having execution profiles in place saves you a lot of time that you spent on changing the configuration settings for every execution manually.

For example, earlier even to switch to another browser for a test suite execution you had to manually change the settings. Now you can create multiple execution profiles for different browsers and simply select the one that you want to use during test suite execution.

For more information, refer to Working with Execution Profiles.

Configuration Settings

You can now configure settings on project level depending on the project requirements. This comes handy in situations where you can choose whether or not you want to integrate your project with version control tools, such as GIT or SVN.

For more information, refer to Configure Qualitia Client Settings .

Offline Configuration Utility

The Offline Package now includes the Offline Configuration Utility, which makes changing configuration settings for offline execution and offline package execution very easy. You are no longer dependent on the CLI command extension tools to modify configuration settings or execute the offline packages.
Additionally, if the offline package is configured and connected with the Qualitia Server during execution, you can track the suite executions in the Real Time Reporting Portal.

For more information, refer to Offline Package.

Server Upgrade Process

If you upgrade to Qualitia 8.x.x from a previous version, if a few projects fail, you are required to only restore the backups of the failed projects. The Upgrade program is now enhanced to save your time by not having you to restore the passed projects.

For more information, refer to Upgrade.

Healthcheck utility

This release introduces the Health-Check utility that lets you check the health of the Qualitia Server and Qualitia Client components. The Health-check utility can perform both the pre-installation and post-installation checks.

• Pre-installation checks: Verifies if your computer meets the minimum system requirements to install the Qualitia Server or the Qualitia Client.

• Post-installation checks: Verifies if all the components of the Qualitia Server or the Qualitia Client are installed and functioning properly.

For more information, refer to Qualitia Healthcheck Utility.

Dropped features

The following features have been dropped in this release:

• Debugging is not supported.

• Student Edition is discontinued.

• Integration with Defect Management system is unavailable.

Bug Fixes and Enhancements

The following are the details of bug fixes and enhancements made in this release:

• Even if you do not specify browser driver path, Qualitia would install and download the browser driver path while execution.

• Every Qualitia Client is bundled with Appium for mobile application testing.

• During a hybrid test case execution, you can switch from native environment to a web page view using a single Mobile.StoreWebViewHandle action. Earlier, to do this, you had to use the following two actions in the sequence listed: 

  • Mobile.StoreWebViewHandle 

  • Mobile.SelectWebView 

Known Issues

The following are the known issues in Qualitia Automation Studio 8.0 Beta release.

Qualitia Automation Studio Recorder

Qualitia Web Recorder

• The Pause/Resume and Stop button do not work from the Qualitia Editor. As a workaround, use the Pause/Resume and Stop buttons of the Qualitia Web Recorder to pause or resume, or to stop the recording.

• Qualitia Web Recorder may sometimes not record the objects on a popup. To work around this issue, verify if the steps are recorded, if not, try recording them again.

• By design, the recorder does not start until all the objects on a web page are loaded. Ensure that all the objects on a web page are loaded before you start recording.

• Recording keyboard interactions are not supported in this release. As a workaround, you must add such steps manually in the Qualitia Editor.

• Recording objects on Windows dialog boxes, such as downloading or uploading files, or entering user credentials, is not supported in this release. As a workaround, add these steps manually in the Qualitia Editor.

• While recording a web application, if you press Alt+Tab from the keyboard, it is added as Alt+Left in the parameter. You must remove such unnecessary steps captured by the recorder in the Qualitia Editor.

• While recording a web application, if you update the URL in the address bar, it is not recorded as a step. You need to enter a step manually with action as OpenURL and add the new URL in the parameter.

• Qualitia Web Recorder does not support Shadow DOM.

• While recording a web application, if you click the play or pause button of a video, it is not recorded as a step. As a workaround, you must add these elements manually in the Qualitia Editor.

• Qualitia does not recommend using the recorder during dry runs. However, if you do so you may face issues and see unexpected results.

• While recording a web action, if you click Back and Forward buttons, they are not recorded as steps. You need to enter steps manually with actions as NavigateBack and NavigateForward.

• While recording a web application, alert actions are not recorded. You must add these actions manually in the Qualitia Editor.

Qualitia Mobile Recorder

• The Pause/Resume and Stop button do not work from the Qualitia Editor. As a workaround, use the Pause/Resume and Stop buttons of the Qualitia Mobile Recorder to pause or resume, or to stop the recording.

• While recording a mobile application, if you disconnect a physical mobile device, the application session continues. To work around this issue, restart the agent and reconnect the mobile device to start recording.

• You cannot record ClearText messages on iOS devices. You must add such actions manually in the Qualitia Editor.

• While recording an iOS application, if you click the keys of the soft keyboard, every keystroke is recorded as a step. You must not use the soft keyboard to enter values, use SetText mode to enter the values. To clear the texts, you must pause the recording session and use soft keyboard to remove the text from the mobile.

• Unable to connect to a device intermittently. To work around this issue, restart the recording session.

• When recording a mobile web application on iOS simulator, it opens a blank browser. As a workaround, enter the application URL manually and refresh the browser to fetch the latest objects.

• Qualitia Mobile Recorder does not support iOS version 12.0 or above for mobile web recording and web view context of a hybrid application.

• Qualitia Mobile Recorder does not support flick gesture. You can use swipe gesture instead of the flick gesture.

• Qualitia Mobile recorder does not support entering values on objects from a keyboard. You need to enter values using SetText and ClearText modes.

• While recording a mobile web application, if you switch between multiple tabs on a mobile browser, it is not recorded as a step. As a workaround, for the switch window step, you must manually add a step with selectwindowusingurl as the action and the window URL as the parameter.

Reports and Dashboards

Realtime Reporting Known Issues

• The Real Time Reporting portal and Reports tab of Qualitia client does not display the test cases executed through TFS/Azure DevOps and HP ALM. Currently, you need to view the associated test suite executions reports in TFS/Azure DevOps and HP ALM only.

• While a test suite execution, Qualitia does not display any appropriate alert message if the Qualitia Server does not have the required space. As a result, you might not view the suite execution report.
  The Admin needs to monitor the amount of available space in Qualitia Server regularly and remove the reports data that are no longer required from the Server Administration Portal. For more information, refer to Purging the Reports Data.

• Qualitia allows you to edit a text for a test case step under the Name/Condition column in the test case editor screen of the Qualitia Client and save the test case. However, after executing the associated test suite, the suite execution report screen displays the original text under the Hierarchy column.

• The design of Real time Reporting Portal is not mobile responsive. Therefore, you can expect some UI distortions when viewing the portal through the mobile device having resolution lower than 1100px.

• Real Time Reporting portal does not restrict the status bar and log icon moving out of the visible window, which might result in losing them. As a workaround, you have to refresh the report page to display the status bar or log icon.

• Due to a known Firefox bug, the Real Time Reporting portal does not display the white borders in table grids in the Firefox.

• Export to Excel feature currently does not support export the Qualitia Design Studio related attributes such as Module, Epics and Stories for a QDS enabled project 

• Real Time Reporting Portal shows the browser version used for test suites executed on mobile web applications intermittently. As a workaround, before a test suite execution, you need to specify the browser version in the Edit Desired Capabilities of the associated execution profile.

Dashboard Known Issues

• The Defects logged report and Trends chart would not display any data as Qualitia v8.0.0 Beta does not support Manual nor Auto-defect creation.

• The Suite Execution Time statistics chart may show a difference of a second in the Average execution time metric due to rounding of milliseconds to seconds.

Old Qualitia Reports

• Export to Excel feature is not available for reports of executions prior to release 8.0.0, that are viewed from the Show Old Reports menu.

Cloud Executions

Perfecto

• Desktop web executions are not tested on Macintosh computers. 

• The mobile native and hybrid application file (i.e. apk/ipa/app file) is not uploaded on Perfecto automatically during the Qualitia Automation Studio executions. Hence, the operation to upload the application file to the Perfecto repository is disabled in this release. 
  As a workaround, manually upload the application file to Perfecto. For more information, refer to the URL: 
  https://developers.perfectomobile.com/display/PD/Upload+Item+to+Repository 
  Note: After you upload the application file to Perfecto, ensure that you set Perfecto lab repository path as the first parameter of the Mobile.OpenApp action. For example, Perfecto lab repository path: "PRIVATE:MyApp.apk".

Sauce Labs

• Mobile executions with iOS mobile native and hybrid applications are not tested. iOS application testing on Sauce Labs simulators was not possible due to technical difficulties with Sauce Labs.

• Fixed an issue where test case artifacts and database are left in inconsistent state due to database connectivity issues in saving a test case.

• Fixed an issue where due to adding data in specific date-time formats in test data, the test case was not getting saved.

• Fixed an intermittent issue when a test data is saved, a message as “Connection is Not Open” was displayed.

• You can view the screenshots that have failed an are defect steps in TFS/Azure DevOps test results. All you need is to enable the Fail and Defect checkboxes in Qualitia Remote Agent Settings.
  For more information, refer to Qualitia Remote Agent Configuration.

• Attaching the Qualitia Test results as a ZIP file is now optional, which can be selected in Qualitia Get Assembly task.
  For more information, refer to Configure Qualitia-Get Test Assembly Task

•  Whenever a task is updated, then you can re-publish all the associated test cases with a single click.

• Fixed a bug where debug logs for test case iterations were not generated or incorrectly attached in TFS/Azure DevOps.

• The Sync Log file that records the logs of QAS-QDS synchronization is updated daily in a separate log file.

• Fixed the issue where the unimplemented test cases were not handled correctly when upgrading from Qualitia from v7.2.1 to v7.3.4 .

• Fixed the issue in which if a test suite execution uses Chrome Object Spy, SmartLocator was unable to auto-correct the locator values for the objects. Also, you can now view the specified and updated locator values for an object by analyzing the associated Info Log from the Test Suite Execution Summary report.  

• Fixed the issue of Chrome Object Spy in which objects with same parent-child hierarchy across pages were not getting added to the object repository.

• Fixed the issue of Object Spy as it was unable to capture and highlight the objects present inside a frame.

• You can create auto-defects with custom fields in JIRA.

•  When a test case from a QAS project is shared with the linked QDS project, the associated tasks of the test case are also automatically shared with the linked QDS project. Further, for the shared test case, QAS does not allow to edit the associated tasks .

• Fixed a bug related to publishing the test results in parallel executions due to the mismatch of Run Ids

• Fixed a bug related to publishing the test results ZIP files during pipeline executions

• Resolved issues relevant to uploading of Test Case Results to TFS/Azure DevOps and Qualitia Server

• Fixed minor bugs

• Improved the test case migration failure scenarios

• Working with Test Case and Test Data Explorer simultaneously

• Drastic time reduction in loading and saving test case and test data

• Aiding in expediting test case creation

• Overall, significant improvement in performance and users work efficiency

• Strong Synchronization between Test Case with Test Data

  • Instantly highlights the associated parameter data in Test Data explorer upon clicking a step.

  • Instantly enters the same parameters in Test Data explorer upon adding or editing an Action for a step.

• Validation of blank data and highlighting them in the red color

• Introduction of exporting and importing test data through an excel file

• Resizable and movable Test Data explorer

• Tasks and Conditional Statements Collapsibility

• Consolidation of Test Case and Task Condition Columns

• Highlighting Skipped Tasks and Steps in Green Color 

• XPath Syntax Validation

• Easily Manageable Object Hierarchy

• Resizing Edit Object Window

• Introduction of UI Automator

• Enable SmartLocator for Web Objects

• Publishing the execution end time for each step in the Test Case Summary Report

• Upon saving a test case, task, and Custom Action, if Qualitia fails to push it into the Source Repository (SVN or GIT), an error message is prompted. This allows the users to verify whether the problem is due to the Source Repository connection, or with their credentials or privileges so that they can rectify the connection issue.

• Qualitia project name in the project directory is case sensitive. Whenever there is a mismatch in the case with Project Directory in Source Control Repository (SVN or GIT), an error message is prompted upon opening the project. As a result, unless the users fix the project name in Source Control, Qualitia does not allow them to open the project.

• Resolved the Actions related to Verification Existence for objects enabled with SmartLocator

You can now view the published time and integration statuses of all the test cases linked to TFS/Azure DevOps tests in the automation studio.

Qualitia displays the details of the linked test cases in the following two screens:

• Develop Module > Scenario 

• Execute Module > Integration Status 

Both contain two new columns: Published On and Published Status.

Overriding Qualitia Environment Variables Runtime from TFS/Azure DevOps 

Qualitia allows defining environment variables, which you can use while developing test cases with dynamic or frequently changing test artefacts. While executing test cases with TFS/Azure DevOps build and release pipeline, you can now update the values of the environment variables as defined in the automation studio. 

To do so, you can use the .runsetting file from the TFS agent.

For the detailed information on how to update environment variable values runtime and its syntax, refer to the TFS/Azure DevOps integration documentation.

Automatically Getting Qualitia Server URL in Remote Agent (TFS/Azure DevOps Integration) 

Qualitia now automatically gets the Qualitia Server URL in Qualitia Remote Agent. The information is collected from the build and release pipelines configured under the respective TFS/Azure DevOps project.

Alternatively, users can also update this information manually.

Introducing More Capabilities for Android Mobile Automation Testing 

Qualitia has enhanced the automation experience by adding the following capabilities for Android. You can find these capabilities, their expected values, and other related information in the androiddc.properties file under the Qualitia installed location. (%LocalAppData%\QualitiaWDClient\app-x.x.x\WebDriver\config)

• mjpegServerPort

• adbExecTimeout

• clearSystemFiles

  
  
  

Bug Fixes:

• Fixed minor issues related to the upgrade process where the automation studio was not getting launched after the upgrade process is completed.

• Fixed the exception that used to occur in the Develop module for the TFS/Azure DevOps integrated Qualitia projects.

• Fixed the issue where Qualitia was displaying older Manual TC IDs even after they were updated in the databases and XMLs.

• Fixed the exception that used to occur while loading the Scenario tree.

Qualitia Automation Studio for Web and Mobile 7.2.2

Installing Qualitia Made Easier

Enrolling Qualitia clients for new users has now become simpler than ever. Qualitia is now ready to be deployed through Configuration Software Management Systems (CSMS) or Group Policy Objects (GPO). It helps in experiencing the seamless Qualitia client installation without requiring administrator access to the system. 

For more information on deploying Qualitia as a part of GPO or using CSMS, refer to the Installation Process section.

Bug Fixes:

• In the Custom Actions Module: 

  • Fixed an issue where users were able to update the custom action repository path even after importing custom actions into Qualitia.  

  • Fixed an issue which was causing a test case failure after upgrading to the latest version of Qualitia automation studio. 

  • Qualitia was throwing an exception if the project path contains white spaces at the time of launching custom action code in Eclipse with the error File not found. This exception has been handled. 

  • Handled an exception where custom action with parameter name with an underscore (_) character was not working. 

  • Handled an exception (Eclipse instance already running) occurring when multiple users on the same VM were trying to open Eclipse to view or edit custom action code. 

  • Other minor usability issues have been fixed which will make custom action module more robust and comprehensive. 

• Qualitia administrators were facing difficulties while removing users from projects. This issue has been resolved. 

• Handled the intermittent issue of Qualitia getting terminated when used the Tab key in Test Data for navigation. 

• Fixed a performance-related issue where Qualitia was taking more than usual time for creating new projects.

Qualitia Automation Studio for Web and Mobile 7.2.1

Bug Fixes:

• Fixed an issue where custom action-related files were not getting deleted from the SVN repository when they were deleted from the local systems. 

• Optimized Test cases, Tasks, and Objects rendering time in Qualitia Automation Studio.

• Fixed an issue where the publishing of test cases integrated with TFS/Azure DevOps was failing in case the user deletes the temp folder. Qualitia automatically creates the temp folder in case it does not exist to store the published version of test cases.

• Removed the Custom Action Repository Path field from Qualitia Remote Agent for TFS/Azure DevOps integration as it is no longer required.

Qualitia Automation Studio for Web and Mobile 7.2

Bug Fixes:

• Fixed minor issues related to the upgrade process.

• Fixed an issue which lead to breaking an alignment of suite execution HTML report when getting an error for any step.

Qualitia Automation Studio for Web and Mobile 7.1

Introducing Qualitia Design Studio Integration 

Qualitia now offers seamless integration with Qualitia Design Studio. This integration offers a clear understanding of the requirements to automation testers before they start testing the application and helps to develop highly scalable and maintainable test automation design. It eventually gives end-to-end traceability from requirements to manual test cases to automation test cases and to defects found while testing the real-time application.

Using this integration, you can:

• Import product requirements from Design Studio to Automation Studio  

• Implement manual test cases and    

• Automate these manual test cases with the help of tasks and objects. 

You can also send these test cases back to Design Studio for design level updates, in case there are any such requirements.  

For detailed information on how to work with these requirements in the automation studio, refer to the Working with Requirements section.

Introducing Web-Based Dashboards 

Qualitia’s new Web-based dashboards provide a capability to analyze the results of the test cases executed using Qualitia Automation Studio for Web and Mobile and offline packages. These dashboards help managers and testers get a holistic and comprehensive view of execution results across projects, test suites, and test environments.   

For more information about accessing and interpreting charts and metrics from the dashboard, refer to the Web-Based Dashboards section.  

Introducing Object Spy for Capturing Mobile Application Objects 

Qualitia is delighted to introduce object spy to identify and capture objects reliably for mobile application testing. It adds to the current suite of Qualitia's object identification and capturing capabilities. Mobile Object Spy provides a uniform way to capture objects from mobile applications for native and hybrid applications across Android and iOS. 

For more information on this, refer to the Object Spy for Mobile Applications section.

Introducing New Way to Handle Custom Actions in Qualitia  

Custom actions help Qualitia users to extend testing capabilities by allowing them to add project specific methods while creating automation tasks/test cases. Managing this custom action code in collaboration with other project members is now made simple than ever.  

Qualitia now maintains custom action code just like it maintains the tasks and test cases. You can share your custom actions and make them available to other project members so they can leverage the same set of actions while creating tasks/test cases. Project’s integration with version control tools like Bitbucket or SVN makes sharing these actions even more reliable and robust in the cases of multi-user scenario. 

Existing Qualitia users can import their custom actions to streamline it with other project data. For more information about working with these custom actions in a new way, refer to the Custom action module section. 

Ability to Automatically Add Offline Package Execution Reports to Qualitia 

You can now configure Qualitia to automatically sync offline package execution reports to Qualitia Server. This will eliminate the manual process of importing offline package execution results in Qualitia Automation Studio (from Reports section).  Importing offline package execution reports automatically in Qualitia server enables to view test execution results from the Web-based dashboards.  

In order to sync offline package execution reports, you must first set Share Path under Qualitia Configuration Settings and configure qualitia.properties file accordingly.  

Introducing New Web API Actions

Qualitia has enhanced its test coverage by adding few more capabilities into its Web API action’s repository. These actions will help you in automating test cases for REST API services with JSON and XML files. Following is the complete list of new actions which you can leverage for the API testing using Qualitia automation studio.   

• REST.Response.StoreResponseTime 

• REST.Response.VerifyResponseTime 

• REST.Request.SetTimeout 

• REST.Request.WaitForAttribute 

• REST.Request.SetFormUrlEncodedParameters 

• REST.Request.ImportSSLCertificate 

• JSON.CompareJson 

For more information on using these actions and their parameters, refer to the Web Services Actions section. 

Changes in TFS/Azure DevOps Integration 

Starting version 6.0, Qualitia offers integration with Microsoft TFS/Azure DevOps. You can now map Qualitia test cases to TFS manual test cases from the Execute section. Execute section is now divided into two different sections; Suite Execution and Integration Status. You can see the Integration Status section only for the projects integrated with TFS/Azure DevOps which helps to link Qualitia test cases to TFS/Azure DevOps manual tests and publish them to run with release or build pipelines.  

In TFS/Azure DevOps, test cases linked with Qualitia test cases are labeled as Planned and test cases which are published from Qualitia automation studio are labeled as Automated. Only the published test cases will be considered while executing build and release pipelines. 

For more information on how to link and publish test cases, refer to the TFS integration section.

Other Changes

• You can now cut/copy/paste multiple steps across tasks and test cases in Qualitia automation studio. 

• Qualitia gives you a provision to print the customized status and message in the test execution report using the PrintMessageInReport action. 

Bug Fixes

• Fixed an issue where Qualitia administrator was facing difficulties while creating new role in Qualitia.

• While installing or upgrading, Qualitia will now check whether the required .net version is installed. If not installed, Qualitia prompts user about it.

• After installing TFS Remote Agent, all the dependency paths will now be pre-populated.

• In order to be more comprehensive, Qualitia has made some changes in the parameter names of these actions mentioned below.

  • CompareString

  • CompareTabularResults

  • CompareArray

  • VerifyDifference

  • VerifyDates

For more information on how to use these actions, refer to the General Web Actions section.