...
These release notes provide information about the new features added to Qualitia Automation Studio. They also provide details about the enhancements done, bugs fixed, and known issues in this release.
| Table of Contents |
|---|
We are happy We’re excited to announce the release of Qualitia Automation Studio 8.5.0. In this new version, we have fired up Qualitia with exciting new features and capabilities to improve the overall user experience.
We are bringing you some exciting new features that will take user experience to a whole new level.With every step, we strive to make automation development with Qualitia even easier, even faster, and even more reliablehave also resolved some long-standing inefficiencies that will go a long way in providing the required stability to your automation.
And we have enriched Qualitia with functionalities to ensure successful test automation at enhanced performance levels.
Qualitia Automation Studio 8.5.0 Release Notes
What’s New?
Publish Execution Results to ALM
Introduced a feature to publish the suite execution status to ALM test sets for the test cases that are executed in Qualitia suite.
Enhancements
Changes in Qualitia system properties will not prompt for restarting client.
Updated the webdrivermanager version from 4.4.3 to 5.1.0.
Bug Fixes
Auto Heal (Smart Locator) support is added for web objects in SFDC Projects.
Fixed the AcceptDialogue action issue in SalesForce Automation.
The test data consistency issue related to loading the test case where step sequence in the included task is changed has been fixed.
Enhanced multi-locator implementation for IE browser-specific polyfills. Multi-locator is now stabilized in the Chrome and Firefox browsers.
...
Updated the Wait action behavior as per the Qualitia Automation Studio 7.x series.
...
Improved execution stability by fixing the use case which led to browser crash issue.
...
Fixed the issue where system properties entered by user in the Qualitia settings were not utilized during execution.
...
The verbose logs for execution engine are now generated in the location specified by the user.
...
Experience Changes
Export real-time reports to ALM and share across teams
We have spruced things up and made it possible for your users to export real-time reports to ALM with the same folder hierarchy structure as in ALM and using the same search test case functionality. The best part is that your users can now share reports across teams and stakeholders for a better understanding of execution and test coverage and gain better insights into defects/failures in the application under test.
Incorrect mandatory failure of action is mandatory no more!
In this new version, we’ve tinkered with the internal workings of the Mobile.CloseApp to avoid mandatory failure of action when the mobile app is not launched before using CloseApp action.
Easy to understand error messages
When a step fails after using an incorrect environment variable to get the locator value, we have made the error message clearer to help your users understand the exact cause of failure and make relevant corrections.
Silent update and restart
Now, your users don’t need to manually restart Qualitia to update any configuration change. We have made changes in Qualitia system properties, enabling the engine to update the changes and silently restart on its own.
Added Auto Grant Permission capability
If your users were not able to see the AutoGrantPermissions property in Qualitia version 8, we have added the capability for Android mobile platform now. After defining the execution behavior, the user can auto grant permissions for the application under test.
Stability Improvements
Better execution stability
With Qualitia 8.4.0 offline packages, the browser was crashing and that resulted in showing incorrect execution status, leading to false reporting. In the new version, we have fixed the browser crash issue for better execution stability.
Improved test data management
The test data mismatch error encountered when saving test cases where the task was modified from the task tab by another user is now fixed. The new release has made it easier for testers to make changes to the task from the task tab as well.
Enhanced execution profile functionality
Previously, when changes were made to the execution profile, they were not getting saved. We have made a few modifications in the saving execution profile data to make the execution profile functionality stable.
Improved dashboard usability
There were issues with the dashboard, including duplicate key entries, blank dashboards while switching projects, sort order functionality not working properly, and heatmap showing the wrong data range. The new version has proactively resolved these issues to provide a seamless experience.
Resolved memory leak for smooth navigation to test cases
The intermittent crashes of Qualitia while navigating to different test cases (TC), which were traced to stored history data in the memory now stand resolved. In this new version, the memory leak is fixed by clearing the last visited page/frame from history to reduce memory consumption.
Enhanced multi-locator implementation for web applications
If in the older version, your web application child window wasn’t opening when clicked, we have now enhanced the multi-locator implementation by loading the relevant polyfills. The multi-locator is now stabilized for Chrome and Firefox browsers.
Handled TimeoutException for uninterrupted execution
We’ve made changes to the TimeoutException in action to stabilize the AcceptDialog action for robust execution
Stabilized task step addition process
Previously, whenever a new step was added to the test case task, multiple clones of the step were automatically updated. In this new release, we have improved the stability of task step addition by adding a task navigation handler in the constructor of the task that stops multiple cloning of steps.
Enhanced the scope of Chrome Object Spy
With a few changes in the identification algorithm, we have improved stability of object locator creation for Large Object Hierarchy in DOM structure for Chrome Object Spy.
Fixed wrong error displayed during the upgrade
During the upgrade, an incorrect error that the Qualitia server is in maintenance mode was displayed. We’ve now removed the code that was responsible for this invalid connection string.
Known Issues
Execution of suites having test cases with large test data iterations, such as 5000 iteration rows and 500 parameter columns, fails to start.
While purging the old Qualitia Reports in large volumes, such as 16 GB reports with 44 GB data, you may see the "Error occurred while fetching purge listing" error.
As a workaround, purge the old Qualitia Reports in chunks instead of purging large volumes at the same time.Recording or executing test cases using Internet Explorer browser fails with a timeout error message in the QualitiaEngine.log file. This issue occurs as the WebDriverManager does not identify the IE browser version and hence it fails to download the appropriate driver.
As a workaround, download and add a driver that is compatible with IE browser version manually and provide the path in Qualitia Settings by navigating to Browser>IE.
In the Dashboard Heatmap, if the date range spans across two calendar years, the heatmap shows the data only for the latest year.
In the Dashboard, for the date filters, the following behavior is observed:
If you select the current date, which is today’s date, the selection is applied.
If you select a date range, the starting date is applied but not the end date. Details up to the current date are displayed, irrespective of what end date is selected.
If you select a date from previous years, then the selection is ignored. Data for only the current year is displayed.
When you purge more than 2 GB of data, the purge status of the batch is not marked as completed as expected.
In the Dashboard – Test Trend, the unexecuted test cases from a suite are not included in the calculations.
Overriding an environment variable that is used in multiple QAS projects from the Azure DevOps pipeline overrides the environment variable across all QAS projects.
You can use any of the following workarounds:Do not use the same environment variable name across multiple Qualitia projects that are linked with an AzureDevOps project.
If you already have an environment variable that is used across multiple Qualitia projects with AzureDevOps pipeline, do not override the environment variable from AzureDevOps pipeline.
Ensure that the tests from different Qualitia projects are not linked to the AzureDevOps tests in the same test suite.
Ensure that environment variables names in multiple Qualitia projects do not match. You may prefix them with the project name.
...
You can now link multiple Qualitia projects to the same project in Azure DevOps. You can manage your testing efficiently by organizing all Qualitia projects separately under a single Azure DevOps project.
You can now link multiple Qualitia test cases from different Qualitia projects to a single manual test case in Azure DevOps.
You can now see a consolidated report for multiple Qualitia projects.
You can now quickly search the Azure DevOps Test Plan and Azure DevOps Test Suite while linking the Qualitia test case to Azure DevOps test case instead of scrolling from the drop-down list to save time.
Bug Fixes
The performance issues observed when loading and editing large test cases using Test Case Editor have been fixed.
The stability issue with WaitForInvisibility action has been fixed.
The issue where Qualitia Automation Studio would become unresponsive while adding or removing test cases has been fixed.
The issue of test cases taking longer time to load from dry run has been fixed.
The issue with Suite Stability Comparison chart where the charts would not display when switching from one suite to another has been fixed.
The issue with the QAS Server not working after installation has been fixed.
The issue with not being able to process the environment variables from the Qualitia settings has been fixed.
The issue where the execution of the WaitForInnerText and WaitForInnerTextMatches pattern actions would fail has been fixed.
The issue where the execution of the WaitForInvisibility action would fail has been fixed.
The issues with the Test Plan and Test Suite search have been fixed to provide better search results.
The issue where an error was displayed when you click on the Save as report option on the Summary Report screen has been fixed.
The issue where you had to restart the Qualitia Automation Studio after modifying the System Execution Profile has been fixed.
The issue where the "The insert statement conflicted with the foreign key..." error was displayed while saving a test case has been fixed.
The issues with the Suites Filter not working properly for Azure DevOps executions have been fixed.
The issue where the “Error occurred while applying project schema” error was displayed while creating a Desktop project has been fixed.
The issue where after unlinking an Azure DevOps project, the button label was displayed as Azure DevOps instead of Link on the Project screen has been fixed.
The issue of the toast message of partially purged reports not displayed completely on RTR has been fixed.
The issue with large test cases, where it would take longer to add or remove a test case step, has been fixed.
...
Enhanced the user experience for environment variables to enable environment variable management for a project easily. The variables are automatically shared across all the project users. You can now also overwrite the values of the variables at local level for customizations.
The Perfecto API has been added to support File Upload.The Perfecto File upload API was changed by Perfecto. Hence, it was not possible to upload the artifacts to the repository using Qualitia Automation Studio. It was required to upload the artifacts to the repository manually and mention the repository storage path in the test case.
You can now easily upload the artifacts to the repository using Qualitia Automation Studio by providing the local directory path of application file.A new setting called MaxSnapshotWriterQueueCapacity has been added to enable you to manage the queue capacity in the execution settings. In case you run out of memory and the logs say that the queue size is too large, you can adjust the queue capacity using the MaxSnapshotWriterQueueCapacity setting.
Upgraded Log4j version to 2.17 to fix the Log4J vulnerability issue.
Bug Fixes
Fixed the performance issues of suite execution by making execution JSONs available while starting the suite execution. This reduces the time taken to start the suite executions and avoids application going into non-responsive state.
Fixed the Real Time Reporting issues where the state of suite was not aborted after 1 hour in case of unexpected error.
Implemented retry mechanism in Qualitia Remote agent to try to get the test case artifacts from Qualitia server if first attempt fails.
Introduced a setting to bypass validation for user permissions during Server installation, if necessary Database privileges are not set up in the Database configurations for the Database user performing the Qualitia server installation.
Enabled database configuration wait time for Server setup to address latency issues between Qualitia Server and Database server.
Fixed performance issues observed while adding a new test in a large suite.
Fixed the issue of handling Azure DevOps suite names containing single quotes.
Fixed the issue with encrypted environment variable values for overwriting the values of the variables from the command prompt/Azure DevOps executions.
The threshold percentage values to be used to show warning for disk space in Real time reporting has been made configurable so that you can set thresholds lower than default values.
Fixed the issue with incorrect execution profile selection by multiple users of a project.
Fixed the issue in updating SVN/Git password in version control settings.
Fixed the Real Time Report issue of RTR data not being displayed when large number of projects and suites are available for Azure SQL database.
Fixed the issue with screenshot visibility in the Real Time Reports.
Improved the message that is logged to understand cause of Failure of Sauce Tunnelling.
Fixed the issue in desktop executions to display execution report after successfully closing UFT instance used for execution.
Fixed the issue with statusIfConditionNotSatisfied parameter of the WaitForVisibility action.
Fixed the issue when the task would not open and throw the "please update latest version of file" error.
Fixed the acceptSSLCerts issue for execution.
...
Qualitia Automation Studio 8.3.3 Release Notes
Bug Fixes
Fixed the Real-time reporting issues for longer executions where the suite execution details were not updated to the Reports dashboard.
Fixed the Real-time reporting issue where the filter options did not work as expected for Azure SQL database if the number of project and suite executions are high.
Fixed the issue on the Task screen to display appropriate error message when the XML file associated with the task is missing.
...
Qualitia Automation Studio now allows you to clone the existing execution profiles. You can clone an execution profile to copy its settings for creating a new execution profile.
Enhancements
Qualitia Automation Studio (QAS) now supports Shadow DOM for Web Object Spy and Web Recorder.
The QAS Recorder now has a constant ID that can be whitelisted for Google Chrome and Microsoft Edge.
Added new web object actions and enhanced some existing ones to support Shadow DOM.
Added actions in Desktop projects for classes present under Technology UI Automation and Oracle.
You can now update the Qualitia Server settings from the Reporting portal.
Improved logging for test case loading and saving to improve troubleshooting of the issues related to development flow.
Bug Fixes
Added few missing desired capabilities.
Fixed the screenshot trimming issue in the Qualitia execution report for the Desktop Capture mode.
Fixed the behavior of Environment variable to read the variable values from the environment file.
Fixed a few defects related to user interface enhancements to improve the user experience.
Fixed upgrade related defects that were observed while upgrading from Qualitia 5.6 to 8.3.x.
Fixed the issue related to incorrect publish status of test cases when only test data is changed in Azure DevOps integration.
Fixed the issue related to overwriting the environment variables in Azure DevOps executions/Offline executions when variable contains "=" in the value.
...
For more information, refer to Azure DevOps with Offline Package.
Enhancements
Improved the error highlighting in the Test Case Editor screen for the steps that contain empty or deleted objects. Now, the modified task steps are also highlighted if their test data is blank.
Real Time Reporting now allows to filter offline suite results executed through Continuous Integration (CI) tool. Also, the offline suite results executed through CI tools now display the CI tool next to their names, such as Offline | Jenkins and Offline | Azure DevOps.
Bug Fixes
Fixed the issue where the SVN client version was getting reset in the Scheduler suite executions.
Updated the custom action return status handling when the return status values are not as expected by Qualitia.
Now, you cannot edit the test data if all the test case steps use static data.
Fixed issues in action execution.
Fixed the issues where the suite execution results displayed cropped screenshots in different screen resolutions.
Improved the Excel.StoreCellData action to read different data types from an Microsoft Excel file.
Improved the performance of the Suites and Custom Actions screens.
Improved the Settings screen.
Some cosmetic changes are done in the product to improve the user experience.
...
Enhancements
Chrome Object Spy now enables you to:
Detach the Chrome Object Spy UI from the application under test page.
Learn objects for a child window in the following ways:
Opens another Chrome Object Spy to add child window objects.
Allows switching between a parent and a child window if you are using a common Chrome Object Spy UI.
The locator preference is now saved locally so that it is preserved across all the Object Spy sessions for a user.
You can now edit the Mandatory status for a custom action parameter though the action is added in a task or a test case.
You can now increase the timeout to query the database to more than 30 seconds.
To set the timeout value, open the Qualitia Server Settings file and specify the DatabaseQueryTimeout value as per your requirement.When the connection to the MS SQL database server fails, the Chrome Object Spy now displays an appropriate message to restore the database connection.
Updated Git integration workflow to avoid continuous incorrect Task modification notification.
Bug Fixes
Fixed the issue with saving test cases when large test data is attached with filters.
The aborted scheduler executions now display the correct execution time in the reports and terminate after the predefined time period if no response is received for the execution progress.
Updated the Qualitia Server to refresh the database connection when the database connection goes into a stale state due to a temporary connectivity issue.
Fixed the issue that occurred while accessing the Reports and Dashboard due to blank spaces in the Qualitia Server URL.
Fixed the issue with Reports and Dashboard login when the domain name of the Active Directory is different from the E-Mail ID domain.
Fixed the issue where the work would be lost by automatic reload occurring due to a connection reset in Remote Desktop Connection.
...
We remain committed to a process of continuous improvement and look forward to receiving any feedback that you might have for us.
Enhancements
Features Improvements
The action execution logs now contain additional details to improve the troubleshooting of the test cases executed on desktop web and mobile web environments.
You can now enable the SmartLocator feature for the mobile web objects also.
The SmartLocator feature does not change the object properties, such as locator type and locator value, during test case execution. The objects are searched at the run-time and their properties are displayed in the suite execution report.
You can now enable or disable the Legacy option to view the Qualitia Reports and Dashboard in the old or new format.
...
The CompareSubString action verifies whether a string or any of its substring is defined in the desired pattern that you want. For more information, refer to General Web Actions .
Enhancements
When a task is removed from the Test Case Editor screen, the selection focus now moves to the previous logical unit (Test Case step, Task, If Block) instead of the first line of the test case.
Enhancements have been done to improve the error logging.
QAS now supports MOS and Mobile Recorder for iOS platform version 14.x.
MOS and Mobile Recorder now support web view on simulator and real device for iOS web and hybrid applications.
The offline package logging is updated to match the QFD version logging for enabling dependency on specific log formats.
Updated the PrintMessageInReport action to support backward compatibility for the Qualitia for Desktop v4.3.x projects migrated to QAS 8.x.
Bug Fixes
Fixed the issues where the applications stopped responding during successive project changes.
Fixed the authentication issue that were seen while logging into the Reports and Dashboard portal.
Fixed the issue where an incorrect object class was mapped to a custom action.
Fixed the issue where the suite execution reports for Azure DevOps pipeline executions did not display the execution start and end time.
Fixed the issues related to migration of the desktop projects from Qualitia for Desktop v4.3.x to QAS 8.x.
Fixed the Date-Time formatting issue in the Sync TSR feature and the Sync TSR button visibility.
Fixed the issue related to incorrect migration of the ComputeExpression action for the desktop projects migrated from Qualitia for Desktop v4.3.x to QAS 8.x.
Fixed the issues in the reporting of parallel execution of a test suite using Power Shell utility. The Qualitia Parallel Execution Report is now generated if you abort the execution by pressing Ctrl+C from the PowerShell console.
...
Qualitia Automation Studio 8.0.5 Release Notes
Enhancements
Selecting an object in the object repository allows you to view the details of the object and also its child objects on the main page.
Updated the Writelog action for handling the pass message.
Updated the VerifyExistence action to display the appropriate message in the Info Log details.
Bug Fixes
Fixed the issues related to editing child objects. Now you can select a child object directly and edit or remove it, without having to first select the parent object.
Fixed the issues to allow you to edit or remove an object that is selected using the Find option.
Fixed the issue where after editing any object name, it is reflected in the left pane immediately. Now you are no longer required to switch to other tabs and return to the Objects tab to see the updated object name.
Fixed the issue where the new properties added to an object were not displayed.
Fixed the issue with Qualitia executable process, which would remain active in the background even after closing the QAS client.
Fixed the issues in the Wait actions to enable working in the Explicit wait mode.
Fixed the issues related to saving test cases when objects are identified using the Google Chrome Object Spy.
...
Bug Fixes and Enhancements
Enhancements
The QAS server upgrade process now handles the Unit Test stubs for the projects integrated with TFS/Azure DevOps. You are no longer required to re-publish the test cases after upgrading the TFS/Azure DevOps integrated projects.
Significant performance improvements have been made in the following areas:
Test case management
Object management
Project management
Local data cache management
SaveAs Project feature
The location of TFS/Azure DevOps Remote Agent working folder has been moved to the localappdata folder to avoid conflicts.
Cosmetic user interface changes done to improve the user experience.
Enhancements in the object identification for web elements using Smart locator with text strategy in the following scenarios:
Creating objects manually in QAS
Adding objects using the the Qualitia Automation Web Recorder
Learning objects using Chrome object spy and IE object spy
Enhancements in the SmartLocator algorithm.
Bug Fixes
Qualitia Automation Studio now allows you to save test cases with empty test data (cells containing only spaces).
Fixed the issue related to the data type while passing variables to the Vbscript engine for the test case executions on the Desktop applications.
Fixed the issue with test case exit flags in a test suite. When you save a test suite, the existing test case exit flags do not reset to Continue (Green flag) anymore.
Fixed the issues related to the test data of the projects that are migrated from QFD. Now the correct test data is shown for those actions whose parameter sequence has changed.
Minor fixes related to object identification are done.
...
Mobile Object Spy and Qualitia Automation Mobile Recorder has dropped supporting iOS versions 10.4 and earlier.
Enhancements
Multiple enhancements are done to the user interface to improve usability.
Improved the error message that is displayed when you create a project that already exists in the target database server.
Improved the error message to highlight the set of characters allowed in a project name while creating a project.
Enhanced the info logs for wait actions. Info logs now display the actual values used in wait action executions.
Added support to integrate Azure DevOps Git repository as a version control tool in addition to Bitbucket and GitHub.
When a user edits a task, other users can now view the following information:
The user who edited the task
The date and time when the task was edited
Earlier, only the following message was displayed:
"Some tasks in the test case have been modified".
Added support for specifying a relative path to the AttachFile action.
Added support to update the expired password in the ALM integration settings.
Added support to update the expired password in the Azure DevOps integration settings.
Added support to install Qualitia Automation Studio for multiple user profiles on a Virtual Machine even when other users are actively using Qualitia Automation Studio.
...
Qualitia Automation Studio 8.0.1 Release Notes
Enhancements
Qualitia now supports the Windows Authentication Login Action in Firefox browser and Selenium Grid Executions (Chrome and Firefox)
Bug Fixes
Fixed the minor issues in UI, suite executions, and configuration settings.
Fixed an issue related to Offline Suite executions.
An offline suite execution fails if it contained an encrypted password that is defined in the associated Environment Variables.
...