Executions on Perfecto
- Dhiraj Chandanshive (Unlicensed)
Introduction
Perfecto is a cloud-based lab for Web and Mobile application testing. It allows running tests in the cloud using different combinations of operating systems, browsers, and browser versions. In this environment, all desktop web application tests are executed on virtual machines (VMs) and mobile application tests are executed on physical devices. Perfecto allows you viewing video recordings of the test case executions after the suite executions are completed.
To know more about Perfecto, click here.
Prerequisite:
An active user account on Perfecto.
Mandatory Settings and Execution Guidelines in Qualitia
The mobile native and hybrid application file, that is the apk, ipa, and app file, is not uploaded on Perfecto automatically during the Qualitia Automation Studio executions.
Qualitia recommends that you perform the following steps to upload the native and hybrid mobile application file:
Open https://{PerfectoURL}/assets/repository in a browser, where PerfectoURL indicates the URL of your Perfecto account.
Enter the valid login credentials.
Click File Upload, and select the mobile application from your local machine.
Do one of the following:
To add a private app:
Select Private and click Upload.
Select the private app that you want to upload and click OK.
The app path is displayed as locator PRIVATE:{AppName}.apk, where AppName indicates the name of your mobile application.
To add a public app:
Select Public and click Upload.
Select the public app that you want to upload and click OK. The app path is displayed as PUBLIC:{AppName}.apk, where AppName indicates the name of your mobile application.
Copy the Perfecto repository path for your mobile app.
You can now enter the value of app_path in the first parameter for all the Mobile.OpenApp actions present in different test cases, which are planned for execution on Perfecto.
Tip
You can create an environment variable for this Perfecto repository path. For more information, refer to Creating an Environment Variable.
Mandatory Settings in Associated Execution Profile
In the associated execution profile, do the following in the order listed:
From the Environment list, select as Cloud.
From the Cloud Platform list, select Perfecto.
Select the Edit Additional Capabilities checkbox.
Select or enter the following values:
Enter your Perfecto account URL, in URL.
Either enter Username and Password, or SecurityToken.
Perform the following steps to execute the test suite on a mobile application,
Select enableAppiumBehavior as True.
By default, the apk/ipa files are overridden (uploaded) to Perfecto during every execution. If you do not want to upload these files, set the capability "override=false".
In the host capability, enter your Perfecto cloud name (for example, trial, demo, and so on) based on your subscription type.
To execute test suite on a mobile web application:
Select enableAppiumBehavior and useAppiumForWeb as True.
Select AutomationName for Android as Appium and for iOS as XCUITest.
Enter SeleniumVersion to 4.0.0.
Enter the chrome driver version for the target mobile device, in ChromeDriverVersion to 2.xx, where xx denotes a chrome driver version, such as 91 and 92.
To execute test suite on an Android hybrid application:
Select enableAppiumBehavior and useAppiumForHybrid as True.
Enter SeleniumVersion to 4.0.0.
Enter the chrome driver version for the target mobile device, in ChromeDriverVersion to 2.xx, where xx denotes a chrome driver version, such as 91 and 92.
To execute test suite on an iOS hybrid application:
Select enableAppiumBehavior, useAppiumForHybrid,and iOSResign as True.
Optionally, you can specify the following capabilities for Perfecto:
artifactLocator: It specifies an unique artifact identifier. The format is {folderType}:{artifactKey}, where folderType defines the privileges of accessibility and the possible values are:
PRIVATE: Only the owner has access to the artifact.
GROUP: Only users related to the owner’s group will have access to the artifact.
PUBLIC: All users have access to the artifact.
Note: The artifactKey cannot contain backslash (\) character. If the artifactName is kept blank, the artifactKey cannot contain any of the following characters: /:"*?<>|”
artifactType: It defines the type of artifact. You can choose any one of the following available values:
GENERAL, IOS, SIMULATOR, ANDROID, IMAGE, AUDIO, VIDEO, or SCRIPT.
artifactName: It represents the artifact once it is downloaded. The default value is artifactKey.
Note: The artifactName cannot contain any of the following characters: /:"*?<>|”mimeType: It defines the contentType.
override: It states whether to override if an artifact with the same artifactLocator value exists. The default value is false.
Additional Recommendations:
In the Execution Parameters tab, select ScreenCaptureMode as Browser.
If you have used ID, Accessibility ID, and Class locator types when adding native mobile app objects in Qualitia, Perfercto Appium integration translates these all locator types to xPath at the time of test case execution.
For more information, refer to the PerfectoMobile documentation.
Viewing Execution Status and Reports in Perfecto's Execution Center
Once you have triggered the offline execution, you can view the status of your ongoing executions in Perfecto's Execution Center. Each test case appears on dashboard as a single grid with execution status against it. The status is updated after each test execution is completed in Perfecto's environment with its status (FAILED / SUCCESS) against it. Select the test case from the list and click Report from top to view recording of your test case.
Qualitia and Perfecto's reports may mismatch if Qualitia test case contains any situation which ends the WebDriver session. This situation may arise due to the use of actions like Mobile.CloseApp, opening multiple WebDriver sessions in a single test case and so forth.
To view the execution report of Qualitia test cases:
Log on to your Perfecto account.
From the top right corner, click More > Execution Center.
In the Executions section, select the test case from the list.
Click Report
Executing Test Cases Behind Firewall Applications
Few applications are configured to be accessed using private networks. Such applications deny access when they are being accessed from other than local networks and so from Perfecto. Executing test cases on Perfecto for such applications needs special configurations.
Simply download Perfecto Connect client executable that matches your Operating System. You need to execute it on the machine in the private network to allow Perfecto executing tests flawlessly.
For more information on configuration of Perfecto connect, refer to the Perfecto documentation.
To configure perfecto to run test cases for the applications behind firewall:
Download Perfecto Connect executable depending on your OS.
Unzip the folder and run the file using command line interface along with Cloud URL and Security Token.
For example:perfectoconnect.exe -c <Perfecto_Cloud_URL> -s <Security_token>Executing this file will give you the tunnel ID.
Under Edit Additional capabilities, enter the tunnel ID in tunnelId.
For more information about this, refer to the Perfecto documentation.