Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

...

...

...

...

...

...

...

...

Introduction

Perfecto is a cloud-based lab for Web and Mobile application testing. It allows running tests in the cloud using different combinations of operating systems, browsers, and browser versions. In this environment, all desktop web application tests are executed on virtual machines (VMs) and mobile application tests are executed on physical devices. Perfecto allows you viewing video recordings of the test case executions after the suite executions are completed.

To know more about Perfecto, click here.

Prerequisites

Before you start offline execution on Perfecto, ensure you have:

  • An active account with valid Username/Access Key. If you don’t have an account, then you need to create an account first using this link https://trial.app.perfectomobile.com/
  • Sufficient balance of execution hours

Execution Guidelines

To execute tests on Perfecto, follow these steps:

...

  1. Sign into your Perfecto account.

...

  • To add a private app:
    1. Select Private and click Upload.
    2. Select the private app that you want to upload and click OK.
      The app path is displayed as locator PRIVATE:{AppName}.apk, where AppName indicates the name of your mobile application.
  • To add a public app:
    1. Select Public and click Upload.
    2. Select the public app that you want to upload and click OK. The app path is displayed as PUBLIC:{AppName}.apk, where AppName indicates the name of your mobile application.

...

Info
titleTip

You can create an environment variable for this Perfecto repository path. For more information, refer to Creating an Environment Variable.

Mandatory Settings in Associated Execution Profile

In the associated execution profile, do the following in the order listed:

...

  1. Enter your Perfecto account URL, in URL.
  2. Either enter Username and Password, or SecurityToken.

...

  1. Select enableAppiumBehavior as True.
  2. By default, the apk/ipa files are overridden (uploaded) to Perfecto during every execution. If you do not want to upload these files, set the capability "override=false".
  3. In the host capability, enter your Perfecto cloud name (for example, trial, demo, and so on) based on your subscription type.
  4. To execute test suite on a mobile web application:
    1. Select enableAppiumBehavior and useAppiumForWeb as True.
    2. Select AutomationName for Android as Appium and for iOS as XCUITest.
    3. Enter SeleniumVersion to 4.0.0.
    4. Enter the chrome driver version for the target mobile device, in ChromeDriverVersion to 2.xx, where xx denotes a chrome driver version, such as 91 and 92
  5. To execute test suite on an Android hybrid application:
    1. Select enableAppiumBehavior and useAppiumForHybrid as True.
    2. Enter SeleniumVersion to 4.0.0.
    3. Enter the chrome driver version for the target mobile device, in ChromeDriverVersion to 2.xx, where xx denotes a chrome driver version, such as 91 and 92
  6. To execute test suite on an iOS hybrid application:
    • Select enableAppiumBehavior, useAppiumForHybrid,and iOSResign as True.

Optionally, you can specify the following capabilities for Perfecto:

  • artifactLocator: It specifies an unique artifact identifier. The format is {folderType}:{artifactKey}, where folderType defines the privileges of accessibility and the possible values are:

    • PRIVATE: Only the owner has access to the artifact.

    • GROUP: Only users related to the owner’s group will have access to the artifact.

    • PUBLIC: All users have access to the artifact.
      Note: The artifactKey cannot contain backslash (\) character. If the artifactName is kept blank, the artifactKey cannot contain any of the following characters: /:"*?<>|”

  • artifactType: It defines the type of artifact. You can choose any one of the following available values:

    GENERAL, IOS, SIMULATOR, ANDROID, IMAGE, AUDIO, VIDEO, or SCRIPT.

  • artifactName: It represents the artifact once it is downloaded. The default value is artifactKey.
    Note: The artifactName cannot contain any of the following characters: /:"*?<>|”

  • mimeType: It defines the contentType.

  • override: It states whether to override if an artifact with the same artifactLocator value exists. The default value is false.

Additional Recommendations:

In the Execution Parameters tab, select ScreenCaptureMode as Browser.

Note

If you have used ID, Accessibility ID, and Class locator types when adding native mobile app objects in Qualitia, Perfercto Appium integration translates these all locator types to xPath at the time of test case execution.

For more information, refer to the PerfectoMobile documentation

Viewing Execution Status and Reports in Perfecto's Execution Center

Once you have triggered the offline execution, you can view the status of your ongoing executions in Perfecto's Execution Center. Each test case appears on dashboard as a single grid with execution status against it. The status is updated after each test execution is completed in Perfecto's environment with its status (FAILED / SUCCESS) against it. Select the test case from the list and click Report from top to view recording of your test case.

Info

Qualitia and Perfecto's reports may mismatch if Qualitia test case contains any situation which ends the WebDriver session. This situation may arise due to the use of actions like Mobile.CloseApp, opening multiple WebDriver sessions in a single test case and so forth.

To view the execution report of Qualitia test cases:

  1. Log on to your Perfecto account. 
  2. From the top right corner, click More > Execution Center.
  3. In the Executions section, select the test case from the list.
  4. Click Report
  1. Click LEARN MANUAL TESTING.
    Image Added

  2. Select DESKTOP WEB in the What would you like to test? window.
    Image Added

  3. Click LET'S GO.
    Image Added

  4. In the next window, select Operating System and Browser of your choice.
    Image Added

  5. Next, set all the capabilities in the CAPABILITIES tab. 
    Image Added

  6. Now, open Qualitia Automation Studio and login.
  7. Go to the Execute tab.
  8. Click Execution Profile.
  9. Click the plus icon to add new Execution Profile.
  10. Provide a name for the Execution Profile.
  11. Under Execution Configuration > Web Environment select Perfecto
  12. Under Web Execution Platform select Perfecto.
  13. In the Desired Capabilities window, enter all the following mandatory fields by selecting the checkbox:
    1. url
    2. securityToken
    3. platformName
    4. platformVersion
    5. location
    6. resolution
      Image Added

      Note: You can find the security token in the My security token option present under the Profile menu.
      Image Added

      Image Added

  14. Select Chrome under Browser and enter the version in the Desired Capabilities section.
    Image Added

  15. Navigate to the Suite Execution tab.
  16. Create a test suite and test case.
  17. Select the Execution Profile you created.
    Image Added

  18. Click on the run now icon.
  19. Verify the report in RTR.
    Image Added

  20. Go to Perfecto.
  21. Click Onboarding > Test Analysis.
    Image Added

  22. Verify the execution.
    Image Added

  23. You can also see the video recording as shown in the following screenshot:
    Image Added

Executing Test Cases Behind Firewall Applications

Few applications are configured to be accessed using private networks. Such applications deny access when they are being accessed from other than local networks and so from Perfecto. Executing test cases on Perfecto for such applications needs special configurations.

Simply download Perfecto Connect client executable that matches your Operating System. You need to execute it on the machine in the private network to allow Perfecto executing tests flawlessly.

For more information on configuration of Perfecto connect, refer to the Perfecto documentation.

To configure perfecto to run test cases for the applications behind firewall:

  1. Download Perfecto Connect executable depending on your OS.
  2. Unzip the folder and run the file using command line interface along with Cloud URL and Security Token
    For example: 

    Code Block
    perfectoconnect.exe -c <Perfecto_Cloud_URL> -s <Security_token>

    Image Modified

  3. Executing this file will give you the tunnel ID.
  4. Under Edit Additional capabilities, enter the tunnel ID in tunnelId. 

For more information about this, refer to the Perfecto documentation.