Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

...

...

...

...

...

...

...

...

...

...

...

...

...

...

...

...

...

...

...

Introduction

Sauce Labs is a cloud environment which allows users to run tests in the cloud using different combinations of operating systems, browsers, and browser versions. In this environment all tests are executed on Sauce Labs VM. You can view the ongoing suite execution on Sauce Lab's Dashboard.

...

  • An active account with valid user name / password 

  • Sufficient balance of execution hours.

Info

After logging to Sauce Labs, click Data Center located at the top-right corner, and select the Time Zone to USE West 1.

Mandatory Settings in Qualitia

You must create execution profiles that are solely used for execution on Saucelabs platform from Qualitia Client or offline package. In those execution profiles, you must define the settings that are mandatory for test suite execution.

Mandatory Settings in the Associated Execution Profile

Do the following in the order listed:

  1. From the Environment list, select as Cloud.

  2. From the Cloud Platform list, select Sauce.

  3. Select the Edit Desired Capabilities checkbox

  4. Select or enter the following values: 

    • Url

    • username 

    • accesskey

  5. To test on a desktop web application, select usew3c as True.

  6. To test on a mobile application,

    • Enter the Platform Version only and do not edit the default value for the Native Object sync time. 

    • Do not add the same capabilities that are already specified in Sauce labs Mobile section, such as deviceName.

    • For iOS mobile application, ignore value present in Appium Server URL as it is mandatory field. It is not used in the execution.

    • To test on a mobile hybrid application, select nativeWebScreenshot as True.

      • To test on an iOS native or hybrid application, perform the following actions:

        • From the automationName drop-down, select XCUITest.

        • Enter the latest Appium version number as the appiumVersion.

Additional Recommendations:

In the Execution Parameters tab, select ScreenCaptureMode as Browser.

Viewing Current Execution on Sauce Lab's Dashboard

Once you have triggered the offline execution, you can view the status of your ongoing executions on the Sauce Lab's Dashboard. Each test case appears on dashboard as a single job with execution status against it. All the test cases are taken one by one by the sequence they are arranged in Suite. The status is updated after each test execution is completed on Sauce Lab environment with its status (fail / pass) against it. You can view the execution of test case clicking the current job on Dashboard.

You can record your test case execution configuring the sauce.properties file accordingly.

Set the recordVideo value as true and all the test case executions will be recorded.

You can download these videos once the test execution is completed from the Metadata tab. The video contains the execution of all the test cases available in Suite as the value set against QualitiaExecMode in the associated execution profile is PS (refers to per suite).

...

Execution Reports

Test execution reports are launched on the machine from where the execution was triggered after the test case execution is completed. You can also download the video of test case execution from the Metadata tab.

...

Execution Guidelines

To execute tests on Sauce Labs, follow these steps:

  1. Open Qualitia Automation Studio and login.

  2. Go to the Execute tab.

  3. Click Execution Profile.

  4. Click the plus icon to add new Execution Profile.

  5. Provide a name for the Execution Profile.

  6. Under Execution Configuration > Web Environment select Sauce Labs

  7. Under Web Execution Platform select Sauce Labs.

  8. In the Desired Capabilities window, enter all the following mandatory fields by selecting the checkbox: 

    • url

    • username 

    • accesskey

      Image Added


      You can find the URL in the User Settings option present under the Account menu.

      Image AddedImage Added

      Username and Access key are present under the Username & Access key menu.

      Image Added

  9. Select the browser under Browser and enter the version in the Desired Capabilities section.

    Image Added

  10. Navigate to the Suite Execution tab.

  11. Create a test suite and test case.

  12. Select the Execution Profile you created.

    Image Added

  13. Go to Sauce Labs.

  14. From the left navigation panel, select Automated > Test Results and verify the execution.

    Image Added

  15. You can also see the video recording as shown in the following screenshot:

    Image Added

Execution of Tests Running Behind Firewall (on Private Networks)

Few applications are configured to be accessed using private networks. Such applications deny access when they are being accessed from other than local networks and so from Sauce Lab. Executing test cases on Sauce for such applications needs special configurations.

...

  1. Open the associated execution profile.

  2. Under Edit Additional Capabilities, set the desired value for slw.tunnelIdentifier.
    The value set here for this key will be required when executing sc.exe in step 6. For more information on configuring this property, refer Sauce Labs documentation.

  3. Download the Sauce Connect Proxy on any machine in the network using following url: 
    https://wiki.saucelabs.com/display/DOCS/Sauce+Connect+Proxy

  4. Extract the folder at the suitable location.
    You will find the sc.exe file in the bin folder.

  5. Open Command Prompt and navigate to the folder where sc.exe file exists. 

  6. Enter the following command.

    Code Block
    sc -u <sauce_username> -k <accesskey> -i <tunnelID>
    For example: sc -u john.doe -k 8becc95c-4559-4582-a617-7d38544797a2 -i tunnel-1232
  7. Press Enter.

Once the SC.exe file is executed successfully, you can execute your offline tests on Sauce environment using the same method mentioned above.

Execution using Browser Capabilities

You can also execute test cases on remote environment using selenium supported Browser Capabilities.

For more information on this, please refer to the Execution using Browser Capabilities section.

Executing Test Cases on iOS Devices

If you are executing test cases on iOS mobile devices using Sauce Labs, you need to configure settings in the iosdc.properties file accordingly.

  • If iOS device is 9.3.x and below, automationname should be Appium or

  • If iOS device is 10.0.x and above, automationname should be XCUITest.

Execution using W3C Protocols

W3C-compliant Selenium capabilities and protocol is supported for test case executions in the Sauce Labs environment with selenium v3.11.0 and above.

...