Providing arguments based on the execution environments or making changes to the properties file, the same QualitiaOffline jar file can be used to execute tests in different environments.
...
Qualitia Offline Package is compatible to execute on Sauce Labs and Remote environments along with local environments. Depending on the desired environment the Qualitia.Properties file accommodates configurations as follows;
To execute offline package on | Configure Qualitia.Properties as |
Local Machine | ExecutionEnvironment=local |
Remote Machine | ExecutionEnvironment=remote |
Sauce Labs | ExecutionEnvironment=sauce |
| Anchor | ||||
|---|---|---|---|---|
|
| Anchor | ||||
|---|---|---|---|---|
|
| Anchor | ||||
|---|---|---|---|---|
|
| Anchor | ||||
|---|---|---|---|---|
|
| Anchor | ||||
|---|---|---|---|---|
|
...
Qualitia Offline Package supports multiple platforms and browsers for test case executions and report viewing. Browser and platform support can be classified into in two ways:
- Support for Execution
- Support for Report Viewing
...
| Anchor | ||||
|---|---|---|---|---|
|
| Local |
|
|
| Remote |
|
|
|
|
| IE | Firefox | Chrome | Safari |
| IE | Firefox | Chrome | Safari |
Windows | Yes | Yes | Yes |
|
| Yes | Yes | Yes |
|
Linux |
| Yes | Yes |
|
|
| Yes | Yes |
|
Mac |
|
|
| Yes |
|
|
|
| Yes |
Here is a quick overview of the browsers and platforms you can use for test executions using offline package.
Executions on Virtual Machines:
- : denotes support for the browser on a platform.
| BrowserStack |
|
|
| Sauce Labs |
|
|
|
|
| IE | Firefox | Chrome | Safari |
| IE | Firefox | Chrome | Safari |
Windows | Yes | Yes | Yes |
|
| Yes | Yes | Yes |
|
Linux |
|
|
|
|
|
| Yes | Yes |
|
Mac |
|
|
| Yes |
|
|
|
|
...
| Yes |
| Anchor | ||||
|---|---|---|---|---|
|
Once test cases are executed, Qualitia displays reports using Internet Explorer (IE) browser on the local machine from where the execution is triggered. Following is the quick overview of the supported browsers that can be used for viewing reports on different platforms.
Note: Chrome is not supported for report viewing.
| IE | Firefox | Chrome | Safari |
Windows | Yes | Yes | Not Supported |
|
Linux |
| Yes | Not Supported |
|
Mac |
| Yes | Not Supported | Yes |
| Anchor | ||||
|---|---|---|---|---|
|
...
- Open the config folder of offline package.
- Open qualitia.properties file using Notepad++.
Figure 2.2.2 1
- Set the ExecutionEnvironment value as local.
Figure 2.2.2 2
Note: All the other configuration settings in the qualitia.properties file have to be done traditionally.
| Anchor | ||||
|---|---|---|---|---|
|
You can execute offline package using the traditional method after the configuration settings are done.
For more information on execution of offline package, see section 2.2.2, Offline Package - Execution.
It uses browsers available on local machine for test case executions. For example, if you have chosen "Firefox" to be the execution browser and the local machine has Firefox v42, Qualitia continues execution using Firefox v42. After the execution is complete, test execution reports are displayed on the local machine.
| Anchor | ||||
|---|---|---|---|---|
|
You can execute test cases on remote environment using selenium Selenium supported Browser Capabilities.
For more information about executing test cases using browser capabilities, see section 3.4.5, "Execution using Browser's Capabilities."
...
You can choose this option when you have distributed test environments where you want network to select a remote machine based on the availability.
Key Points to Know Before You Start
What is Hub?
The Hub is the main command center for managing which machines your test will run on. This is where you can see list of all the available nodes currently running in your grid environment (Remote Execution Environment).
What is Node?
A Node is a machine that you register with your Hub. By registering with Hub, the Hub now knows about the Node and any configuration information you used when you registered the node.
In order to perform remote execution through selenium grid, you need to configure Hub and Node in the network.
Creating Hub in the Network
A Hub can be created in the network following the steps mentioned below.
...
| Anchor | ||||
|---|---|---|---|---|
|
Note: You can bundle your IEServerDriver.exe or ChromeDriver.exe running while registering to Hub as shown in Figure 3.4.22.
| Anchor | ||||
|---|---|---|---|---|
|
Prior Before executing test cases in remote execution in selenium Selenium grid, you need to configure settings accordingly. Here are some important points to keep in mind when configuring settings for remote execution in selenium grid.
...
- Selenium server jar version used in Qualitia offline package and downloaded at remote machines including Hub and Nodes should be same all over.
- Java needs to be installed and configured in computer's environment path.
- Port number used for hub is changeable and default port number is 4444.
- As hub selects node for execution at its own at run time, you cannot provide details for specific OS / Platform.
- To know more about how to setup Selenium grid hub and node it is recommend using the selenium grid links given below.
- {_}{+}https://github.com/SeleniumHQ/selenium/wiki/Grid2+_
- _+http://www.joecolantonio.com/2014/10/07/selenium-grid-how-to-setup-a-hub-and-node/+_
To configure settings for remote execution in selenium grid:
...
Sauce Labs is cloud environment which allows users to run tests in the cloud using different combinations of operating systems, browsers, and browser versions. In this environment all tests are executed on Sauce Labs VM. You can view the ongoing suite execution on Sauce Lab's Dashboard.
It is recommended to set ScreenCaptureMode value as Browser when the execution environment is Sauce or Remote.
You can set the value for FailStepOnBrowserScreenshotFailure as per the test case requirements (as true or false) to behave when the application under test generates any runtime Alert / Windows.
To know more about Sauce Labs visit: _+https://saucelabs.com/+_
Prior starting offline execution on Sauce Labs, ensure you have;
...
Notes:
If you are providing these values through command line, each value should be provided within double quotes if values are containing spaces; otherwise, the spaces in values will result in inconsistencies. For example, java -jar Qualitia-Offline-xxx.jar platform="Windows 8.1".
For more information on platforms, browsers, browser versions supported on Sauce, please refer https://saucelabs.com/platforms/.
If you do not set these values against platform in the Sauce.properties file, all your test cases will be executed on Linux. Also, if you do not specify the version, test cases will be executed using the latest version of browsers.
Figure 3.4.3 2
When the Application under Test is mobile application and you want to execute the offline package in the Sauce Labs environment, you need to configure the saucemobile.properties file accordingly.
To update the saucemobile.properties file:
...
Users should not specify UDID when executing test cases on mobile devices on Sauce Labs.
Notes:
For more information about property possible values, refer the saucemobile.properties file.
You can use the Platform Configurator maintained by Sauce Labs to get the exact values of properties to set in the configuration files. Open Platform Configurator, select the properties based on which you want to configure your device on Sauce Labs and you will find the list of properties to be set in the configuration file at the end of page.
If you are providing these values through command line, each value should be provided within double quotes if values are containing spaces; otherwise, the spaces in values will result in inconsistencies. For example, java -jar Qualitia-Offline-xxx.jar platform="Windows 8.1".
For more information on platforms, browsers, browser versions supported on Sauce, please refer https://saucelabs.com/platforms/.
If you do not specify the version of browsers, test cases will be executed using the latest version of browsers.
...
You can execute the offline package following traditional method of offline execution.
For more details, please refer section 2.2.2, "Offline Package - Execution".
Values you provide in the sauce.properties file can also be provided using command line. You can set the sauce properties using three different sources as mentioned below.
Sauce.properties | It is a set of default Sauce properties file. You can always use this file to define your own set of properties. |
User Defined Sauce Properties | Qualitia users can create their own properties file for Sauce Labs, which includes all the Sauce Labs properties. This file can be used by providing command line arguments accordingly when executing offline package. |
Command Line Arguments | Qualitia allows providing Sauce properties as command line arguments. For example, java -jar qualitia-offline-xxxx.jar custom_username=<<sauce user name>> platform=MAC recordVideo=false |
Viewing Current Execution on Sauce Lab's Dashboard
...
- Download the Sauce connect zip on any machine in the network using following url:
{_}https://saucelabs.com/downloads/Sauce-Connect-3.1-r32.zip_
...
You can execute the offline package using traditional method of offline execution.
For more details, please refer to the section, 2.2.2, "Offline Package - Execution".
Values you provide in the browserstack.properties file can also be provided using the Command Prompt window. You can set the BrowserStack properties using three different sources as mentioned below.
browserstack.properties | It is a set of default BrowserStack properties file. You can always use this file to define your own set of properties. |
| Qualitia users can create their own properties file for BrowserStack, which includes all the BrowserStack properties. This file can be used by providing command line arguments accordingly when executing offline package. |
Command Line Arguments | Qualitia allows providing BrowserStack properties as command line arguments. For example, java -jar qualitia-offline-xxxx.jar custom_username=<<BrowserStack user name>> platform=MAC recordVideo=false |
- Viewing Current Execution on BrowserStack
...
For example; if you want to change the version of the browser to be used for test execution, remove the # sign located prior to the version and enter the version number against it.
Figure 3.4.5 1
Qualitia gives you provision to set these values for Selenium. Selenium has its own control on what value to use and how to reflect them in Execution Browser. For more information about Selenium Capabilities, refer following links:
- _+https://code.google.com/p/selenium/wiki/DesiredCapabilities+_
- _+https://sites.google.com/a/chromium.org/chromedriver/capabilities+_
| Anchor | ||||
|---|---|---|---|---|
|
...