Launch Test with Web Runner

WebRunner is the component to run automated test and provided rich XML report. Based on the programming language used to build a test automation solution, the command-line has a little difference. However, all behaviors and arguments remain the same.

Warning

Spacing characters are not accepted as parameter values. Parameter with space must be enclosed in double-quotes.

webrunner "-a:<testproject>" [-data:<testdata>] [-env:<env_ariable>] [-browser:<browser-type>] [optional_arguments]

Prerequisites

To run tests build with WebEngine Framework, you have to provide compiled test automation solution.

  • -a:<testproject>: the filename or full path of compiled test project: DLL library for .NET.

If your solution use Data-Driven approach, it is required to provide at least one of following files:

  • -data:<testdata>: Test Data to be used for data-driven test execution, in XML format. The file can be exported via Excel Add-in
  • -env:<env_variable>: Environment Variables in XML format, to store test environment related test data, such as URLs, Hostnames or Credentials.

Examples

Run test on desktop browsers

For following command line launches the solution in Firefox browser and generate test reports in C:\Temp

WebRunner.exe "-a:MyProject.dll" "-data:Data.xml" "-env:Staging.xml" "-browser:Firefox" "-outputDir:C:\Temp"

Run webapp test on Android Emulator

Following command line launches same test under emulated Android device (requires Android Emulator + Appium Server on local) using Chrome browser.

WebRunner.exe "-a:MyProject.dll" "-data:Data.xml" "-env:Env.xml" "-platform:Android" "-browser:Chrome" "-device:Emulator" "-outputDir:C:\Temp"

Run app test on Selenium compatible Device Cloud

Following command line installs the application package, then launches test under iPhone 12, using provided device cloud.

WebRunner.exe "-a:AppProject.dll" "-data:Data.xml" "-env:Staging.xml" -platform:iOS -browser:IOSNative "-device:iPhone 12" "-grid:http://seleniumgrid.com/wd/hub" "-appId:C:\app_under_test.ipa"

Optional parameters

Note

Some parameters can be provided in the configuration file appsettings.json for C# and application-properties.yml for JAVA.

Please refer to Test Configuration C# for C#

Please refer to Test Configuration JAVA for Java

Commun parameters

-browser:<browser>

Specifies the browser on which to run test. see: BrowserType.

-platform:<platform>

Specifies The platform for test execution: see: Platform. Default value is Windows.

-outputDir:<outputFolder>

Specifies the folder to store output of test execution and test report. This parameter is can be defined in appsetting.json for C# and application.yml for JAVA.

-m

Specifies the manual debug mode. Use this mode for debugging test scenarios locally. When the test is failed test will pause for manual intervention before clean-up process.

-junit:<junit-report-path>

In additional of default XML report, generates a JUnit 2.6 compliant test report. Useful to publish test result to a Continuous Integration Platform

-html:<html-report-path>

In additional of default XML report, generates a HTML test report. Test report will be generated in the given folder. HTML report contains also css, javascript and screenshot files. If you want the share the report, you have to copy the whole folder.

-showReport

Launches Report Viewer after test execution.

Parameters for Mobile testing

To run tests on Mobile device, -platform, you should specify the following arguments Android or iOS.

-grid:<gridUrl>

Indicates the Selenium Grid to connect to device cloud. Default value is http://localhost:4723/wd/hub for local Appium Server If you are using cloud-based device cloud, please refer to service providers documentation. If the argument is provided, option desktopGrid will be automatically set to true

-desktopGrid

This option activates the usage of Selenium Grid for Web Desktop tests. If the value is false, the framework only use selenium grid for mobile based tests.

-username:<username>

Indicates the username to be used for Selenium Grid authentication.

-password:<password>

Indicates the password to be used for Selenium Grid authentication.

-device:<deviceName>

Indicates the device name for device selection. for example: iPhone Xs, Huawei P30. Refers your cloud provider.

-osVersion:<version>

Indicate the version of the OS for device selection. for example: 14.1, 9.0. Refers your cloud provider.

Where to find WebRunner package?

WebRunner package is installed via NuGet Package (.NET) or Maven (Java). After compilation of your test automation project, it will be found in project output folder.