Creating A Test Run
Selecting Devices for Xamarin Test Cloud
Overview
A test run refers to a single, point-in-time run of a test for a mobile application in Xamarin Test Cloud on a
collection of devices and the results of that test run. Xamarin Test Cloud provides a Test Run Wizard that will
guide you through selecting devices and provide you with a snippet showing the command line to use for
submitting your tests.
Requirements
You must have a Xamarin Test Cloud account. Your account must be a member of a team with permissions to
submit tests to that account.
The only way to select devices for a test run is to use the Test Run Wizard.
Creating a Test Run
1. Login in to Xamarin Test Cloud with your account.
2. Select New Test Run:
3. Select the application that this test run is for, and click Next:
4. Select the device that you want to run the tests on, and click Select x devices. Notice that the wizard does
provide you with some selectors to help narrow down what devices may be of interest to you:
5. On the next dialog in the wizard allows you to specify meta-data about the run:
These options are explained in more detail below.
6. The final screen will provide you with some instructions and a sample command line for uploading tests to
Xamarin Test Cloud. Pictured below is one screenshot for Xamarin.UITest, and another for Calabash:
The team API key is a sensitive value that should be protected. The device id is not, and can be shared
with other test runs if desired.
Command Line Parameters
The Test Run Wizard assists with selection devices provides a snippet of what command line parameters to use
when initiating a test run. The table below lists some of the command line parameters for test-cloud.exe. It is
not a definitive list, but describes some of the more commonly used parameters.
Parameter
--devices
--user
Description
The device identifier is a unique number that identifies the devices that will be used to run the
tests. Mandatory.
The e-mail address of the user that is running the tests. Mandatory.
-assembly-
The path to the directory holding the UITest assemblies. Mandatory.
dir
--dsym
--nunitxml
--category
--fixture
--testchunk
--testfixture
The path to the dSYM files to upload to Test Cloud. Optional. iOS only.
The name of a file to save the NUnit test results.
Runs only the tests that belong to the specified category. Can be specified more than once to
identify multiple categories. Optional.
Run on the tests in the specified fixture. Optional
Run tests in parallel by test method. Optional.
Run tests in parallel by test fixture. Optional
Parameter
--series
--locale
Description
The test series is a logical grouping of tests. For example, tests runs can be grouped into
production, developer, or beta. Optional.
The language for the test run. Optional
--app-name Specify the name of the application in Xamarin Test Cloud. Optional.
Summary
This guide discussed how to create a test run using the Test Run Wizard on the Test Cloud website. It also briefly
explained some of the common command line parameters for submitting test runs.