First, go to the Tests list page:
Test menu link
1 - Adding tests to the run list
Then, select all the tests that you which to add. The order in which you add them will be the order in which they will run.
Run tests button
Pay attention to the Run list: if you have clicked several times the same test, instead of having one line per occurrence of that test, you have one line with a repetition number on the left of the name of the test. You can edit that repetition number if you click it:
Running tests repeat button
When you are ready, click Run.
2 - The run confirmation page
The tests will not be run immediately: instead, you'll be taken to a new page, named Run confirmation page:
Running tests run page
If you don't intend to change anything to the default values, it's quite straightforward, and you can directly click the big green Run button at the top or at the bottom. But if you want to customize the behavior of your tests, let's take a look at the following areas:
- The platform selector (you will not see it if you only have one platform). The platform you choose will give you access to different values for the global variables your tests may be using. For instance, a global variable PLANE_TICKET may have a value ETKT42420010 on platform Beta and a value ETKT83829218 on platform Production.
- The name field, to give a custom name to your results. By default, results have no name, so it's hard to find a specific result in the Tests results page unless you gave it a name.
- The variables editing and owners overriding area.
- The options area.
Selecting a different platform
As you may already know, global variables can have different values per platform, and even several values on the same platform. Let's assume that we have the following global variables configured:
Available global variables
-
The variable AMOUNT_BET has exactly one value on platform Production: (1000) and no value on platform TheBeta.
-
The variable API_SERVER has exactly one value on each platform.
-
The variable LUCKY_NUMBERS has two values on platform Production (423317088998 and 498892018327) and no value on platform TheBeta.
And let's assume that our test named lucky draw test requires the following variables:
Example test
-
The global variable LUCKY_NUMBERS is used as a public variable
-
Global variables AMOUNT_BET and API_SERVER are used as private variables.
In our Run confirmation page, if we choose to run the tests on platform Production, here is what happens:
Example on platform Production
Both global variables AMOUNT_BET and API_SERVER are private, so we don't see them in the variables area. But since they have a value for the platform Production, they'll take that value without us seeing it.
The global variable LUCKY_NUMBERS is public, so we can see it. Since that variable has two values on the platform Production, we can choose which value to pick. We can even enter a custom value if needed.
What if LUCKY_NUMBERS was private? Since it has several values on platform Production, the first value (423317088998) would be selected automatically, and we would not be able to change it.
The case of a platform with missing global variable values
What if we select the platform TheBeta? We'll run into problems:
Example on platform TheBeta
-
The global variable LUCKY_NUMBERS has no value on this platform. But it's not a problem, because it's used as a public variable. So we can just enter a value manually.
-
However, the global variable AMOUNT_BET has no value too, and is private. So we get an error message warning us that there is no value available on this platform, and we are prevented from running the test. The solution is either to add a value for AMOUNT_BET on platform TheBeta, or to edit the test.
Now that we have seen how selecting a platform impacts the way your tests will run, let's see the most important area for configuring the run: the variables editing and owners overriding area.
Configuring variables and owners
When the same test is to be run several times in a row, it is displayed as a group:
Run page with collapsed tests group
You can tell it's a group thanks to the arrow symbol ▶ on its left, and the repetition number on its right (x2). By default, the group is collapsed, but you can expand it and see one line per repetition if you click it:
Run page with expanded tests group
Expanding the group allows you to set different values of variables and owners for each repetition of the test. If the group is collapsed, changing a variable or owner means changing it for all repetitions at once.
There are also additional options to set the values of variables and owners more quickly. Click the three dots button ⋮ on the right of a variable or owner and you'll see this:
Shortcuts to change variables' values
The Reset value option will revert the value of the variable or owner to what it was originally. The Set same value for all tests will give the same value to this variable or owner everywhere at once.
The run options
At the bottom of the Run confirmation page is the Options area:
Run options
-
Run later: choose when to launch the tests, if not immediately.
-
Send me results by email.
-
Ignore errors: if checked, if an action fails, the test will still proceed. The default behavior is to stop at the first error.
-
Wait SMS for and SMS observation delay options: these options only appear when at least one of the tests contains a Wait SMS action.
3 - Running tests again
Alternatively, you can relaunch tests from the Tests results page. Just click to Add all the results whose tests you want to re-run, and then click Run:
Running tests again
Or in a results details page, click the Run again button to relaunch this specific test:
Run again button