Run test suites

After you create a test suite, you run the test suite in order to gain the full picture of the part of the application for which your test suite was created.

When you run a test suite, you can run it in different ways:

  • One person can run the entire test suite as a unit, performing each test run individiually until the tests contained in the suite are completely run

  • Different people can run the different tests contained in the test suite, and the owner of the test suite receives the compiled results for the test suite's test. This method is particularly helpful for regression testing.

Run a test suite by a single user

When running a test suite by a single user, the process is much the same as running an individual test. The user starts the test suite, and runs each of the tests contained in the test suite in sequential order.

  1. In the Smart List View or the Grid View in the Tests tab of the Quality module or the Tests tab of a feature or story in the Backlog module, select the test suite to run.

  2. In the toolbar, click the Run Test button .

  3. In the run dialog, provide the test run details:

    • Run name: A meaningful name for this individual test run

    • Release: The release to which the test run is assigned. This ensures that the test results are shared with the relevant release and represented in dashboard graphs for that release.

      You can use a test script version from any release with the Use a version from another release check box. Select this option and specify the release of the script version that you want to use. If there is more than one script version related to the release you selected, the latest script version will be used.

      For details on test versions, see Save and compare versions of test scripts.s

    • Environment on which to run the test

    • Draft run: Whether or not this run should be included in dashboard or overview graphs

  4. Click Let's Run! to run the tests.

    The Manual Runner opens.

    During the test run, you can also edit run details by clicking the Run Details button at the top of the Manual Runner window.

  5. Run your manual and Gherkin tests individually. For details, see Run manual and Gherkin tests.

  6. As you complete an individual test run, in the toolbar, advance to the next test using the Manual Runner toolbar: 

    As you run through the test suite, the Manual Runner toolbar also displays overall details for the test suite:

  7. After completing all the tests, click to stop the run.

Back to top

Run a test suite by multiple users

When you run a test suite by multiple users, the suite is basically run as a series of individual tests. At the completion of all test runs for the tests contained in the test suite, the results are compiled in a single report for the owner to view.

  1. In the Smart List View or the Grid View in the Tests tab of the Quality module or the Tests tab of a feature or story in the Backlog module, select the test suite to run.

  2. In the toolbar, click Plan Run.

  3. In the run dialog, provide the test run details:

    • Run name: A meaningful name for this individual test run

    • Release: The release to which the test run is assigned. This ensures that the test results are shared with the relevant release and represented in dashboard graphs for that release.

      You can a test script version from any release with the Use a version from another release check box. Select this option and specify the release of the script version that you want to use. If there is more than one script version related to the release you selected, the latest script version will be used.

    • Default environment on which to run the test

    • Default assign to: The default user to appear in the Run by field. This can be updated later if needed, although it is better to leave it blank.

    • Draft run: Whether or not this run should be included in dashboard or overview graphs

  4. In the test suite, select the Suite Runs tab. A list of all suite runs, both planned and previously run is displayed.

  5. In the list of suite runs, click on the link for your planned run. The suite run details are displayed.

  6. In the suite run instance, click the Runs tab. A list of all tests included in the suite is displayed.

  7. In the list of tests, click on each individual test link. Inside the test, in the Run by field, assign the test to the relevant user and click Save.

    After you assign all the tests to users, the Runs tab displays the updated list for the multiple users:

    In addition, the assigned owner of the test run receives a notification of the assignment in the My Work area of ALM Octane.

    Tip: If you want to assign a test to be run twice as part of a suite run, but on different environments, in the Runs tab, select the test and click the Duplicate Run button . The same test is added in the list of tests and you can change that test run's attributes as needed.

  8. Each assigned owner runs the tests as normal. When they are complete, the results are compiled for the owner to view.

Back to top

View the suite run results

When the entire suite (all of the suite's tests) runs, the run results are compiled into a single report.

  1. In the Test Suite, click the Suite Runs tab.

  2. In the list of suite runs, click on the numerical link for the suite run you want to view.

  3. In the suite run instance, click on the Runs tab. The list of all runs is displayed.

  4. In the Runs tab, click the Report tab. The suite run report is then displayed:

    You can then scroll or click the links to view each test in the suite, as well as the specific steps in each test.

Back to top

See also: