Executing tests from Quality Center

As an alternative to executing tests from TestArchitect, TestArchitect test cases and test modules can be executed from Quality Center.

Ensure that the machine hosting the TestArchitect repository server has the HP ALM Connectivity Add-in installed, to allow for integration and synchronization between TestArchitect and HP Quality Center.

Ensure that you have already taken the following steps:
  1. In Quality Center's ALM sidebar, navigate to Testing > Test Lab. The Test Lab module appears.
  2. In the test plan tree of the Test Sets tab, right-click the folder in which you want to create a new test set, and then select New Test Set.

  3. On the New Test Set dialog box, enter the name of the new test set in the Name text box, and then click OK.

  4. Select the Execution Grid tab, and then click Select Tests. The Test Plan Tree window opens and displays tests that were created in the Test Plan module.

  5. Select the test cases and/or test modules to add to the test set, and drag them to the Execution Grid tab.
    Tip: You can distinguish a test module by the pound sign (#) as the first character in its name.
  6. Select the test cases and/or test modules in the Execution Grid tab and click Run. Selected items are added to the Automatic Runner dialog box.

  7. In the Automatic Runner dialog box, specify the host machine (in the Run on Host column) where each selected test will run. If you want to run all tests on the local host machine, select the check box Run All Tests Locally.
    Restriction: Due to Quality Center limitations, execution of tests on a Linux host from Quality Center is not supported.
  8. Select a test on the test list you want to execute and click Run to execute the selected test case, or click Run All to run all test cases on the list. The TestArchitect Execution dialog box appears.

  9. In the dialog box, enter the requested information as described below:
    • TestArchitect Information panel:

      • Repository Server: Name or IP address of TestArchitect Repository Server holding the repository of the tests.
      • Port: Port number of the TestArchitect Repository Server host.
      • Repository Name: Name of TestArchitect repository hosting the tests.
      • User Name: TestArchitect user name whose account has permission to access and execute tests on the host.
      • Password: Password for the above user account.
    • General tab:
      • Variation Specification panel:

        • Keyword: Keyword, or comma-delimited list of keywords, specifying the test variation to be executed, if any. (See Creating keyword variations.)
        • AUT Version: Enter a value or click the Select Version button to specify a variation tailored to an AUT version or platform (See Creating linked variations.)
        • Time Traveling: To opt for time traveling execution, which selects an historical "snapshot" of the test's project items for execution during the test run, select the check box and provide an appropriate timestamp. (See Time Traveling for details.)
      • Controllers/Devices panel:

        • Select Controllers/Devices: Click this button to designate which controller and device the test will execute on.
          • Lab Manager Server: (Display only) IP and port number of the Lab Manager Server to which the test controllers and devices are registered.
          • Controllers/Devices panel: Lists all available controllers and cloud/physical mobile devices on which the test can be executed. The list consists of those controllers and devices that are either registered with the Lab Manager Server or have been manually added with the Add Controller or Add desired capabilities files button.
          • Controller Port Configuration: Use this panel to specify to TestArchitect the port number that the remote machine is using for its TestArchitectcontroller, if not using the default.
            • IP/Server Name: (Display only) IP address of remote machine currently selected in the Controllers/Devices panel.
            • Port: Port number through which TestArchitect will attempt to communicate with the controller on the host specified in the IP/Server Name field. If this is not the port on which the controller is known to be listening, change this value and then click Save .
        Restriction: Only one controller or one device may be selected to run tests at a time. In other words, multiple controller/device execution is prohibited.
      • Automatically add result(s) to repository: Select this check box if you want to add test results automatically to the repository once the test concludes.

        • Repository destination: Add test results to the repository at this specified location.
        • By result: Limit the results stored to the repository in accordance with the following check box selections:
          • Passed: Passed test results are stored.
          • Passed with Warnings/Errors: Passed test results with warnings/errors status are stored.
          • Passed with known bug: Test results which passed, but with marked known bugs whose outcomes have been ignored, are stored.
          • Failed: Failed test results are stored.
    • Startup Settings tab:

    Tip: To save the configurations, click the Save button.
    Note: The list of remote machines is added using the Available Options field in the New External Tool dialog box (see Configuring the Quality Center connection). For an existing tool profile, the field is available on the tool profile’s information screen.
  10. Click Run to execute the tests.
    Important: If you are executing tests for the first time, you are prompted to enter your TestArchitect license server information. Enter the required information in the dialog box. If the specified license server is reached successfully, or the trial key is validated, the provided license information is stored. From then on, you will be able to execute tests without again being prompted for this information.

TestArchitect executes the test, and the test results are uploaded to Quality Center.

  • When running an automated test, the execution of every single Quality Center test entails the execution of the INITIAL section, if any. However, the execution of the last Quality Center test entails the execution of both the INITIAL and FINAL sections. For example, execution of test 01 (the first in the sequence) starts off with execution of the INITIAL section; the same is true for each subsequent test, including test 05, the last one. Note, however, that only test 05 concludes with execution of the FINAL section.
  • If, in the TestArchitect Execution dialog box, you specify a non-default test variation (using the Keyword and/or AUT version boxes), the results of the variation's test run are uploaded as follows:
    • if the variation has been mapped with Quality Center: the results are uploaded to the correct mapped variation.
    • if the variation has not been mapped with Quality Center: the results are uploaded to the default test.

You can view the execution results in Quality Center from Test Lab's Last Run Report tab. Click an action on the report to view the detailed steps for that action.

Note: The Actual fields on the Steps Details frame show the actual argument values, if any, for the selected action immediately after that action line finishes execution.
A detailed test report is also stored in the Local Results folder of the TestArchitect project, and is available on the TestArchitect explorer tree.
  • If your test includes action lines occurring before the first test case in the TestArchitect test module (an area commonly referred to as the INITIAL section of the test module) and you start a test case in Quality Center, TestArchitect executes the initial action lines before executing the test case. Typically, such action lines are used to have TestArchitect start the system under test, or to initialize some variables.
  • Ensure that the TestArchitect Data folder can write files with UAC enabled. To do this you must run Internet Explorer or Quality Center Explorer using the Run as administrator option.