Automatically uploading TestArchitect test results to Team Foundation Server

When launching a test run from TestArchitect Client, you can configure TestArchitect to automatically upload the test results to TFS upon conclusion of the run.

Ensure that you have already taken the following steps:

To automatically upload TestArchitect test results to TFS after execution:

  1. Initiate TestArchitect test execution as you normally would. (Learn more.) The Execute Test dialog box appears.
  2. On the General tab, in the Build Number field, specify a build number.

    Remember:
    • Build number is a built-in field for both TestArchitect and TFS, representing the AUT build.

    • If your TestArchitect installation is integrated with Visual Studio Team Services, formerly known as Visual Studio Online, be aware that the Build Number field in Visual Studio Team Services is governed by a user-specified domain of values. That is, any build number supplied from TestArchitect must first exist in Visual Studio Team Services's list of allowable build numbers.
  3. Switch to the Advanced tab, and then select the Upload result(s) to Team Foundation Server check box.

  4. Click the browse button.
  5. In the Select Location dialog box, specify a location on TFS to which you wish the result uploaded. You can do this by either of two means:
    • By explicitly defining the location:
      1. Click Select a Destination Folder.
      2. Select the location to which the result should be uploaded, and then click OK.

    • By using Work Item Query Language (WIQL).(Learn more.)
      1. Click Work Item Query Language (WIQL).
      2. Enter a WIQL query to query for a collection of satisfied TFS test cases, and then click OK.

        Tip: Click the question mark icon to see the typical syntax of a WIQL query.
  6. Select the Upload attachment(s) to Team Foundation Server check box to upload the TestArchitect test result to selected TFS test cases as an HTML file attachment. (Selectivity is determined by the field that follows).

  7. The By Team Foundation Server result list box allows you to specify which associated TFS test cases are to receive links to the attached test result. This determination is based, for each given test case, on its result in terms of its TFS outcome.

    • Passed: Attach the TA test result file if the test case's TFS outcome is Passed.
    • Inconclusive: Attach the TA test result file if the test case's TFS outcome is Inconclusive.
    • Failed: Attach the TA test result file if the test case's TFS outcome is Failed.
    Note:
    • The mappings between TestArchitect result statuses and TFS outcomes (that is, how TFS interprets each TA result status) are defined during initial configuration of the TA repository's connection to the Team Foundation Server. (Learn more.)
    • If more than one condition is selected, they are effectively OR'd together. For example: If both Passed and Failed check boxes are selected, any TA result that has an TFS outcome of either Passed or Failed is uploaded as an attachment.
  8. In the Upload attachment as panel, select the format of the uploaded test result
    • HTML: (Default) Upload the result as an HTML file.
    • Compressed (Zip): Upload the result as a zipped HTML file.
    • Automatically compress result(s) if file size > KB: Upload the result as a compressed (zipped) HTML file if the file exceeds the specified size. Otherwise, upload the result as an uncompressed HTML file.


  9. In the Execute Test dialog box, click the Execution button to begin test execution. After the test run terminates, TestArchitect automatically uploads the generated test results to TFS at the specified location and displays the upload confirmation message.
  10. Click OK to close the confirmation dialog box.
TestArchitect test results are uploaded to TFS in the format specified in step #8.

CAUTION:
In case of test results generated from a serial test run, that is, running multiple test modules sequentially within a single test run, if the given Build Number's values among test modules are not identical, the test results are unable to be uploaded to TFS. (Learn more.)