Overview of the Results File

A results file provides information about the execution of the test case, script, suite, test plan, or keyword-driven test. By default, the results file has the same name as the executed script, suite, test plan, or keyword-driven test, but with a .res extension. For example, find.res.

Whenever you run tests, Silk Test Classic generates a results file, which indicates how many tests passed and how many failed, describes why tests failed, and provides summary information. You can invoke comparison tools from within the results file that pinpoint exactly how the runtime results differ from your known baselines. Test-plan results files offer additional features, such as the ability to compare different runs of the test plan. When Silk Test Classic displays a results file, on the menu bar it includes the Results menu, which allows you to manipulate the results file and locate errors. The Results menu appears only when the active window displays a results file.

TrueLog Explorer

Silk Test Classic also provides the TrueLog Explorer to help you analyze test results files. You must configure Silk Test Classic to use the TrueLog Explorer and specify what you want to capture.

Multiple User Environments

A .res file can be opened by multiple users, as long as no test is in process. This means you cannot have two users run tests at the same time and write to the same results file. You can run a test on the machine while the file is open on the other machine. However, you must not add comments to the file on the other machine, or you will corrupt the .res file and will not be able to report the results of the test. If you add comments to the file on both machines, the comments will be saved only for the file that is closed (and therefore saved) first.

Default Settings

By default, the results file displays an overall summary at the top of the file, including the following:

The name of the script, suite, test plan, or keyword-driven test.
The machine on which the tests were executed.
The amount of tests that were executed.
The amount of errors and warnings that were generated during the execution.
The actual errors that were generated.
Timing information.

To hide the overall summary, click the summary and click Results > Hide Summary. For a script or suite results file, the individual test summaries contain timing information and errors or warnings. For a test plan results file, the individual test summaries contain the same information as in the overall summary plus the name of the test case and script file.

While Silk Test Classic displays the most current version of the script, suite, or test plan, by default Silk Test Classic saves the last five sets of results for each script, suite, or test plan executed. To change the default number, use the Runtime Options dialog. As results files grow after repeated testing, a lot of unused space can accumulate in the files. You can reduce the size of a results file with the Compact menu option.

The format for the rest of a test plan results file follows the hierarchy of test descriptions that were present in the test plan. Test statements in the test plan that are preceded by a pound sign (#) as well as comments, which are using the comment statement, are also printed in the results file, in context with the test descriptions.

comment

To change the default name and directory of the results file, edit the Runtime Options dialog.

Note: If you provide a local or remote path when you specify the name of a results file in the Directory/Field field on the Runtime Options dialog, the path cannot be validated until script execution time.