Configuration suites allow you to execute the same set of tests against multiple configurations, for example multiple browsers or operating systems. To be able to make reasonable statements related to quality and reliability of your application under test you will want to keep track of the results for each individual configuration.
Use the data mart view RV_ConfigurationSuiteStatus to create a report that returns the passed, failed, and not executed counts for each configuration per build.
SELECT BuildName, ConfigurationName, PassedCount, FailedCount, NotExecutedCount FROM RV_ConfigurationSuiteStatus WHERE ConfigurationSuiteID = ${configSuiteID|97|Configuration Suite ID} ORDER BY BuildOrderNumber, ConfigurationName
BuildName | ConfigurationName | PassedCount | FailedCount | NotExecutedCount |
---|---|---|---|---|
350 | Chrome | 0 | 1 | 0 |
350 | Firefox | 0 | 1 | 0 |
350 | Internet Explorer | 0 | 1 | 0 |
351 | Chrome | 1 | 0 | 0 |
351 | Firefox | 1 | 0 | 0 |
351 | Internet Explorer | 0 | 1 | 0 |
352 | Chrome | 1 | 0 | 0 |
352 | Firefox | 1 | 0 | 0 |
352 | Internet Explorer | 1 | 0 | 0 |