Viewing the Results of a Test

Once you have started executing a test, information about the reports and documents appear in the Results Summary area of Integrity Manager. This area lists all the selected reports/documents by name and path. Each report also shows one of the following statuses:

Pending reports/documents have not yet begun to execute.
Running reports/documents are in the process of executing.
In a performance test, this status appears as Running (#/#). The first number is the current execution cycle. The second number is the number of times the report/document will be executed in the test.
Paused (#/#) reports/documents, in a performance test, have executed some but not all of their specified number of cycles when the test execution is paused. The first number is the number of cycles that have been executed. The second number is the number of times the report/document will be executed in the test.
Completed reports/documents have finished their execution without errors.
Timed Out reports/documents did not finish executing in the time specified in the Max Timeout field in the Select Execution Settings page of the Integrity Manager Wizard. These reports have been canceled by Integrity Manager and will not be executed again during this run of the test.
Error indicates that an error has prevented this report/document from executing correctly. To view the error, double-click the report's status. To group the reports and documents with the same error message together in the Results Summary area, see Sorting reports and documents by error messages.
Not Supported reports contain one or more prompts for which an answer could not be generated. These reports will not be executed during this run of the test. To view information about the prompt, double-click the report's status. For more information about how Integrity Manager answers prompts, see Executing prompted reports in Integrity Manager.

Additional information about Completed reports/documents is available in the Data, SQL/MDX, Graph, Excel, and PDF columns, as follows:

The document/dashboard SQL is not visible in the Report Data area and only can be seen in the Result Summary page.

Matched indicates that the results from the baseline and the target are identical for that report/document. In a single-project integrity test, Matched indicates that the report executed successfully.
Not Matched indicates that a discrepancy exists between the baseline and the target. To view the baseline and target report/documents in the Report Data area, with the differences highlighted in red, select the report. For detailed instructions on how to view and compare report/documents, see Analyzing a tested report or document.
Not Compared indicates that Integrity Manager was unable to compare the reports/documents for that type of analysis. This can be because the report/document was not found in the target project, because one or more prompts for the report are not supported by Integrity Manager, or because an error prevented one of the reports/documents from executing.
Not Available indicates that Integrity Manager did not attempt to execute the report/document for this type of analysis. This may be because this type of analysis was not selected on the Select Processing Options page, or (if N/A is present in the Graph column) because the report was not saved as a Graph or Grid/Graph.

To change the columns displayed in the Results Summary area, right-click any column header and select the columns to view from the list that opens.

While an integrity test is running, you can pause and resume its execution by clicking the Pause or Resume buttons on the toolbar. When you pause a test, any currently executing reports/documents complete their execution, but no new reports begin execution until you resume the test. If you are executing multiple cycles in a performance test, the reports/documents finish the current cycle and then pause.

You can re-run specific reports or documents in a test by selecting them > Run > Re-run Selected Items. For more information about re-running part of a test, see Re-running reports or documents in a test.

Viewing the Results of a Test

Related Topics