Table "AIT Test Suite"
Properties
| Name | Value |
|---|---|
| Caption | AI Eval Suite |
| DataClassification | SystemMetadata |
| ReplicateData | False |
| Extensible | True |
| Access | Public |
Fields
| Name | Type | Description |
|---|---|---|
| Code | Code[10] | Specifies the Code for the eval suite. |
| Description | Text[250] | Specifies the description for the eval suite. |
| Status | Enum System.TestTools.AITestToolkit."AIT Test Suite Status" | Specifies the status of the eval suite. |
| "Started at" | DateTime | Specifies when the eval suite was started. |
| "Input Dataset" | Code[100] | Specifies the dataset to be used by the eval suite. |
| "Ended at" | DateTime | Specifies the end time of the eval suite execution. |
| "No. of Tests Running" | Integer | Specifies the number of evals running in the eval suite. |
| Tag | Text[20] | Specifies the tag for an eval run. The Tag will be transferred to the log entries and enables easier comparison between the evals. |
| "Total Duration (ms)" | Integer | Specifies the time taken for executing the evals in the eval suite. |
| Version | Integer | Specifies the version of the current eval run. It is used for comparing the results of the current eval run with the results of the previous eval run. The version will be stored in the Log entries. |
| "Copilot Capability" | __MissingTypeSymbol__ | Specifies the capability that the eval suite evaluates. |
| "Run Frequency" | Enum System.TestTools.AITestToolkit."AIT Run Frequency" | Specifies how frequently the eval suite should be run. |
| "Base Version" | Integer | Specifies the base version to compare the current eval run results against. |
| RunID | Guid | Specifies the unique identifier for the eval run. |
| "No. of Tests Executed" | Integer | Specifies the number of evals executed for the eval suite. |
| "No. of Tests Passed" | Integer | Specifies the number of evals passed for the eval suite. |
| "No. of Operations" | Integer | Specifies the number of operations executed including "Run Procedure" operation for the eval suite. |
| "Tokens Consumed" | Integer | Specifies the aggregated number of tokens consumed by the eval in the current version. This is applicable only when using Microsoft AI Module. Tokens consumed by agent sessions are not included in this number. |
| Accuracy | Decimal | Specifies the average accuracy of the eval suite. The accuracy is calculated as the percentage of turns that passed or can be set manually by the eval. |
| "Number of Evaluators" | Integer | Specifies the number of evaluators to use in the eval suite. |
| "Number of Column Mappings" | Integer | Specifies the number of evaluators to use in the eval suite. |
| "Run Language ID" | Integer | Specifies the language in which the eval suite should be run. |
| "Run Language Tag" | Text[80] | Specifies the language tag for the language in which the eval suite should be run. |
| "Run Language Name" | Text[80] | Specifies the name of the language in which the eval suite should be run. |
| "Test Runner Id" | Integer | Specifies the ID of the test runner to be used by the evals. |
| "Imported by AppId" | Guid | Specifies the application id from which the eval suite was created. |
| "Imported XML's MD5" | Code[32] | Specifies the MD5 hash of the XML file from which the eval suite was imported. |
| Validation | Boolean | Specifies whether this eval suite is used for validation purposes. |
| "Test Type" | Enum System.TestTools.AITestToolkit."AIT Test Type" | Specifies the type of AI eval (Copilot, Agent, or MCP). |
| "No. of Tests Skipped" | Integer | Specifies the number of tests that were skipped due to credit limit being reached. |
| SystemId | Guid | |
| SystemCreatedAt | DateTime | |
| SystemCreatedBy | Guid | |
| SystemModifiedAt | DateTime | |
| SystemModifiedBy | Guid | |
| SystemRowVersion | BigInteger |