Chapter 3 of 6 · Before you start

Continuous evaluation and Foundry platform alerts

Optional module · Draft 3.5 hours

Chapter 3 of 6

Confirm these prerequisites:

  • Session 04 produced one governed Foundry agent in an approved nonproduction project.
  • Session 09 selected the evaluator set and thresholds for that same agent.
  • Session 11 named the Log Analytics workspace, Application Insights resource, action owner, and incident route.
  • Session 12 or the approved deployment path can run Bicep what-if and deployment at the exact resource group that contains the Foundry account.
  • The operator has Monitoring Contributor on the approved resource group.
  • The project managed identity can receive Foundry User through the customer's access process.
  • The operating owner has reviewed baseline traffic and approved the initial thresholds.

Keep tenant IDs, subscription IDs, resource IDs, project endpoints, prompts, responses, tokens, connection strings, and customer data out of this repository. Store resolved values in the approved private configuration path.

Implementation files#

TypeFileConsumer
Deploymentartifacts/monitoring/foundry-platform-monitoring.bicepThe Azure monitoring deployment pipeline
Deploymentartifacts/monitoring/foundry-platform-monitoring.bicepparamThe Azure monitoring deployment pipeline
Recordartifacts/evaluation/continuous-evaluation-decision.jsonThe AI quality owner, Foundry operator, and module preflight scripts
Runtimeartifacts/evaluation/continuous-evaluation-rule.pyThe Foundry evaluation operator
Runtimeartifacts/evaluation/requirements.txtThe Foundry evaluation operator and Python build process
Runtimeartifacts/queries/foundry-token-and-throttling.kqlThe Azure Monitor operations owner

Optional module

Continuous evaluation and Foundry platform alerts slide deck