Skip to main content

Handoff Pipeline

Security Planner to RAI Planner Pipeline

The Security Planner and RAI Planner form a connected assessment pipeline. When the Security Planner detects AI or ML components during Phase 1, it captures component details and enables RAI dispatch. At Phase 6, the Security Planner recommends starting the RAI Planner in from-security-plan mode.

flowchart LR
subgraph SP ["Security Planner"]
SP1["Phase 1\nScoping"]
SP6["Phase 6\nHandoff"]
SP1 -->|"detects AI components"| SP6
end

subgraph Handoff ["State Transfer"]
ST["state.json\naiComponents\nraiEnabled\nraiScope\nraiTier\nthreatCount"]
end

subgraph RP ["RAI Planner"]
RP1["Phase 1\nAI System\nScoping"]
RP6["Phase 6\nReview &<br/>Handoff"]
RP1 --> RP6
end
SP6 -->|"recommends entry"| ST
ST -->|"pre-populates"| RP1

What the RAI Planner Receives

When entering via from-security-plan mode, the RAI Planner reads the security plan's state.json and inherits:

DataSource fieldHow it is used
AI component inventoryaiComponents arrayPre-populates Phase 1 AI element catalog
RAI assessment scoperaiScopeSets initial assessment boundaries
RAI depth tierraiTierDetermines assessment depth (Basic, Standard, or Comprehensive)
Threat countthreat catalog sizeStarting sequence for T-RAI-{NNN} IDs
Security plan referencestate.json pathStored in securityPlanRef for cross-referencing

NOTE

The RAI Planner reads security plan artifacts as read-only. It never modifies files under .copilot-tracking/security-plans/.

Review Summary Generation

Phase 6 produces a review summary covering observations across six dimensions. The review summary presents maturity indicators rather than numeric scores, supporting handoff decisions and backlog prioritization.

flowchart TD
P1["Phase 1\nAI System Scoping"] --> D1["Standards\nAlignment"]
P2["Phase 2\nRisk Classification"] --> D6["Risk\nClassification"]
P3["Phase 3\nStandards Mapping"] --> D1
P4["Phase 4\nSecurity Model"] --> D2["Threat\nCompleteness"]
P5["Phase 5\nImpact Assessment"] --> D3["Control\nEffectiveness"]
P5 --> D4["Evidence\nQuality"]
P5 --> D5["Tradeoff\nResolution"]

D1 --> RS["Review Summary"]
D2 --> RS
D3 --> RS
D4 --> RS
D5 --> RS
D6 --> RS

Review Dimensions

DimensionWhat it covers
Standards AlignmentHow well AI components map to trustworthiness characteristics and regulatory frameworks
Threat CompletenessCompleteness and accuracy of AI-specific threat identification
Control EffectivenessCoverage and effectiveness of controls for identified threats
Evidence QualityQuality and availability of evidence supporting control effectiveness
Tradeoff ResolutionClarity of characteristic tradeoff analysis and resolution rationale
Risk ClassificationWhether risk indicators were evaluated with documented mitigations

Backlog Generation

Gaps identified during Phases 3 through 5 are converted to work items using the same dual-platform format as the Security Planner.

Dual-Platform Support

PlatformID formatFormattingTarget system
ADOWI-RAI-{NNN}HTML <div> wrapperAzure DevOps work items
GitHub{{RAI-TEMP-N}}Markdown with YAML frontmatterGitHub issues

Autonomy Tiers

Each generated work item receives an autonomy tier based on the severity and complexity of the finding.

TierHuman involvementWhen assigned
FullAgent creates and submits without confirmationLow-severity findings with clear remediation
PartialAgent creates items; user confirms before submissionDefault tier for most findings
ManualAgent recommends; user creates itemsHigh-severity findings or cross-team coordination required

Content Sanitization

All generated backlog content is sanitized before handoff:

  1. Replace .copilot-tracking/ paths with descriptive text
  2. Replace full file system paths with relative references
  3. Remove state JSON content or references
  4. Remove internal tracking IDs that are not work item IDs
  5. Preserve standards references in all cases

Pipeline Artifacts

ArtifactPathGenerated during
System definition pack.copilot-tracking/rai-plans/{slug}/system-definition-pack.mdPhase 1
Stakeholder impact map.copilot-tracking/rai-plans/{slug}/stakeholder-impact-map.mdPhase 1
Risk classification screening summary.copilot-tracking/rai-plans/{slug}/system-definition-pack.md (appended)Phase 2
RAI standards mapping.copilot-tracking/rai-plans/{slug}/rai-standards-mapping.mdPhase 3
RAI security model addendum.copilot-tracking/rai-plans/{slug}/rai-security-model-addendum.mdPhase 4
Control surface catalog.copilot-tracking/rai-plans/{slug}/control-surface-catalog.mdPhase 5
Evidence register.copilot-tracking/rai-plans/{slug}/evidence-register.mdPhase 5
RAI tradeoffs.copilot-tracking/rai-plans/{slug}/rai-tradeoffs.mdPhase 5
RAI review summary.copilot-tracking/rai-plans/{slug}/rai-review-summary.mdPhase 6
Handoff summary.copilot-tracking/rai-plans/{slug}/rai-backlog-handoff-summary.mdPhase 6

Artifact Attribution and Review

Persisted RAI artifacts include transparency footers that communicate AI involvement and establish expectations for human review. Footer composition varies based on whether an artifact is consumed by subsequent agent phases or delivered to human reviewers for validation and decision-making.

AI-Content Note

Every Phase 5 and Phase 6 artifact includes a transparency note at the end of the file:

Note - The author created this content with assistance from AI. All outputs should be reviewed and validated by a qualified human reviewer before use.

Human Review Checkbox

Artifacts delivered to human reviewers include a review validation checkbox beneath the AI-content note:

  • Reviewed and validated by a qualified human reviewer

Reviewers check this box upon completing their assessment to signal that the content has been validated.

Full Disclaimer

The Handoff Summary and Compact Handoff Summary append the full RAI Planner disclaimer after the review checkbox. This disclaimer establishes that the agent is an assistive tool only and that all outputs require independent review by appropriate legal and compliance reviewers before use.

The following table shows which footer components appear on each Phase 5 and Phase 6 artifact. Agentic artifacts are consumed by subsequent agent phases, while human-facing artifacts are delivered to reviewers.

ArtifactPhaseCategoryAI-content noteReview checkboxFull disclaimer
Control surface catalog5Agentic
Evidence register5Agentic
RAI tradeoffs5Human-facing
RAI review summary6Human-facing
ADO work items6Human-facing
GitHub issues6Human-facing
Transparency note outline6Human-facing
Monitoring summary6Human-facing
Handoff summary6Human-facing
Compact handoff summary6Human-facing

NOTE

Transparency note outline and monitoring summary are optional artifacts generated only when the user opts in during Phase 6.

End-to-end assessment flow
  1. Security Planner completes Phase 6 with raiEnabled: true and AI component data in state
  2. User starts RAI Planner with from-security-plan prompt, providing the security plan project slug
  3. RAI Planner reads security plan state and pre-populates Phase 1 with AI components and threat count
  4. Phases 1-5 proceed with focused assessment of AI-specific risks, building on the security plan's foundation
  5. Phase 6 produces the review summary with observations across six dimensions
  6. Backlog items are generated for identified gaps using the user's preferred platform format
  7. Assessment artifacts persist under .copilot-tracking/rai-plans/{project-slug}/ for future reference and updates

🤖 Crafted with precision by ✨Copilot following brilliant human instruction, then carefully refined by our team of discerning human reviewers.