Skip to main content

Handoff Pipeline

Security Planner to RAI Planner Pipeline

The Security Planner and RAI Planner form a connected assessment pipeline. When the Security Planner detects AI or ML components during Phase 1, it captures component details and enables RAI dispatch. At Phase 6, the Security Planner recommends starting the RAI Planner in from-security-plan mode.

What the RAI Planner Receives

When entering via from-security-plan mode, the RAI Planner reads the security plan's state.json and inherits:

DataSource fieldHow it is used
AI component inventoryaiComponents arrayPre-populates Phase 1 AI element catalog
RAI assessment scoperaiScopeSets initial assessment boundaries
RAI depth tierraiTierDetermines assessment depth (standard or deep)
Threat countthreat catalog sizeStarting sequence for RAI-T-{CATEGORY}-{NNN} IDs
Security plan referencestate.json pathStored in securityPlanRef for cross-referencing

NOTE

The RAI Planner reads security plan artifacts as read-only. It never modifies files under .copilot-tracking/security-plans/.

Scorecard Generation

Phase 6 produces a scorecard that quantifies assessment quality across five dimensions. Each dimension receives a score from 1 to 5, producing a maximum total of 25.

Outcome Definitions

OutcomeScore rangeMeaning
Approved20-25Assessment is comprehensive; proceed with identified mitigations
Conditional15-19Gaps exist; proceed with conditions and a remediation timeline
Remediation RequiredBelow 15Significant gaps; address findings before proceeding

Backlog Generation

Gaps identified during Phases 2 through 5 are converted to work items using the same dual-platform format as the Security Planner.

Dual-Platform Support

PlatformID formatFormattingTarget system
ADOWI-RAI-{NNN}HTML <div> wrapperAzure DevOps work items
GitHub{{RAI-TEMP-N}}Markdown with YAML frontmatterGitHub issues

Autonomy Tiers

Each generated work item receives an autonomy tier based on the severity and complexity of the finding.

TierHuman involvementWhen assigned
FullAgent creates and submits without confirmationLow-severity findings with clear remediation
PartialAgent creates items; user confirms before submissionDefault tier for most findings
ManualAgent recommends; user creates itemsHigh-severity findings, restricted use escalations, or cross-team coordination required

Content Sanitization

All generated backlog content is sanitized before handoff:

  • No secrets, credentials, or API keys
  • No internal URLs or infrastructure details
  • No PII or personally identifiable information
  • No proprietary model weights or training data references

Pipeline Artifacts

ArtifactPathGenerated during
System definition pack.copilot-tracking/rai-plans/{slug}/system-definition-pack.mdPhase 1
Stakeholder impact map.copilot-tracking/rai-plans/{slug}/stakeholder-impact-map.mdPhase 1
Sensitive uses screening.copilot-tracking/rai-plans/{slug}/sensitive-uses-screening.mdPhase 2
Use-misuse inventory.copilot-tracking/rai-plans/{slug}/use-misuse-inventory.mdPhase 2
RAI standards mapping.copilot-tracking/rai-plans/{slug}/rai-standards-mapping.mdPhase 3
RAI security model addendum.copilot-tracking/rai-plans/{slug}/rai-security-model-addendum.mdPhase 4
Control surface catalog.copilot-tracking/rai-plans/{slug}/control-surface-catalog.mdPhase 5
Evidence register.copilot-tracking/rai-plans/{slug}/evidence-register.mdPhase 5
RAI tradeoffs.copilot-tracking/rai-plans/{slug}/rai-tradeoffs.mdPhase 5
RAI scorecard.copilot-tracking/rai-plans/{slug}/rai-scorecard.mdPhase 6
End-to-end assessment flow
  1. Security Planner completes Phase 6 with raiEnabled: true and AI component data in state
  2. User starts RAI Planner with from-security-plan prompt, providing the security plan project slug
  3. RAI Planner reads security plan state and pre-populates Phase 1 with AI components and threat count
  4. Phases 1-5 proceed with focused assessment of AI-specific risks, building on the security plan's foundation
  5. Phase 6 produces the RAI scorecard with scored dimensions and outcome determination
  6. Backlog items are generated for identified gaps using the user's preferred platform format
  7. Assessment artifacts persist under .copilot-tracking/rai-plans/{project-slug}/ for future reference and updates

🤖 Crafted with precision by ✨Copilot following brilliant human instruction, then carefully refined by our team of discerning human reviewers.