In this article
Build System and Validation
Plugin Generation Pipeline
The plugin generation pipeline transforms marketplace package recipes into distributable
plugin output. The plugin:generate script runs two stages:
-
Generate-Plugins.ps1reads.github/plugin/marketplace.jsonand produces output under an explicit absolute staging root outside the repository. Each package gets its own subdirectory within that temporary root. -
plugin:postprocessapplies markdownlint auto-fixes (markdownlint-cli2 --fix) and aligns Markdown table columns (markdown-table-formatter) for generated package READMEs anddocs/plugins/*.md. Materialized component files remain byte-identical to their canonical sources and are validated there rather than as generated duplicates.
Run the full pipeline with a single command:
HVE_PLUGIN_STAGING_ROOT=/absolute/path/outside/hve-core npm run plugin:generate
IMPORTANT
Package staging requires HVE_PLUGIN_STAGING_ROOT or the generator's
-StagingRoot parameter to name an absolute path outside the repository.
Ordinary validation must not create a repository-root plugins/ directory.
Schema Validation System
YAML frontmatter in markdown files is validated against JSON schemas stored in
scripts/linting/schemas/. The validation system uses glob-based pattern matching to
determine which schema applies to each file.
Schema Files
| Schema | Applies To |
|---|---|
docs-frontmatter.schema.json | docs/**/*.md |
instruction-frontmatter.schema.json | .github/**/*.instructions.md |
agent-frontmatter.schema.json | .github/**/*.agent.md |
prompt-frontmatter.schema.json | .github/**/*.prompt.md |
skill-frontmatter.schema.json | .github/skills/**/SKILL.md |
chatmode-frontmatter.schema.json | .github/**/*.chatmode.md |
marketplace-manifest.schema.json | .github/plugin/marketplace.json |
root-community-frontmatter.schema.json | Root files (README, CONTRIBUTING) |
base-frontmatter.schema.json | Default fallback |
Pattern Mapping
The scripts/linting/schemas/schema-mapping.json file defines the glob-to-schema mapping.
Patterns are evaluated from most specific to least specific, and the first match determines
the schema. When no pattern matches, base-frontmatter.schema.json applies as the default.
Planner State Schemas
The same scripts/linting/schemas/ directory also holds JSON Schemas for planner session
state. These validate the state.json files that phase-based planning agents persist under
.copilot-tracking/. They are not frontmatter schemas, so they are not listed in
schema-mapping.json and are not exercised by npm run lint:frontmatter.
| Schema | Validates |
|---|---|
accessibility-state.schema.json | .copilot-tracking/accessibility/{project-slug}/state.json |
rai-state.schema.json | .copilot-tracking/rai-plans/{project-slug}/state.json |
security-state.schema.json | .copilot-tracking/security-plans/{project-slug}/state.json |
sssc-state.schema.json | .copilot-tracking/sssc-plans/{project-slug}/state.json |
Each schema is the source of truth for its planner's required keys, field types, enum values, and defaults. Agent and instruction files show illustrative state snippets with JSON-literal defaults; when a snippet and its schema disagree, the schema wins.
Two enforcement paths cover these schemas:
- Editor validation through the
json.schemasentries in.vscode/settings.json, which bind the RAI and accessibility state paths to their schemas as you edit. - Pester coverage in
scripts/tests/linting/Test-PlannerStateSchemas.Tests.ps1andscripts/tests/linting/Test-AccessibilityStateSchema.Tests.ps1, which validate schema fixtures and guard the inline state examples in agent and instruction files against drift. Run them withnpm run test:ps -- -TestPath "scripts/tests/linting/".
Adding Custom Schemas
To add validation for a new file type:
- Create a JSON schema file in
scripts/linting/schemas/ - Add a mapping entry to
schema-mapping.jsonwith the glob pattern, scope name, and schema filename - Run
npm run lint:frontmatterto verify the new schema validates correctly
npm Scripts Reference
All validation, formatting, and testing operations run through npm scripts defined in
package.json. The table below groups scripts by purpose. These tables are representative
of the most commonly used scripts rather than an exhaustive list; consult package.json
for the complete set.
Linting
| Script | Command | Description |
|---|---|---|
validate:local | npm run validate:local | Runs the local-safe validation aggregate |
lint:md | npm run lint:md | Markdown linting via markdownlint-cli2 |
lint:md:fix | npm run lint:md:fix | Markdown linting with auto-fix |
lint:ps | npm run lint:ps | PowerShell analysis via PSScriptAnalyzer |
lint:yaml | npm run lint:yaml | YAML syntax and structure validation |
lint:links | npm run lint:links | Link language checking |
lint:md-links | npm run lint:md-links | Markdown link target validation |
lint:frontmatter | npm run lint:frontmatter | Frontmatter schema validation |
lint:json | npm run lint:json | JSON syntax validation |
lint:adr-consistency | npm run lint:adr-consistency | ADR structure and consistency checks |
lint:marketplace | npm run lint:marketplace | Marketplace manifest validation |
lint:hooks | npm run lint:hooks | Hook manifest validation |
lint:version-consistency | npm run lint:version-consistency | GitHub Action version consistency |
lint:permissions | npm run lint:permissions | Workflow permissions validation |
lint:models | npm run lint:models | Model reference validation against catalog |
Validation
| Script | Command | Description |
|---|---|---|
validate:copyright | npm run validate:copyright | Copyright header presence check |
validate:skills | npm run validate:skills | Skill directory structure validation |
Formatting
| Script | Command | Description |
|---|---|---|
format:tables | npm run format:tables | Markdown table column alignment |
Testing
| Script | Command | Description |
|---|---|---|
test:ps | npm run test:ps | PowerShell Pester test suite |
Plugin and Extension
| Script | Command | Description |
|---|---|---|
plugin:generate | npm run plugin:generate | Generate plugins in explicit external staging |
plugin:validate | npm run plugin:validate | Validate marketplace package metadata and closure |
extension:prepare | npm run extension:prepare | Prepare VS Code extension for packaging |
extension:prepare:prerelease | npm run extension:prepare:prerelease | Prepare extension for pre-release |
extension:package | npm run extension:package | Package VS Code extension |
extension:package:prerelease | npm run extension:package:prerelease | Package extension as pre-release |
For local-safe defaults, CI-owned lanes, and package-root-specific setup, see Validation Commands and CI-Owned Lanes.
Local Validation Pipeline
The validate:local script chains local-safe checks in a fixed sequence:
lint:tableschecks markdown table columns without modifying themlint:mdchecks markdown style rules (.markdownlint.json)lint:psanalyzes PowerShell scripts (PSScriptAnalyzer.psd1)lint:yamlvalidates YAML file syntaxlint:jsonvalidates JSON syntaxlint:linkschecks link text language patternslint:md-linksresolves markdown link targetslint:frontmattervalidates YAML frontmatter against schemaslint:adr-consistencychecks ADR structure and consistency ruleslint:marketplacevalidates marketplace package metadata and closurelint:hooksvalidates hook manifestslint:version-consistencychecks GitHub Action version alignmentlint:permissionsvalidates workflow permissionslint:dangerous-workflowchecks workflows for dangerous patternslint:dependency-pinningchecks dependencies are pinned to fixed versionslint:public-dependency-feedsconfirms dependency sources use canonical public feedslint:pr-gatevalidates the pull request validation gatelint:ps-module-pinschecks PowerShell module versions are pinnedlint:pylints Python scripts viaInvoke-PythonLint.ps1validate:skillsverifies skill directory structurelint:ai-artifactsvalidates planner AI artifactslint:asset-docsconfirms assets have documentation pageslint:modelsvalidates model references against the catalogvalidate:devcontainer-lockfilechecks devcontainer lockfile integrity
Each linter outputs results to logs/ for inspection. Run individual linters for faster
feedback during development:
npm run lint:md -- docs/customization/packages.md
CI Validation
Pull request validation runs linters in parallel CI jobs. Each job executes one or more npm scripts from the list above. To reproduce CI checks locally, run the same npm scripts against your changed files.
Full local-safe validation:
npm run validate:local
Targeted validation for specific files:
npm run lint:md -- path/to/changed-file.md
npm run lint:frontmatter
TIP
Run validate:local before pushing for the repository default. Individual
checks provide faster feedback when you know which validation applies to your
changes. Reproduce browser, model, moderation, or credential-dependent CI
lanes separately when they are relevant.
Customizing Validation
Markdown Rules
Configure markdownlint rules in .markdownlint.json at the repository root. Each rule
maps to a markdownlint rule ID (e.g., MD013 for line length). Disable rules by setting
them to false, or customize parameters such as line length limits.
PowerShell Analysis
PSScriptAnalyzer rules are configured in scripts/linting/PSScriptAnalyzer.psd1. Add or
exclude rules to match your team's PowerShell coding standards. Run analysis with:
npm run lint:ps
Results appear in logs/psscriptanalyzer-results.json and
logs/psscriptanalyzer-summary.json.
Custom Validation Scripts
Add new validation scripts to scripts/linting/ and register them as npm scripts in
package.json. Follow the existing pattern: scripts accept file paths or glob patterns
as input and write structured results to logs/.
To include a new local-safe linter in the default pipeline, add it to the validate:local chain in
package.json.
Role Scenarios
Northwind Traders' SRE/Operations lead runs npm run validate:local as a pre-push hook to
catch markdown formatting issues, broken links, and frontmatter schema violations before
they reach CI. When a new deployment instruction file needs custom frontmatter fields, the
lead adds a schema to scripts/linting/schemas/ and registers the pattern in
schema-mapping.json.
Adventure Works' security architect extends the validation pipeline with a custom script
that checks instruction files for required security disclaimer sections. The script follows
the existing pattern of writing JSON results to logs/ and integrates into the validate:local
chain through package.json.
🤖 Crafted with precision by ✨Copilot following brilliant human instruction, then carefully refined by our team of discerning human reviewers.