← Back to skills
Test-First Code ChangesHigh ReliabilityModerate-Risk Workflow

Agent Regression Pack Generator

Generates structured evaluation cases for changed agent workflows and validates pack completeness for repeatable regression testing.

Version

0.1.0

Last Updated

Apr 22, 2026

Verification Type

unit tests, integration tests, manual review required

Downloads

0

Required inputs

  • change_summary (markdown)

    Summary of behavior changes in agent workflow/prompt/tooling.

  • baseline_cases (json)

    Existing regression/evaluation cases.

Expected outputs

  • regression_pack (json)

    Structured test case pack ready for execution.

  • evaluation_plan (markdown)

    Execution strategy and pass/fail rules.

Included checks and assets

  • scripts/validate_regression_pack.py (script)

    Validates regression pack case schema and required fields.

  • references/case-schema.md (reference)

    Regression case schema specification.

  • references/coverage-mapping-guide.md (reference)

    Guide for mapping risk areas to regression case coverage.

Failure modes

  • Case packs may miss semantic edge conditions.
  • Risk-area mapping can be incomplete.
  • Pass criteria may be vague without explicit assertions.

Ideal use cases

  • Prompt/workflow regression protection
  • Agent release validation
  • CI behavior consistency checks

Example runs

Tool-calling behavior update

Validated sample run

Generates and validates regression cases for updated tool routing logic.

Input preview

baseline_cases.json + change_summary.md

Output preview

Validated regression pack with uncovered risk notes

Changelog summary

  • 0.1.0 · Apr 22, 2026

    Initial release for agent regression pack generation.

Links

Inspect the source, read authored documentation, or download the published skill bundle.