eval-generator Skill
Generate standalone — turns the populated Eval Suite Planning workbook (output of /eval-suite-planner) into concrete capability eval sets and trust & safety eval sets. Delivers playbook Steps 2 & 3 and designs the Step 8 regression partition. Outputs 2-column Copilot Studio -for-import.csv files (Question + Expected re Published by microsoft in eval-guide.
What is eval-generator Skill?
Generate standalone — turns the populated Eval Suite Planning workbook (output of /eval-suite-planner) into concrete capability eval sets and trust & safety eval sets. Delivers playbook Steps 2 & 3 and designs the Step 8 regression partition. Outputs 2-column Copilot Studio -for-import.csv files (Question + Expected re Published by microsoft in eval-guide. This profile combines repository metadata with install, compatibility, and usage signals so developers can quickly decide whether it fits their agent workflow before opening the source repository.
Automated repository signals based on public metadata such as recency, license, installation evidence, and adoption. These are not a security audit or endorsement.
Key capabilities
- Includes SKILL.md support
- Reusable instructions support
- Testing
- Design and media
- Testing use cases
- Design and media use cases
Technical details
- Install or run with Copy skill directory
When to use eval-generator Skill
- Use it for testing.
- Use it for design and media.
Built with
Editorial notes
Source
- Creator: microsoft
- Repository: microsoft/eval-guide
- Skill file: skills/eval-generator/SKILL.md
What it does
Generate standalone — turns the populated Eval Suite Planning workbook (output of /eval-suite-planner) into concrete capability eval sets and trust & safety eval sets. Delivers playbook Steps 2 & 3 and designs the Step 8 regression partition. Outputs 2-column Copilot Studio -for-import.csv files (Question + Expected re
Skill instructions
Purpose This skill produces the Generate artifact of the /eval-guide lifecycle: importable test cases for Copilot Studio's Evaluation tab plus a .docx test-case report carrying the full manifest for human review and downstream Run/Interpret stages. It is the standalone form of /eval-guide Generate. In the canonical Practical Guidance on Agent Evaluation: 10-step playbook, this skill delivers Step 2 — Build the Capability Eval Sets and Step 3 — Build the Trust & Safety Eval Sets, and it designs the Step 8 — Regression Suite partition for those sets. Keep the operational stage name Generate as UX scaffolding; use the playbook terms for methodology. Primary mode — the conversation or attachments contain the populated /eval-suite-planner workbook (eval-suite-<agent-name-<date.xlsx). Use 2 . Eval Suite Registry as the source of truth for eval sets, and 1 . Planning for risk tier, owners, gates, lifecycle stage, and source dependencies. Generate one set of cases per capability row and one se
Explore related resources
Frequently asked questions
What is eval-generator?
eval-generator is a open-source AI agent skill with Copy skill directory. Generate standalone — turns the populated Eval Suite Planning workbook (output of /eval-suite-planner) into concrete capability eval sets and trust & safety eval sets.
Who is eval-generator best for?
eval-generator is best for reusing agent instructions, scripts, and references, testing workflows, design and media workflows.
How do I install eval-generator?
Install or run eval-generator using Copy skill directory. Check eval-generator for the latest setup command.
Is eval-generator actively maintained?
eval-generator may need a closer maintenance check before production use.
Auto-fetched from GitHub.
