m365-agent-evaluator Skill
Use this skill when a user wants to create, run, or analyze evaluation suites for Microsoft 365 Copilot declarative agents with the public @microsoft/m365-copilot-eval CLI. Trigger on intents such as "evaluate my agent", "test my agent", "run my evals", "create eval prompts", "add multi-turn tests", "tune evaluator thr Published by microsoft in skills.
Decision snapshot
Is this a fit?
Testing, Data analysis, Includes SKILL.md, Reusable instructions
Compatibility not yet detected.
Permission behavior not yet detected.
Copy skill directory
2 months ago · MIT license
No specific cautions were detected. Review the source and requested permissions before installing.
What is m365-agent-evaluator Skill?
Use this skill when a user wants to create, run, or analyze evaluation suites for Microsoft 365 Copilot declarative agents with the public @microsoft/m365-copilot-eval CLI. Trigger on intents such as "evaluate my agent", "test my agent", "run my evals", "create eval prompts", "add multi-turn tests", "tune evaluator thr Published by microsoft in skills. This profile combines repository metadata with install, compatibility, and usage signals so developers can quickly decide whether it fits their agent workflow before opening the source repository.
Automated repository signals based on public metadata such as recency, license, installation evidence, and adoption. These are not a security audit or endorsement. See how SkillIndex evaluates profiles.
Key capabilities
- Includes SKILL.md support
- Reusable instructions support
- Testing
- Data analysis
- Testing use cases
- Data analysis use cases
Declared skill metadata
- Source file: .github/plugins/microsoft-365-agents-toolkit/skills/m365-agent-evaluator/SKILL.md
These fields retain source and confidence evidence from the indexed SKILL.md.
Compatibility and setup
- Install or run with Copy skill directory
When to use m365-agent-evaluator Skill
- Use it for testing.
- Use it for data analysis.
Built with
Editorial notes
Source
- Creator: microsoft
- Repository: microsoft/skills
- Skill file: .github/plugins/microsoft-365-agents-toolkit/skills/m365-agent-evaluator/SKILL.md
What it does
Use this skill when a user wants to create, run, or analyze evaluation suites for Microsoft 365 Copilot declarative agents with the public @microsoft/m365-copilot-eval CLI. Trigger on intents such as "evaluate my agent", "test my agent", "run my evals", "create eval prompts", "add multi-turn tests", "tune evaluator thr
Skill instructions
M365 Agent Evaluator Use this skill to help users evaluate Microsoft 365 Copilot declarative agents with @microsoft/m365-copilot-eval. The skill designs schema-compatible eval datasets, runs the public preview CLI, analyzes results, and recommends targeted fixes. Default to Microsoft 365 Agents Toolkit (ATK) projects when detected, but do not hard-stop solely because the current directory is not ATK. The CLI can also evaluate deployed agents with an explicit M365AGENTID or --m365-agent-id. Always use this CLI invocation powershell npx -y --package @microsoft/m365-copilot-eval@latest runevals Do not recommend the old private aka.ms installer, global installs, bare runevals, bare npx runevals, --input, or --html. Activation workflow 1. Identify the user goal: setup, dataset authoring, running evals, analyzing results, or updating an existing eval suite. 2. Load only the reference needed for the current goal: - references/workflow.md for the end-to-end operator workflow and CLI commands.
Verified compatibility and discovery
Frequently asked questions
What is m365-agent-evaluator?
m365-agent-evaluator is a open-source AI agent skill with Copy skill directory. Use this skill when a user wants to create, run, or analyze evaluation suites for Microsoft 365 Copilot declarative agents with the public @microsoft/m365-copilot-eval CLI.
Who is m365-agent-evaluator best for?
m365-agent-evaluator is best for reusing agent instructions, scripts, and references, testing workflows, data analysis workflows.
How do I install m365-agent-evaluator?
Install or run m365-agent-evaluator using Copy skill directory. Check m365-agent-evaluator for the latest setup command.
Is m365-agent-evaluator actively maintained?
m365-agent-evaluator may need a closer maintenance check before production use.
Project health auto-fetched from the source repository.
Maintain this resource?
Review this source-backed profile, send a correction with evidence, or link to it from your documentation. Claims verify your relationship to the project; profile facts still require source evidence and editorial review.
