m365-agent-evaluator Skill
Use this skill when a user wants to create, run, or analyze evaluation suites for Microsoft 365 Copilot declarative agents with the public @microsoft/m365-copilot-eval CLI. Trigger on intents such as "evaluate my agent", "test my agent", "run my evals", "create eval prompts", "add multi-turn tests", "tune evaluator thr Published by microsoft in skills.
What is m365-agent-evaluator Skill?
Use this skill when a user wants to create, run, or analyze evaluation suites for Microsoft 365 Copilot declarative agents with the public @microsoft/m365-copilot-eval CLI. Trigger on intents such as "evaluate my agent", "test my agent", "run my evals", "create eval prompts", "add multi-turn tests", "tune evaluator thr Published by microsoft in skills. This profile combines repository metadata with install, compatibility, and usage signals so developers can quickly decide whether it fits their agent workflow before opening the source repository.
Automated repository signals based on public metadata such as recency, license, installation evidence, and adoption. These are not a security audit or endorsement.
Key capabilities
- Includes SKILL.md support
- Reusable instructions support
- Testing
- Data analysis
- Testing use cases
- Data analysis use cases
Technical details
- Install or run with Copy skill directory
When to use m365-agent-evaluator Skill
- Use it for testing.
- Use it for data analysis.
Built with
Editorial notes
Source
- Creator: microsoft
- Repository: microsoft/skills
- Skill file: .github/plugins/microsoft-365-agents-toolkit/skills/m365-agent-evaluator/SKILL.md
What it does
Use this skill when a user wants to create, run, or analyze evaluation suites for Microsoft 365 Copilot declarative agents with the public @microsoft/m365-copilot-eval CLI. Trigger on intents such as "evaluate my agent", "test my agent", "run my evals", "create eval prompts", "add multi-turn tests", "tune evaluator thr
Skill instructions
M365 Agent Evaluator Use this skill to help users evaluate Microsoft 365 Copilot declarative agents with @microsoft/m365-copilot-eval. The skill designs schema-compatible eval datasets, runs the public preview CLI, analyzes results, and recommends targeted fixes. Default to Microsoft 365 Agents Toolkit (ATK) projects when detected, but do not hard-stop solely because the current directory is not ATK. The CLI can also evaluate deployed agents with an explicit M365AGENTID or --m365-agent-id. Always use this CLI invocation powershell npx -y --package @microsoft/m365-copilot-eval@latest runevals Do not recommend the old private aka.ms installer, global installs, bare runevals, bare npx runevals, --input, or --html. Activation workflow 1. Identify the user goal: setup, dataset authoring, running evals, analyzing results, or updating an existing eval suite. 2. Load only the reference needed for the current goal: - references/workflow.md for the end-to-end operator workflow and CLI commands.
Explore related resources
Frequently asked questions
What is m365-agent-evaluator?
m365-agent-evaluator is a open-source AI agent skill with Copy skill directory. Use this skill when a user wants to create, run, or analyze evaluation suites for Microsoft 365 Copilot declarative agents with the public @microsoft/m365-copilot-eval CLI.
Who is m365-agent-evaluator best for?
m365-agent-evaluator is best for reusing agent instructions, scripts, and references, testing workflows, data analysis workflows.
How do I install m365-agent-evaluator?
Install or run m365-agent-evaluator using Copy skill directory. Check m365-agent-evaluator for the latest setup command.
Is m365-agent-evaluator actively maintained?
m365-agent-evaluator may need a closer maintenance check before production use.
Auto-fetched from GitHub.
