metric-pack-designer Skill
Design custom metric packs for plugin-eval so teams can add local evaluation rubrics that emit schema-compatible checks and metrics. Use when the user wants their own evaluation criteria or visualizations. Published by openai in plugins.
What is metric-pack-designer Skill?
Design custom metric packs for plugin-eval so teams can add local evaluation rubrics that emit schema-compatible checks and metrics. Use when the user wants their own evaluation criteria or visualizations. Published by openai in plugins. This profile combines repository metadata with install, compatibility, and usage signals so developers can quickly decide whether it fits their agent workflow before opening the source repository.
Automated repository signals based on public metadata such as recency, license, installation evidence, and adoption. These are not a security audit or endorsement.
Key capabilities
- Includes SKILL.md support
- Reusable instructions support
- Design and media
- Design and media use cases
Technical details
- Install or run with Copy skill directory
When to use metric-pack-designer Skill
- Use it for design and media.
Built with
Editorial notes
Source
- Creator: openai
- Repository: openai/plugins
- Skill file: plugins/plugin-eval/skills/metric-pack-designer/SKILL.md
What it does
Design custom metric packs for plugin-eval so teams can add local evaluation rubrics that emit schema-compatible checks and metrics. Use when the user wants their own evaluation criteria or visualizations.
Skill instructions
Metric Pack Designer Use this skill when the user wants to extend plugin-eval with a local rubric. Workflow 1. Clarify the custom rubric categories and target kinds. 2. Define the smallest useful checks[] and metrics[] payload. 3. Create a metric-pack manifest plus a script that prints JSON to stdout. 4. Run the pack through plugin-eval analyze <path --metric-pack <manifest.json. Design Rules - Keep IDs stable across runs so comparisons stay meaningful. - Emit only checks[], metrics[], and optional artifacts[]. - Do not try to overwrite the core score or summary. - Prefer deterministic local signals over subjective text generation. Reference - ../../references/metric-pack-manifest.md
Explore related resources
Frequently asked questions
What is metric-pack-designer?
metric-pack-designer is a open-source AI agent skill with Copy skill directory. Design custom metric packs for plugin-eval so teams can add local evaluation rubrics that emit schema-compatible checks and metrics.
Who is metric-pack-designer best for?
metric-pack-designer is best for reusing agent instructions, scripts, and references, design and media workflows.
How do I install metric-pack-designer?
Install or run metric-pack-designer using Copy skill directory. Check metric-pack-designer for the latest setup command.
Is metric-pack-designer actively maintained?
metric-pack-designer may need a closer maintenance check before production use.
Auto-fetched from GitHub.
