Favicon of plugin-eval

plugin-eval Skill

AI Agent SkillJavaScriptOpen source

Help engineers evaluate a local skill or plugin, explain why it scored that way, show what to fix first, measure real token usage, benchmark starter scenarios, or decide what to run next. Use when the user says things like "evaluate this skill", "give me an analysis of the game dev skill", "why did this score that way" Published by openai in plugins.

Decision snapshot

Is this a fit?

Best for

Documentation, Data analysis, Includes SKILL.md, Reusable instructions

Works with

Compatibility not yet detected.

Access

Permission behavior not yet detected.

Setup

Copy skill directory

Project health

20 days ago

Considerations

No specific cautions were detected. Review the source and requested permissions before installing.

What is plugin-eval Skill?

Help engineers evaluate a local skill or plugin, explain why it scored that way, show what to fix first, measure real token usage, benchmark starter scenarios, or decide what to run next. Use when the user says things like "evaluate this skill", "give me an analysis of the game dev skill", "why did this score that way" Published by openai in plugins. This profile combines repository metadata with install, compatibility, and usage signals so developers can quickly decide whether it fits their agent workflow before opening the source repository.

Trust signal
95/100
Maintenance signal
90/100
Adoption signal
92/100

Automated repository signals based on public metadata such as recency, license, installation evidence, and adoption. These are not a security audit or endorsement. See how SkillIndex evaluates profiles.

Key capabilities

  • Includes SKILL.md support
  • Reusable instructions support
  • Documentation
  • Data analysis
  • Documentation use cases
  • Data analysis use cases

Declared skill metadata

  • Source file: plugins/plugin-eval/skills/plugin-eval/SKILL.md

These fields retain source and confidence evidence from the indexed SKILL.md.

Compatibility and setup

Copy skill directory
  • Install or run with Copy skill directory

When to use plugin-eval Skill

  • Use it for documentation.
  • Use it for data analysis.

Built with

JavaScriptCopy skill directory

Editorial notes

Source

  • Creator: openai
  • Repository: openai/plugins
  • Skill file: plugins/plugin-eval/skills/plugin-eval/SKILL.md

What it does

Help engineers evaluate a local skill or plugin, explain why it scored that way, show what to fix first, measure real token usage, benchmark starter scenarios, or decide what to run next. Use when the user says things like "evaluate this skill", "give me an analysis of the game dev skill", "why did this score that way"

Skill instructions

Plugin Eval Use this as the beginner-friendly umbrella entrypoint for local Codex skill and plugin evaluation. Start Here 1. Resolve whether the target path is a skill, a plugin, or another local folder. 2. Prefer the chat-first router when the user speaks naturally or is not sure which command they need: bash plugin-eval start <path --request "<user request" --format markdown 3. Route natural chat requests to the matching workflow: - "Give me an analysis of the game dev skill." - resolve the named skill path, run plugin-eval analyze <path --format markdown, then initialize a benchmark and show the setup questions needed to tailor benchmark.json - "Evaluate this skill." - plugin-eval analyze <path --format markdown - "Why did this score that way?" - plugin-eval analyze <path --format markdown - "What should I fix first?" - plugin-eval analyze <path --format markdown - "Explain the token budget for this skill." - plugin-eval explain-budget <path --format markdown - "Measure the real tok

Verified compatibility and discovery

Frequently asked questions

What is plugin-eval?

plugin-eval is a open-source AI agent skill with Copy skill directory. Help engineers evaluate a local skill or plugin, explain why it scored that way, show what to fix first, measure real token usage, benchmark starter scenarios, or decide what to run next.

Who is plugin-eval best for?

plugin-eval is best for reusing agent instructions, scripts, and references, documentation workflows, data analysis workflows.

How do I install plugin-eval?

Install or run plugin-eval using Copy skill directory. Check plugin-eval for the latest setup command.

Is plugin-eval actively maintained?

plugin-eval may need a closer maintenance check before production use.

Share:

Stars
5,140
Forks
717
Last commit
20 days ago
Last verified
Aug 24, 2026
Metadata fetched
Aug 24, 2026
Repository age
6 months
License
Unknown

Project health auto-fetched from the source repository.

Maintain this resource?

Review this source-backed profile, send a correction with evidence, or link to it from your documentation. Claims verify your relationship to the project; profile facts still require source evidence and editorial review.

Alternatives to plugin-eval