Eval Audit And Sweep Skill
<!-- Copyright 2026 Anthropic PBC -- <!-- SPDX-License-Identifier: Apache-2.0 -- Published by anthropics in cwc-workshops.
What is Eval Audit And Sweep Skill?
<!-- Copyright 2026 Anthropic PBC -- <!-- SPDX-License-Identifier: Apache-2.0 -- Published by anthropics in cwc-workshops. This profile combines repository metadata with install, compatibility, and usage signals so developers can quickly decide whether it fits their agent workflow before opening the source repository.
Automated repository signals based on public metadata such as recency, license, installation evidence, and adoption. These are not a security audit or endorsement.
Key capabilities
- Includes SKILL.md support
- Reusable instructions support
- Testing
- Security review
- Testing use cases
- Security review use cases
Technical details
- Install or run with Copy skill directory
When to use Eval Audit And Sweep Skill
- Use it for testing.
- Use it for security review.
Built with
Editorial notes
Source
- Creator: anthropics
- Repository: anthropics/cwc-workshops
- Skill file: rightmodel/.claude/skills/eval-audit-and-sweep/SKILL.md
What it does
<!-- Copyright 2026 Anthropic PBC -- <!-- SPDX-License-Identifier: Apache-2.0 -- ## Skill instructions <!-- Copyright 2026 Anthropic PBC -- <!-- SPDX-License-Identifier: Apache-2.0 -- --- name: eval-audit-and-sweep description: This skill should be used when a user wants to (a) audit the quality and reliability of an existing LLM evaluation suite, or (b) determine which Claude model and inference parameters give the best quality-per-dollar and quality-per-second for their specific task by running a parameter sweep over that eval. Applicable to any eval framework (custom harnesses, tau-bench, inspect-ai, pytest-based, etc.) since the guidance is framework-agnostic. --- Eval Audit and Sweep This skill is an example exercise for the "Picking the Right Model" workshop during Code with Claude. It is a two-phase playbook for getting trustworthy cost-quality numbers out of an existing LLM eval. Phase 1 audits the eval for common reliability issues. Phase 2 wraps it in a model/parameter sweep and produces a recommendation. The phases are independent: a user may ask for only the audit, only theExplore related resources
Frequently asked questions
What is Eval Audit And Sweep?
Eval Audit And Sweep is a open-source AI agent skill with Copy skill directory. <!-- Copyright 2026 Anthropic PBC -- <!-- SPDX-License-Identifier: Apache-2.0 --
Who is Eval Audit And Sweep best for?
Eval Audit And Sweep is best for reusing agent instructions, scripts, and references, testing workflows, security review workflows.
How do I install Eval Audit And Sweep?
Install or run Eval Audit And Sweep using Copy skill directory. Check Eval Audit And Sweep for the latest setup command.
Is Eval Audit And Sweep actively maintained?
Eval Audit And Sweep may need a closer maintenance check before production use.
Auto-fetched from GitHub.
