Favicon of writing-evals

writing-evals Skill

AI Agent SkillWriting SkillsTypeScriptOpen source

Scaffolds evaluation suites for the Axiom AI SDK. Generates eval files, scorers, flag schemas, and config from natural-language descriptions. Use when creating evals, writing scorers, setting up flag schemas, or configuring axiom.config.ts. Published by openclaw in clawhub.

What is writing-evals Skill?

Scaffolds evaluation suites for the Axiom AI SDK. Generates eval files, scorers, flag schemas, and config from natural-language descriptions. Use when creating evals, writing scorers, setting up flag schemas, or configuring axiom.config.ts. Published by openclaw in clawhub. This profile combines repository metadata with install, compatibility, and usage signals so developers can quickly decide whether it fits their agent workflow before opening the source repository.

Trust signal
95/100
Maintenance signal
90/100
Adoption signal
99/100

Automated repository signals based on public metadata such as recency, license, installation evidence, and adoption. These are not a security audit or endorsement.

Key capabilities

  • Includes SKILL.md support
  • Reusable instructions support
  • Testing
  • Documentation
  • Data analysis
  • Writing
  • Testing use cases

Technical details

Copy skill directory
  • Install or run with Copy skill directory

When to use writing-evals Skill

  • Use it for testing.
  • Use it for documentation.
  • Use it for data analysis.
  • Use it for writing.

Built with

TypeScriptCopy skill directory

Editorial notes

Source

  • Creator: openclaw
  • Repository: openclaw/clawhub
  • Skill file: .agents/skills/writing-evals/SKILL.md

What it does

Scaffolds evaluation suites for the Axiom AI SDK. Generates eval files, scorers, flag schemas, and config from natural-language descriptions. Use when creating evals, writing scorers, setting up flag schemas, or configuring axiom.config.ts.

Skill instructions

Writing Evals You write evaluations that prove AI capabilities work. Evals are the test suite for non-deterministic systems: they measure whether a capability still behaves correctly after every change. Prerequisites - Complete the Axiom AI SDK Quickstart (instrumentation + authentication) Verify the SDK is installed: bash ls nodemodules/axiom/dist/ If not installed, install it using the project's package manager (e.g., pnpm add axiom). Always check nodemodules/axiom/dist/docs/ first for the correct API signatures, import paths, and patterns for the installed SDK version. The bundled docs are the source of truth — do not rely on the examples in this skill if they conflict. Philosophy 1. Evals are tests for AI. Every eval answers: "does this capability still work?" 2. Scorers are assertions. Each scorer checks one property of the output. 3. Flags are variables. Flag schemas let you sweep models, temperatures, strategies without code changes. 4. Data drives coverage. Happy path, adversar

Explore related resources

Frequently asked questions

What is writing-evals?

writing-evals is a open-source AI agent skill with Copy skill directory. Scaffolds evaluation suites for the Axiom AI SDK. Generates eval files, scorers, flag schemas, and config from natural-language descriptions.

Who is writing-evals best for?

writing-evals is best for reusing agent instructions, scripts, and references, testing workflows, documentation workflows, data analysis workflows.

How do I install writing-evals?

Install or run writing-evals using Copy skill directory. Check writing-evals for the latest setup command.

Is writing-evals actively maintained?

writing-evals may need a closer maintenance check before production use.

Share:

Stars
9,149
Forks
1,425
Last commit
9 days ago
Repository age
7 months
License
MIT

Auto-fetched from GitHub.

Similar to writing-evals