bootstrap-realtime-eval Skill
Bootstrap a new realtime eval folder inside this cookbook repo by choosing the right harness from examples/evals/realtimeevals, scaffolding prompt/tools/data files, generating a useful README, and validating it with smoke, full eval, and test runs. Use when a user wants to start a new crawl, walk, or run realtime eval Published by openai in openai-cookbook.
What is bootstrap-realtime-eval Skill?
Bootstrap a new realtime eval folder inside this cookbook repo by choosing the right harness from examples/evals/realtimeevals, scaffolding prompt/tools/data files, generating a useful README, and validating it with smoke, full eval, and test runs. Use when a user wants to start a new crawl, walk, or run realtime eval Published by openai in openai-cookbook. This profile combines repository metadata with install, compatibility, and usage signals so developers can quickly decide whether it fits their agent workflow before opening the source repository.
Automated repository signals based on public metadata such as recency, license, installation evidence, and adoption. These are not a security audit or endorsement.
Key capabilities
- Includes SKILL.md support
- Reusable instructions support
- Testing
- Data analysis
- Testing use cases
- Data analysis use cases
Technical details
- Install or run with Copy skill directory
When to use bootstrap-realtime-eval Skill
- Use it for testing.
- Use it for data analysis.
Built with
Editorial notes
Source
- Creator: openai
- Repository: openai/openai-cookbook
- Skill file: examples/evals/realtime_evals/skills/bootstrap-realtime-eval/SKILL.md
What it does
Bootstrap a new realtime eval folder inside this cookbook repo by choosing the right harness from examples/evals/realtimeevals, scaffolding prompt/tools/data files, generating a useful README, and validating it with smoke, full eval, and test runs. Use when a user wants to start a new crawl, walk, or run realtime eval
Skill instructions
Bootstrap Realtime Eval Use this skill when the user wants a new realtime eval scaffold under examples/evals/realtimeevals/. This skill is repo-specific. Do not copy harness code into the generated folder. The generated eval should point at the shared harnesses already in: - examples/evals/realtimeevals/crawlharness - examples/evals/realtimeevals/walkharness - examples/evals/realtimeevals/runharness Inputs To Collect Always ask the user for the minimum set needed to choose and scaffold the eval before you create files, run the scaffold script, or author starter data. Do not skip this just because you can infer a default. Ask for: - Eval name - Goal or scenario - Harness choice, or enough context to recommend one - System prompt path or inline text - Tools JSON path or tool descriptions - Data path or source materials - Desired graders If the user does not know which harness they want, explain the options briefly and recommend one. See references/harness-selection.md. When the user asks
Explore related resources
Frequently asked questions
What is bootstrap-realtime-eval?
bootstrap-realtime-eval is a open-source AI agent skill with Copy skill directory. Bootstrap a new realtime eval folder inside this cookbook repo by choosing the right harness from examples/evals/realtimeevals, scaffolding prompt/tools/data files, generating a useful README.
Who is bootstrap-realtime-eval best for?
bootstrap-realtime-eval is best for reusing agent instructions, scripts, and references, testing workflows, data analysis workflows.
How do I install bootstrap-realtime-eval?
Install or run bootstrap-realtime-eval using Copy skill directory. Check bootstrap-realtime-eval for the latest setup command.
Is bootstrap-realtime-eval actively maintained?
bootstrap-realtime-eval may need a closer maintenance check before production use.
Auto-fetched from GitHub.
