benchmark-qed-autoq Skill
Generate benchmark questions and assertions from input data using benchmark-qed. Use when: generating local, global, linked, or activity questions for RAG benchmarking, creating assertions for existing questions, computing assertion statistics, or running the autoq question generation pipeline. Also use when the user w Published by microsoft in benchmark-qed.
What is benchmark-qed-autoq Skill?
Generate benchmark questions and assertions from input data using benchmark-qed. Use when: generating local, global, linked, or activity questions for RAG benchmarking, creating assertions for existing questions, computing assertion statistics, or running the autoq question generation pipeline. Also use when the user w Published by microsoft in benchmark-qed. This profile combines repository metadata with install, compatibility, and usage signals so developers can quickly decide whether it fits their agent workflow before opening the source repository.
Automated repository signals based on public metadata such as recency, license, installation evidence, and adoption. These are not a security audit or endorsement.
Key capabilities
- Includes SKILL.md support
- Reusable instructions support
- Data analysis
- Data analysis use cases
Technical details
- Install or run with Copy skill directory
When to use benchmark-qed-autoq Skill
- Use it for data analysis.
Built with
Editorial notes
Source
- Creator: microsoft
- Repository: microsoft/benchmark-qed
- Skill file: .apm/skills/benchmark-qed-autoq/SKILL.md
What it does
Generate benchmark questions and assertions from input data using benchmark-qed. Use when: generating local, global, linked, or activity questions for RAG benchmarking, creating assertions for existing questions, computing assertion statistics, or running the autoq question generation pipeline. Also use when the user w
Skill instructions
Benchmark-QED Question Generation (autoq) Generate benchmark questions and assertions from input data for RAG evaluation. Prerequisites - A configured workspace with valid settings.yaml (use the /benchmark-qed-setup skill first) - A configured workspace with valid settings.yaml (use the benchmark-qed-setup skill to initialize and configure) - Input data (CSV or JSON) in the workspace input/ directory - Valid LLM API key in .env Run all commands with: bash uvx --from "git+https://github.com/microsoft/benchmark-qed" benchmark-qed <command Commands 1. Generate Questions (autoq) The main question generation pipeline. Generates benchmark questions from input data. bash uvx --from "git+https://github.com/microsoft/benchmark-qed" benchmark-qed autoq <settings.yaml <outputdir [OPTIONS] Options: | Option | Description | |--------|-------------| | --generation-types | Specific types to generate (repeatable). CLI default: all except datalinked, but this skill always includes datalinked | | --prin
Explore related resources
Frequently asked questions
What is benchmark-qed-autoq?
benchmark-qed-autoq is a open-source AI agent skill with Copy skill directory. Generate benchmark questions and assertions from input data using benchmark-qed.
Who is benchmark-qed-autoq best for?
benchmark-qed-autoq is best for reusing agent instructions, scripts, and references, data analysis workflows.
How do I install benchmark-qed-autoq?
Install or run benchmark-qed-autoq using Copy skill directory. Check benchmark-qed-autoq for the latest setup command.
Is benchmark-qed-autoq actively maintained?
benchmark-qed-autoq may need a closer maintenance check before production use.
Auto-fetched from GitHub.
