nemo-curator Skill
Curate LLM training data: dedupe, filter, PII redaction. Published by NousResearch in hermes-agent.
Decision snapshot
Is this a fit?
Data analysis, Design and media, Includes SKILL.md, Reusable instructions
Compatibility not yet detected.
Permission behavior not yet detected.
Copy skill directory
2 months ago · MIT license
No specific cautions were detected. Review the source and requested permissions before installing.
What is nemo-curator Skill?
Curate LLM training data: dedupe, filter, PII redaction. Published by NousResearch in hermes-agent. This profile combines repository metadata with install, compatibility, and usage signals so developers can quickly decide whether it fits their agent workflow before opening the source repository.
Automated repository signals based on public metadata such as recency, license, installation evidence, and adoption. These are not a security audit or endorsement. See how SkillIndex evaluates profiles.
Key capabilities
- Includes SKILL.md support
- Reusable instructions support
- Data analysis
- Design and media
- Data analysis use cases
- Design and media use cases
Declared skill metadata
- Declared author: Orchestra Research
- Declared license: MIT
- Source file: optional-skills/mlops/nemo-curator/SKILL.md
These fields retain source and confidence evidence from the indexed SKILL.md.
Compatibility and setup
- Install or run with Copy skill directory
When to use nemo-curator Skill
- Use it for data analysis.
- Use it for design and media.
Built with
Editorial notes
Source
- Creator: NousResearch
- Repository: NousResearch/hermes-agent
- Skill file: optional-skills/mlops/nemo-curator/SKILL.md
What it does
Curate LLM training data: dedupe, filter, PII redaction.
Skill instructions
NeMo Curator - GPU-Accelerated Data Curation NVIDIA's toolkit for preparing high-quality training data for LLMs. When to use NeMo Curator Use NeMo Curator when: - Preparing LLM training data from web scrapes (Common Crawl) - Need fast deduplication (16× faster than CPU) - Curating multi-modal datasets (text, images, video, audio) - Filtering low-quality or toxic content - Scaling data processing across GPU cluster Performance: - 16× faster fuzzy deduplication (8TB RedPajama v2) - 40% lower TCO vs CPU alternatives - Near-linear scaling across GPU nodes Use alternatives instead: - datatrove: CPU-based, open-source data processing - dolma: Allen AI's data toolkit - Ray Data: General ML data processing (no curation focus) Quick start Installation bash NeMo Curator 1.x installs with uv. Extras use hyphens (PyPI-normalized): text-cuda12 / text-cpu (and image/video/audio/math variants), or all. Text curation (CUDA 12) uv pip install "nemo-curator[text-cuda12]" All modalities uv pip install "n
Verified compatibility and discovery
Frequently asked questions
What is nemo-curator?
nemo-curator is a open-source AI agent skill with Copy skill directory. Curate LLM training data: dedupe, filter, PII redaction.
Who is nemo-curator best for?
nemo-curator is best for reusing agent instructions, scripts, and references, data analysis workflows, design and media workflows.
How do I install nemo-curator?
Install or run nemo-curator using Copy skill directory. Check nemo-curator for the latest setup command.
Is nemo-curator actively maintained?
nemo-curator may need a closer maintenance check before production use.
Project health auto-fetched from the source repository.
Maintain this resource?
Review this source-backed profile, send a correction with evidence, or link to it from your documentation. Claims verify your relationship to the project; profile facts still require source evidence and editorial review.
