llama-cpp Skill
llama.cpp local GGUF inference + HF Hub model discovery. Published by NousResearch in hermes-agent.
What is llama-cpp Skill?
llama.cpp local GGUF inference + HF Hub model discovery. Published by NousResearch in hermes-agent. This profile combines repository metadata with install, compatibility, and usage signals so developers can quickly decide whether it fits their agent workflow before opening the source repository.
Automated repository signals based on public metadata such as recency, license, installation evidence, and adoption. These are not a security audit or endorsement.
Key capabilities
- Includes SKILL.md support
- Reusable instructions support
- Research
- Research use cases
Technical details
- Install or run with Copy skill directory
When to use llama-cpp Skill
- Use it for research.
Built with
Editorial notes
Source
- Creator: NousResearch
- Repository: NousResearch/hermes-agent
- Skill file: skills/mlops/inference/llama-cpp/SKILL.md
What it does
llama.cpp local GGUF inference + HF Hub model discovery.
Skill instructions
llama.cpp + GGUF Use this skill for local GGUF inference, quant selection, or Hugging Face repo discovery for llama.cpp. When to use - Run local models on CPU, Apple Silicon, CUDA, ROCm, or Intel GPUs - Find the right GGUF for a specific Hugging Face repo - Build a llama-server or llama-cli command from the Hub - Search the Hub for models that already support llama.cpp - Enumerate available .gguf files and sizes for a repo - Decide between Q4/Q5/Q6/IQ variants for the user's RAM or VRAM Model Discovery workflow Prefer URL workflows before asking for hf, Python, or custom scripts. 1. Search for candidate repos on the Hub: - Base: https://huggingface.co/models?apps=llama.cpp&sort=trending - Add search=<term for a model family - Add numparameters=min:0,max:24B or similar when the user has size constraints 2. Open the repo with the llama.cpp local-app view: - https://huggingface.co/<repo?local-app=llama.cpp 3. Treat the local-app snippet as the source of truth when it is visible: - copy th
Explore related resources
Frequently asked questions
What is llama-cpp?
llama-cpp is a open-source AI agent skill with Copy skill directory. llama.cpp local GGUF inference + HF Hub model discovery.
Who is llama-cpp best for?
llama-cpp is best for reusing agent instructions, scripts, and references, research workflows.
How do I install llama-cpp?
Install or run llama-cpp using Copy skill directory. Check llama-cpp for the latest setup command.
Is llama-cpp actively maintained?
llama-cpp may need a closer maintenance check before production use.
Auto-fetched from GitHub.
