huggingface-local-models Skill
Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm. Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup, conversion, and OpenAI-compatible local serving. Published by huggingface in skills.
Decision snapshot
Is this a fit?
Research, Includes SKILL.md, Reusable instructions
Compatibility not yet detected.
Permission behavior not yet detected.
Copy skill directory
28 days ago · Apache-2.0 license
No specific cautions were detected. Review the source and requested permissions before installing.
What is huggingface-local-models Skill?
Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm. Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup, conversion, and OpenAI-compatible local serving. Published by huggingface in skills. This profile combines repository metadata with install, compatibility, and usage signals so developers can quickly decide whether it fits their agent workflow before opening the source repository.
Automated repository signals based on public metadata such as recency, license, installation evidence, and adoption. These are not a security audit or endorsement. See how SkillIndex evaluates profiles.
Key capabilities
- Includes SKILL.md support
- Reusable instructions support
- Research
- Research use cases
Declared skill metadata
- Source file: skills/huggingface-local-models/SKILL.md
These fields retain source and confidence evidence from the indexed SKILL.md.
Compatibility and setup
- Install or run with Copy skill directory
When to use huggingface-local-models Skill
- Use it for research.
Built with
Editorial notes
Source
- Creator: huggingface
- Repository: huggingface/skills
- Skill file: skills/huggingface-local-models/SKILL.md
What it does
Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm. Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup, conversion, and OpenAI-compatible local serving.
Skill instructions
Hugging Face Local Models Search the Hugging Face Hub for llama.cpp-compatible GGUF repos, choose the right quant, and launch the model with llama-cli or llama-server. Default Workflow 1. Search the Hub with apps=llama.cpp. 2. Open https://huggingface.co/<repo?local-app=llama.cpp. 3. Prefer the exact HF local-app snippet and quant recommendation when it is visible. 4. Confirm exact .gguf filenames with https://huggingface.co/api/models/<repo/tree/main?recursive=true. 5. Launch with llama-cli -hf <repo:<QUANT or llama-server -hf <repo:<QUANT. 6. Fall back to --hf-repo plus --hf-file when the repo uses custom file naming. 7. Convert from Transformers weights only if the repo does not already expose GGUF files. Quick Start Install llama.cpp bash brew install llama.cpp winget install llama.cpp bash git clone https://github.com/ggml-org/llama.cpp cd llama.cpp make Authenticate for gated repos bash hf auth login Search the Hub text https://huggingface.co/models?apps=llama.cpp&sort=trending h
Verified compatibility and discovery
Frequently asked questions
What is huggingface-local-models?
huggingface-local-models is a open-source AI agent skill with Copy skill directory. Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm.
Who is huggingface-local-models best for?
huggingface-local-models is best for reusing agent instructions, scripts, and references, research workflows.
How do I install huggingface-local-models?
Install or run huggingface-local-models using Copy skill directory. Check huggingface-local-models for the latest setup command.
Is huggingface-local-models actively maintained?
huggingface-local-models may need a closer maintenance check before production use.
Project health auto-fetched from the source repository.
Maintain this resource?
Review this source-backed profile, send a correction with evidence, or link to it from your documentation. Claims verify your relationship to the project; profile facts still require source evidence and editorial review.
