huggingface-local-models Skill
Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm. Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup, conversion, and OpenAI-compatible local serving. Published by huggingface in context-course.
What is huggingface-local-models Skill?
Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm. Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup, conversion, and OpenAI-compatible local serving. Published by huggingface in context-course. This profile combines repository metadata with install, compatibility, and usage signals so developers can quickly decide whether it fits their agent workflow before opening the source repository.
Automated repository signals based on public metadata such as recency, license, installation evidence, and adoption. These are not a security audit or endorsement.
Key capabilities
- Includes SKILL.md support
- Reusable instructions support
- Research
- Research use cases
Technical details
- Install or run with Copy skill directory
When to use huggingface-local-models Skill
- Use it for research.
Built with
Editorial notes
Source
- Creator: huggingface
- Repository: huggingface/context-course
- Skill file: projects/inference/.agents/skills/huggingface-local-models/SKILL.md
What it does
Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm. Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup, conversion, and OpenAI-compatible local serving.
Skill instructions
Hugging Face Local Models Search the Hugging Face Hub for llama.cpp-compatible GGUF repos, choose the right quant, and launch the model with llama-cli or llama-server. Default Workflow 1. Search the Hub with apps=llama.cpp. 2. Open https://huggingface.co/<repo?local-app=llama.cpp. 3. Prefer the exact HF local-app snippet and quant recommendation when it is visible. 4. Confirm exact .gguf filenames with https://huggingface.co/api/models/<repo/tree/main?recursive=true. 5. Launch with llama-cli -hf <repo:<QUANT or llama-server -hf <repo:<QUANT. 6. Fall back to --hf-repo plus --hf-file when the repo uses custom file naming. 7. Convert from Transformers weights only if the repo does not already expose GGUF files. Quick Start Install llama.cpp bash brew install llama.cpp winget install llama.cpp bash git clone https://github.com/ggml-org/llama.cpp cd llama.cpp make Authenticate for gated repos bash hf auth login Search the Hub text https://huggingface.co/models?apps=llama.cpp&sort=trending h
Explore related resources
Frequently asked questions
What is huggingface-local-models?
huggingface-local-models is a open-source AI agent skill with Copy skill directory. Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm.
Who is huggingface-local-models best for?
huggingface-local-models is best for reusing agent instructions, scripts, and references, research workflows.
How do I install huggingface-local-models?
Install or run huggingface-local-models using Copy skill directory. Check huggingface-local-models for the latest setup command.
Is huggingface-local-models actively maintained?
huggingface-local-models may need a closer maintenance check before production use.
Auto-fetched from GitHub.
