Favicon of hf-mem

hf-mem Skill

AI Agent SkillPythonOpen source

Hugging Face CLI to estimate the required memory to load Safetensors or GGUF model weights for inference from the Hugging Face Hub Published by huggingface in skills.

What is hf-mem Skill?

Hugging Face CLI to estimate the required memory to load Safetensors or GGUF model weights for inference from the Hugging Face Hub Published by huggingface in skills. This profile combines repository metadata with install, compatibility, and usage signals so developers can quickly decide whether it fits their agent workflow before opening the source repository.

Trust signal
95/100
Maintenance signal
90/100
Adoption signal
100/100

Automated repository signals based on public metadata such as recency, license, installation evidence, and adoption. These are not a security audit or endorsement.

Key capabilities

  • Includes SKILL.md support
  • Reusable instructions support
  • Developers using skills

Technical details

Copy skill directory
  • Install or run with Copy skill directory

When to use hf-mem Skill

  • Use it for developers using skills.

Built with

PythonCopy skill directory

Editorial notes

Source

  • Creator: huggingface
  • Repository: huggingface/skills
  • Skill file: skills/hf-mem/SKILL.md

What it does

Hugging Face CLI to estimate the required memory to load Safetensors or GGUF model weights for inference from the Hugging Face Hub

Skill instructions

hfmem estimates the required memory for inference, including model weights and an optional KV cache, for Safetensors and GGUF for models on the Hugging Face Hub using HTTP Range requests i.e., without downloading or loading any weights locally. When to use? - User asks how much VRAM or memory a model needs to run - User wants to know if a model fits on their GPU or a given instance - User references a Hugging Face model ID or URL and asks about inference requirements What are the requirements? - uv installed (for uvx) - HFTOKEN env var or --hf-token flag (for gated or private models only) How to run? Run with --model-id pointing to the Hugging Face Hub repository which will check that it either contains Safetensors (via model.safetensors, model.safetensors.index.json if sharded, or modelindex.json for Diffusers) or GGUF model weights within. bash uvx hf-mem --model-id <model-id --json-output If the repository contains GGUF model weights in multiple precisions / quantizations, the estim

Explore related resources

Frequently asked questions

What is hf-mem?

hf-mem is a open-source AI agent skill with Copy skill directory. Hugging Face CLI to estimate the required memory to load Safetensors or GGUF model weights for inference from the Hugging Face Hub

Who is hf-mem best for?

hf-mem is best for reusing agent instructions, scripts, and references.

How do I install hf-mem?

Install or run hf-mem using Copy skill directory. Check hf-mem for the latest setup command.

Is hf-mem actively maintained?

hf-mem may need a closer maintenance check before production use.

Share:

Stars
10,812
Forks
717
Last commit
9 days ago
Repository age
8 months
License
Apache-2.0

Auto-fetched from GitHub.

Ad
Favicon

 

  
 

Similar to hf-mem