AI & machine learning · Skill
Hugging Face Local Models
Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm. Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup, conversion, and OpenAI-compatible local serving.
Open in PhởWhat the skill covers
The sections of its instructions, in order.
- 01 Default Workflow
- 02 Quick Start
- Install llama.cpp
- Authenticate for gated repos
- Search the Hub
- Run directly from the Hub
- Run an exact GGUF file
- Convert only when no GGUF is available
- Smoke test a local server
- 03 Quant Choice
- 04 Load References
- 05 Resources
Reference files
3 files Phở can open while it uses the skill.
- references/hardware.md
- references/hub-discovery.md
- references/quantization.md
More in Hugging Face Hub and models
- HuggingFace Best Model Finder
Use when the user asks about finding the best, top, or recommended model for a task, wants to know what AI model to use, or wants to compare models by benchmark scores. Triggers…
- Hf mem
Hugging Face CLI to estimate the required memory to load Safetensors or GGUF model weights for inference from the Hugging Face Hub
- Transformers.js - Machine Learning for JavaScript
Use Transformers.js to run state-of-the-art machine learning models directly in JavaScript/TypeScript. Supports NLP (text classification, translation, summarization), computer…
- Hugging Face Dataset Viewer
Use this skill for Hugging Face Dataset Viewer API workflows that fetch subset/split metadata, paginate rows, search text, apply filters, download parquet URLs, and read size or…
- Hugging Face Paper Pages
Look up and read Hugging Face paper pages in markdown, and use the papers API for structured metadata such as authors, linked models/datasets/spaces, Github repo and project…
- Hf cli
Hugging Face Hub CLI (`hf`) for downloading, uploading, and managing models, datasets, spaces, buckets, repos, papers, jobs, and more on the Hugging Face Hub. Use when: handling…
- TRL
Post-train LLMs with TRL (Transformers Reinforcement Learning) — SFT, DPO, GRPO, KTO, and reward-model training. Use when writing or debugging training code with the TRL Python…
- Trackio - Experiment Tracking for ML Training
Track and visualize ML training experiments with Trackio. Use when logging metrics during training (Python API), firing alerts for training diagnostics, or retrieving/analyzing…
- SageMaker Deployment Planner
Plan and coordinate the deployment of a model to Amazon SageMaker AI. Use this skill whenever the user wants to deploy, host, serve, or expose a model on SageMaker or AWS —…
Similar ai & machine learning skills
Frequently asked questions
What does Hugging Face Local Models do?
Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm. Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup, conversion, and OpenAI-compatible local serving.
Is Hugging Face Local Models free to use?
Yes. Hugging Face Local Models is published by Hugging Face under the Apache 2.0 licence, and you can use it with a free Phở account.
How do I use Hugging Face Local Models in Phở?
Press Open in Phở, then Try to apply it to your next message, or add the Hugging Face Hub and models set so Phở loads it whenever a request matches.
Does Hugging Face Local Models need other tools?
No. It works in a normal Phở chat with what you type or upload.
Copied unchanged from huggingface/skills at commit 25910b3 and credited to Hugging Face, who is not affiliated with Phở. The full instructions and licence text ship with the skill inside Phở.