AI & machine learning · Skill
TRL
Post-train LLMs with TRL (Transformers Reinforcement Learning) — SFT, DPO, GRPO, KTO, and reward-model training. Use when writing or debugging training code with the TRL Python API or the trl CLI.
Open in PhởWhat the skill covers
The sections of its instructions, in order.
- 01 Dataset formats
- 02 SFT: the fields that matter
- 03 GRPO: online RL
- 04 CLI
More in Hugging Face Hub and models
- HuggingFace Best Model Finder
Use when the user asks about finding the best, top, or recommended model for a task, wants to know what AI model to use, or wants to compare models by benchmark scores. Triggers…
- Hf mem
Hugging Face CLI to estimate the required memory to load Safetensors or GGUF model weights for inference from the Hugging Face Hub
- Hugging Face Local Models
Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm. Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup…
- Transformers.js - Machine Learning for JavaScript
Use Transformers.js to run state-of-the-art machine learning models directly in JavaScript/TypeScript. Supports NLP (text classification, translation, summarization), computer…
- Hugging Face Dataset Viewer
Use this skill for Hugging Face Dataset Viewer API workflows that fetch subset/split metadata, paginate rows, search text, apply filters, download parquet URLs, and read size or…
- Hugging Face Paper Pages
Look up and read Hugging Face paper pages in markdown, and use the papers API for structured metadata such as authors, linked models/datasets/spaces, Github repo and project…
- Hf cli
Hugging Face Hub CLI (`hf`) for downloading, uploading, and managing models, datasets, spaces, buckets, repos, papers, jobs, and more on the Hugging Face Hub. Use when: handling…
- Trackio - Experiment Tracking for ML Training
Track and visualize ML training experiments with Trackio. Use when logging metrics during training (Python API), firing alerts for training diagnostics, or retrieving/analyzing…
- SageMaker Deployment Planner
Plan and coordinate the deployment of a model to Amazon SageMaker AI. Use this skill whenever the user wants to deploy, host, serve, or expose a model on SageMaker or AWS —…
Similar ai & machine learning skills
Frequently asked questions
What does TRL do?
Post-train LLMs with TRL (Transformers Reinforcement Learning) — SFT, DPO, GRPO, KTO, and reward-model training. Use when writing or debugging training code with the TRL Python API or the trl CLI.
Is TRL free to use?
Yes. TRL is published by Hugging Face under the Apache 2.0 licence, and you can use it with a free Phở account.
How do I use TRL in Phở?
Press Open in Phở, then Try to apply it to your next message, or add the Hugging Face Hub and models set so Phở loads it whenever a request matches.
Does TRL need other tools?
No. It works in a normal Phở chat with what you type or upload.
Copied unchanged from huggingface/skills at commit 25910b3 and credited to Hugging Face, who is not affiliated with Phở. The full instructions and licence text ship with the skill inside Phở.