Skip to content

Phở Founder Lifetime: $59 once, 1 year of Phở AI included. Limited seats. See the offer

AI & machine learning · Skill set · 19 skills

LLM apps and fine tuning

RAG, embeddings, hybrid and vector search, LLM evaluation, and fine-tuning recipes from dataset curation to LoRA, preference optimisation and quantised export.

Open in Phở

Skills in this set

  • Embedding Strategies

    Select and optimize embedding models for semantic search and RAG applications. Use when choosing embedding models, implementing chunking strategies, or optimizing embedding…

  • Hybrid Search Implementation

    Combine vector and keyword search for improved retrieval. Use when implementing RAG systems, building search engines, or when neither approach alone provides sufficient recall.

  • LangChain & LangGraph Architecture

    Design LLM applications using LangChain 1.x and LangGraph for agents, memory, and tool integration. Use when building LangChain applications, implementing AI agents, or creating…

  • LLM Evaluation

    Implement comprehensive evaluation strategies for LLM applications using automated metrics, human feedback, and benchmarking. Use when testing LLM performance, measuring AI…

  • RAG Implementation

    Build Retrieval-Augmented Generation (RAG) systems for LLM applications with vector databases and semantic search. Use when implementing knowledge-grounded AI, building document…

  • Similarity Search Patterns

    Implement efficient similarity search with vector databases. Use when building semantic search, implementing nearest neighbor queries, or optimizing retrieval performance.

  • Vector Index Tuning

    Optimize vector index performance for latency, recall, and memory. Use when tuning HNSW parameters, selecting quantization strategies, or scaling vector search infrastructure.

  • Checkpoint Promotion

    Gate fine-tuned checkpoints with drift budgets, paired comparison, and forgetting checks before promotion. Use after a training run produces a checkpoint, when deciding whether a…

  • Dataset Curation

    Prepare, format, and validate datasets for supervised fine-tuning and preference training. Use when converting raw data into training format, applying chat templates, configuring…

  • Eval Harness First

    Build the evaluation harness that gates every fine-tuning run — golden sets, per-failure-mode graders, judge calibration, and base-model baselines. Use when starting a…

  • Fine-Tuning Method Selection

    Decide whether to fine-tune at all, and route to the right method (SFT, DPO/ORPO/KTO, GRPO/RLVR, continued pretraining) and base model. Use when starting any fine-tuning effort…

  • GRPO & RLVR Training

    Train reasoning and verifiable-task behavior with GRPO and reinforcement learning from verifiable rewards (RLVR). Use when task success is algorithmically checkable (math, code…

  • LoRA & QLoRA Recipes

    Configure LoRA and QLoRA supervised fine-tuning with current best-practice hyperparameters. Use when writing or reviewing a LoRA/QLoRA training configuration, choosing…

  • Preference Optimization

    Align a fine-tuned model with preference data using DPO, ORPO, KTO, or SimPO. Use when preference pairs or thumbs-up/down feedback exist, when choosing between…

  • Quantized Export

    Export a promoted fine-tuned model in the right deployment format — merged safetensors, LoRA-only, GGUF with imatrix, or FP8. Use after a checkpoint passes promotion, when…

  • Trace To Training Data

    Convert evaluation traces and production logs into SFT examples and preference pairs. Use when graded traces or failure examples exist and need to become training data, when…

  • Vision-Language SFT

    Fine-tune vision-language models (VLMs) with supervised learning on image+text data. Use when adapting a VLM to a visual domain or task, configuring frozen-vision-tower LoRA, or…

  • ML Pipeline Workflow

    Build end-to-end MLOps pipelines from data preparation through model training, validation, and production deployment. Use when creating ML pipelines, implementing MLOps…

  • Recsys Pipeline Architect

    Design composable recommendation, ranking, and feed pipelines using the six-stage Source→Hydrator→Filter→Scorer→Selector→SideEffect framework popularized by xAI's open-sourced X…

Other ai & machine learning sets

Frequently asked questions

What is in the LLM apps and fine tuning skill set?

19 skills: Embedding Strategies, Hybrid Search Implementation, LangChain & LangGraph Architecture, LLM Evaluation, RAG Implementation, Similarity Search Patterns, and 13 more.

Is the LLM apps and fine tuning skill set free?

Yes. It is published by Seth Hobson under the MIT licence and works with a free Phở account.

How do I add LLM apps and fine tuning to Phở?

Press Open in Phở and add the set once. From then on Phở picks the right skill from it whenever a request matches.

Copied unchanged from wshobson/agents at commit 7e2fb55 and credited to Seth Hobson, who is not affiliated with Phở. The full instructions and licence text ship with the skill inside Phở.