---
title: "Data engineering and analytics"
type: skill-set
id: "wshobson-agents/data-engineering"
category: "Data"
publisher: "Seth Hobson"
license: "MIT"
source: "https://github.com/wshobson/agents/tree/7e2fb55"
canonical: "https://labs.pho.chat/en/skills/wshobson-agents/data-engineering"
open_in_pho: "https://pho.chat/customize?item=wshobson-agents%2Fdata-engineering&utm_source=labs&utm_medium=skill-page&utm_campaign=skills-library"
---

# Data engineering and analytics

Airflow DAGs, dbt models, Spark tuning, data quality checks, KPI dashboards and turning numbers into a story.

Source: Seth Hobson (MIT), copied at a pinned commit. Free to use. Part of the Phở Skills library (https://labs.pho.chat/en/skills).

## Skills in this set (6)
- [Apache Airflow DAG Patterns](https://labs.pho.chat/en/skills/wshobson-agents/data-engineering/airflow-dag-patterns.md): Build production Apache Airflow DAGs with best practices for operators, sensors, testing, and deployment. Use when creating data pipelines, orchestrating workflows, or scheduling batch jobs.
- [Data Quality Frameworks](https://labs.pho.chat/en/skills/wshobson-agents/data-engineering/data-quality-frameworks.md): Implement data quality validation with Great Expectations, dbt tests, and data contracts. Use when building data quality pipelines, implementing validation rules, or establishing data contracts.
- [dbt Transformation Patterns](https://labs.pho.chat/en/skills/wshobson-agents/data-engineering/dbt-transformation-patterns.md): Master dbt (data build tool) for analytics engineering with model organization, testing, documentation, and incremental strategies. Use when building data transformations, creating data models, or…
- [Apache Spark Optimization](https://labs.pho.chat/en/skills/wshobson-agents/data-engineering/spark-optimization.md): Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.
- [Data Storytelling](https://labs.pho.chat/en/skills/wshobson-agents/data-engineering/data-storytelling.md): Transform data into compelling narratives using visualization, context, and persuasive structure. Use when presenting analytics to stakeholders, creating data reports, or building executive…
- [KPI Dashboard Design](https://labs.pho.chat/en/skills/wshobson-agents/data-engineering/kpi-dashboard-design.md): Design effective KPI dashboards with metrics selection, visualization best practices, and real-time monitoring patterns. Use this skill when building an executive SaaS metrics dashboard tracking…

## Use it
- In Phở: open https://pho.chat/customize?item=wshobson-agents%2Fdata-engineering&utm_source=labs&utm_medium=skill-page&utm_campaign=skills-library and press Try, or add it so Phở loads it whenever a request matches. Phở works with your own API key (OpenAI, Anthropic, Google and others).
- Original files: https://github.com/wshobson/agents/tree/7e2fb55 (MIT).
- Full machine-readable index: https://labs.pho.chat/skills.json