Applied GenAI Curriculum for AI PMs  ·  Series Close

References & Further Reading

Every source behind the 24 units, collected here textbook-style — the three works the series draws on, and a unit-by-unit map to the exact chapters, sections, and pages for anyone who wants to read deeper.

Primary sources

AIE

AI Engineering: Building Applications with Foundation Models

Chip Huyen. O'Reilly Media, 2025. ISBN 978-1-098-16629-8.

The backbone of the series — the source for all CORE units except 04 and 06, and most DEPTH units. Official table of contents (used to verify the page ranges below): github.com/chiphuyen/aie-book · O'Reilly: oreilly.com

HAMEL

hamel.dev — Hamel Husain's blog

The applied-evaluation spine of the series — the source for the eval thread's practitioner units (06, 14, 15, 16).

Posts cited: Your AI Product Needs Evals · A Field Guide to Rapidly Improving AI Products · Creating a LLM-as-a-Judge That Drives Business Results · LLM Evals FAQ · "It's Hard to Eval" Is a Product Smell

ANTHROPIC

Anthropic Engineering Blog

The source for the foundational architecture distinction in Unit 04.

Article cited: Building Effective Agents (free, ~25 min)

One optional paid resource Referenced in Unit 16 for teams building real eval infrastructure: Husain & Shankar, AI Evals for Engineers & PMs — a cohort course on Maven (maven.com/parlance-labs/evals). Justified only once your organization is past the basics and actually building eval systems.

Source map — unit by unit

Citation format for the book: [AIE] Ch.N → "Section" (pp. X–Y). CORE units are in accent; DEPTH units in brown.

CORE — the operating model (Units 01–13)
01What AI Engineering Is (and Isn't)[AIE] Ch.1 → "The Rise of AI Engineering" (pp. 2–15) + "The AI Engineering Stack" (pp. 35–47)
02Why the Output Is Never the Same Twice[AIE] Ch.2 → "Sampling Fundamentals" + "Sampling Strategies" (pp. 88–96) and "The Probabilistic Nature of AI" (pp. 105–111)
03Should This Even Be an AI Feature?[AIE] Ch.1 → "Planning AI Applications" (pp. 28–35)
04Workflows vs. Agents[Anthropic] "Building Effective Agents"
05The Four-Way Decision[AIE] Ch.6 → "RAG" intro + "RAG Architecture" (pp. 253–256) and "Agent Overview" (pp. 276–278); Ch.7 → "When to Finetune" incl. "Finetuning and RAG" (pp. 311–318)
06Why Evals Are the Whole Game[Hamel] "Your AI Product Needs Evals"
07Defining "Good": Criteria & Model Selection[AIE] Ch.4 → "Evaluation Criteria" (pp. 160–179) + "Model Selection" (pp. 179–199)
08Prompting as an Engineering Discipline[AIE] Ch.5 → "Introduction to Prompting" (pp. 212–218) + "Prompt Engineering Best Practices" (pp. 220–233)
09Designing the Eval Pipeline[AIE] Ch.4 → "Design Your Evaluation Pipeline" (pp. 200–208)
10The Production Architecture, Assembled[AIE] Ch.10 → "AI Engineering Architecture," Steps 1–5 (pp. 449–465)
11Data Curation: The Unsexy Blocker[AIE] Ch.8 → "Data Curation" (pp. 365–380)
12Cost & Latency[AIE] Ch.9 → "Inference Overview" + "Inference Performance Metrics" (pp. 406–419)
13Capstone (CORE checkpoint)None — produced, not read.
DEPTH — pulled in on demand (Units 14–24)
14Error Analysis & the Improvement Flywheel[Hamel] "A Field Guide to Rapidly Improving AI Products"
15LLM-as-Judge, Done Properly[Hamel] "Creating a LLM-as-a-Judge That Drives Business Results" · then [AIE] Ch.3 → "AI as a Judge" (pp. 136–148)
16Evals Reference Shelf[Hamel] "LLM Evals FAQ" and "'It's Hard to Eval' Is a Product Smell" · optional paid course (above)
17RAG Internals: Retrieval Quality[AIE] Ch.6 → "Retrieval Algorithms" (pp. 257–268) + "Retrieval Optimization" (pp. 268–273) + "RAG Beyond Texts" (pp. 273–275)
18Agent Internals[AIE] Ch.6 → "Tools" (pp. 278–281) + "Planning" (pp. 281–298) + "Agent Failure Modes and Evaluation" (pp. 298–300) + "Memory" (pp. 300–305)
19Finetuning: What It Actually Involves[AIE] Ch.7 → "Finetuning Overview" (pp. 308–311) + "Finetuning Tactics" (pp. 357–360)
20Synthetic Data & Distillation[AIE] Ch.8 → "Data Augmentation and Synthesis" (pp. 380–396)
21Monitoring, Observability & Feedback[AIE] Ch.10 → "Monitoring and Observability" + "AI Pipeline Orchestration" (pp. 465–474) + "User Feedback" (pp. 474–492)
22Defensive Prompting[AIE] Ch.5 → "Defensive Prompt Engineering" (pp. 235–251)
23Where Foundation Models Come From[AIE] Ch.2 → "Training Data" (pp. 50–58) + "Post-Training" (pp. 78–88)
24Foundation-Model Evaluation Concepts[AIE] Ch.3 → "Challenges of Evaluating Foundation Models" (pp. 114–118) + "Exact Evaluation" (pp. 125–136) + "Ranking Models with Comparative Evaluation" (pp. 148–156)

Reading views & threads

The units can be read in several deliberate orders beyond the default sequence:

Full CORE pass — the complete standalone operating model.
01 → 02 → 03 → 04 → 05 → 06 → 07 → 08 → 09 → 10 → 11 → 12 → 13
The eval thread — highest-leverage for the PM role; woven through the sequence rather than grouped.
06 → 07 → 09 → 14 → 15 → 16
The architecture thread — from the foundational distinction to the deep dives.
04 → 05 → 10 → 17 → 18 → 19
"We're launching next month" — the pre-launch essentials.
09 → 10 → 21 → 22
Executive education — the conceptual grounding for stakeholders.
01 → 02 → 23 → 03

A note on how sources were used

Each unit distilled and reframed its source(s) for a product-management audience — translating engineering depth into the decisions and questions a PM actually owns, rather than reproducing the material. The units themselves carry no inline citations by design; this page is the single, textbook-style home for all attribution and further reading. Page ranges follow the book's official table of contents and are inclusive of the named section, stopping where the next section begins.

Deliberate exclusions across the series — model internals and information-theory math ([AIE] pp. 58–77, 96–105, 118–124), finetuning memory/quantization math (pp. 319–356), and accelerator/kernel optimization (pp. 419–447) — are the engineers' pages, left out by design to keep the curriculum on the role boundary a PM operates within.