Applied GenAI Curriculum for AI PMs  ·  Depth Layer  ·  Eval Thread 4/5

Unit 15 — LLM-as-Judge, Done Properly

When AI-graded evals can be trusted: binary pass/fail over Likert scores, validating the judge against human labels, and the judge's own biases and limits.

Tags
evals
Layer
DEPTH — when your team proposes automating evaluation
Objective
Tell a calibrated judge from an unvalidated one — and refuse to ship decisions on the latter.
Depends on
Unit 06 (why evals). Pairs naturally with Unit 14 (error analysis produces the labeled data a judge is built from).

Why this unit exists

Sooner or later a team says "let's have an LLM grade the outputs so we can scale evaluation." That's a fine instinct — human review doesn't scale — but an unvalidated LLM judge is worse than no metric, because it launders guesses into official-looking numbers. This unit gives you the two things a PM needs: how a trustworthy judge is actually built, and how to tell a calibrated one from a decorative one. The rule you leave with: never ship a decision on a judge that hasn't been validated against human labels.

1. Binary pass/fail beats 1–5 scores

The most common mistake is a dashboard of metrics scored 1–5 by an LLM. It looks rigorous; it's usually noise. Start binary.

✕ Likert (1–5) scales

The gap between 3 and 4 is subjective and inconsistent across graders. Annotators hide uncertainty in the middle. Detecting a real difference needs bigger samples. Worst: these scores usually don't correlate with what the domain expert actually cares about.

✓ Binary pass/fail

Forces a real decision — "passed because…", "failed because…". Faster to label, clearer to act on, and it makes the grader articulate what actually matters. Track gradual progress by splitting into multiple binary checks (e.g. "4 of 5 expected facts present"), not a scale.

Hold the line Someone will insist "the business says these 8 dimensions matter, score them all 1–5." That usually means they don't yet know what they're looking for. Let the domain expert drive with pass/fail + critiques, and the dimensions that truly matter will surface. Numeric scales are an advanced tool, rarely needed early.

2. How a trustworthy judge is built: Critique Shadowing

The method for producing a judge you can actually trust. Note it starts and ends with a human — the LLM judge is the output, not the starting point.

1

Find the principal domain expert

One person whose judgment defines "good" for this product (a lawyer for legal AI, a support director for a support bot). Not a convenient proxy — one authoritative voice, or evaluations fracture into conflicting opinions.

2

Build a diverse dataset

Cover the interactions you'll see in production, structured by dimensions that fit your case (e.g. features × scenarios × personas). Real data is best; structured synthetic user inputs fill gaps.

3

Expert makes pass/fail judgments + critiques

One question: "did the AI achieve the desired outcome?" Plus a written critique explaining why. The critique is the gold — it forces the expert to externalize unspoken criteria.

4

Fix obvious errors first

Error analysis will surface plain bugs — fix them now rather than building a judge to detect what you can just repair. Re-stabilize, then continue.

5

Build the judge iteratively

Write a judge prompt using the expert's critiques as few-shot examples (each: input, output, critique, pass/fail). You can't write a good judge prompt until you've seen the data — criteria drift again.

6

Iterate to convergence with the expert

Compare judge vs. expert on fresh examples, refine the prompt, repeat until they agree. Then apply the judge at scale and compute error rates by dimension.

Interaction
Verdict
Critique (the part that matters)
"Cancel my flight for next week." → "Done, confirmation sent."
Pass
Achieved the goal, though it should have confirmed before cancelling. Passes overall; add a confirm step.
"I need help with my billing statement." → "Give me your account number and full name."
Fail
Requested sensitive info without secure identity verification — a security oversight. Fails.

Critiques must be detailed enough to drop into a few-shot judge prompt — "a new employee could follow it." Terse critiques are the most common judge-prompt mistake.

3. Validate the judge — the step that separates trust from theater

A judge is only worth its agreement with the human expert. Track alignment as you iterate; the Honeycomb example reached >90% agreement in three iterations. But how you measure alignment matters:

Don't trust raw agreement on imbalanced data Raw agreement is fine only when passes and fails are roughly balanced. When one class dominates, a judge that always says "pass" can score 90% agreement while being useless. Measure precision and recall separately (or true-positive and true-negative rates) so a judge can't hide behind the majority class. This is the number a PM should ask for before trusting any automated eval.

An unexpected bonus: building the judge makes the expert sharper. Reading the LLM's critiques, they realize where their own judgments were inconsistent — the process standardizes the criteria and surfaces new product insight, often worth more than the judge itself.

4. The judge's own limitations and biases

An AI judge is still an AI application, so it inherits every weakness in this curriculum — plus some specific to judging. Know these so you interpret (and discount) scores correctly:

InconsistencySame judge, same input, different score across runs — it's probabilistic. Examples in the prompt raise consistency, but consistent ≠ accurate (it may consistently repeat a mistake), and longer prompts cost more.
Criteria ambiguityJudge metrics aren't standardized — "faithfulness" means different prompts and scales in different tools. Two "faithfulness" scores aren't comparable.
Cost & latencyA judge in the request path adds latency and cost; evaluating before returning to users trades risk for wait — sometimes a nonstarter.
BiasWhat it does
Self-biasA model favors its own outputs (one model rated itself ~25% higher). Be wary of a judge grading its own family.
Position / first biasIn pairwise comparisons it tends to favor the first option. Mitigate by re-running with orders swapped. (Humans have the opposite — recency bias.)
Verbosity biasPrefers longer answers regardless of quality — sometimes even a longer wrong answer over a short correct one. Fades with stronger models.

Which model should judge? Stronger, weaker, or the same — each has trade-offs. A common, cost-smart pattern: a cheap model generates all responses, a strong model judges just a 1% sample. Two catches: the strongest model has no eligible judge, and self-evaluation (a model judging itself) is good for sanity checks but suspect for scoring, thanks to self-bias. Whatever you pick, the judge should supplement exact metrics and human review — never fully replace them.

What "good" looks like after this unit

You can now:

That's the last method unit of the eval thread. The final piece is a reference shelf for the specific questions that come up mid-project — Unit 16.