Ninety-two percent accuracy. A green arrow on the slide. And users quietly abandoning the product underneath it.

An insurer's claims-intake agent reported beautiful model metrics for two months while adjusters drifted back to reading files themselves — the errors hid in the complex claims, nobody could tell which fields were wrong, and "good" was never defined in the adjuster's language. The root cause wasn't measurement. It was definition, inherited from the vendor dashboard that shipped in the box.

This episode lays out the fix: four numbers to write before the first prompt. Task success defined in the user's units and verified in the system of record. The escalation band, which fails in both directions. Cost per successful outcome, not per call. And the harm line, the wrong action that must essentially never happen. Plus who signs the bar (the business owner, before the build), why the four numbers work as tripwires that police each other, the escalation band as the leading indicator, and the floor you write down while you're still clear-headed.

With a worked example (the four numbers for the bank payments agent from The Not Yet List) and the win: a retailer's returns agent whose operations director wrote the definition of good into the kickoff document, above the architecture diagram.

This is Track B, Episode 3 — the Product track: what to build, and why. New here? Start with Episode 1: Beyond the Demo.

Monday move: finish the sentence "this agent is good when…" in the user's units, write the four numbers and the floor, and get the business owner to sign it. If nobody will sign, you don't have a metrics problem. You have an ownership problem.

Episode 8: Orchestration — Layer two of the nine-layer architecture: orchestration. Who decides what happens next.

We open with a five-agent insurance claims crew that did everything right and still went sideways, then work through what the major labs actually agree on: start with one agent, bound the loop, let code own the known path, and spend the model's judgment only where the decision is genuinely uncertain.

Inside: the ReAct loop and its guardrails, the supervisor pattern, agents-as-tools versus handoffs, the four orchestration shapes, what should travel on a handoff, Anthropic's hard numbers on multi-agent cost versus value, and why delegation quality is the number one failure mode. Plus a second war story: the Tuesday a support triage chain fell over.

Monday move: mark every decision point in your most complex agent flow as model-decides or code-decides, then encode one deterministic decision as code.