core practice · system design prompt
Design exercise: Human Review Systems
Review queues, risk routing, disagreement, calibration, escalation, auditability, and learning from corrections. Implement designOutline() returning non-empty values for: riskRouting, reviewRubric, feedbackLoop. Each value must name a concrete mechanism or decision.
The mechanism
Human review is a risk-control system. Route uncertain or high-impact cases, give reviewers evidence and clear rubrics, measure agreement, and feed corrections into evals.
Expected evidence
A design outline with riskRouting, reviewRubric, feedbackLoop plus an explicit failure mode or trade-off.
Try this drill in the practice workspace →
Hints when you need them
- Name the failure mode before selecting the mechanism.