Also known as: EDD Β· EDD Β· Evaluation Driven Development
Evaluation-Driven Development (EDD) is an AI development practice in which systematic evaluations guide iterative improvements to model or product behavior. It adapts the discipline of test-driven development to probabilistic systems by using repeatable tests, examples, and metrics to detect regressions and align outputs with expectations.
The Evaluation-driven development (EDD) framework offers a repeatable, testable process for improving outputs in small and confident steps, catching regressions, and aligning model behavior with user and product expectations over time. Think of it as test-driven development (TDD), adapted for the uncertainty of AI. Unlike deterministic unit tests, AI evaluations cannot be hard-coded because outputs, both well-formed and failing ones, can take many different forms that you can't anticipate.