Golden set
A small, curated set of real cases, with expected behaviour written down, used to tell whether a change helped.
By Lattice editorial · Entry last reviewed · method
What it implies
Twenty examples taken from real production traffic beats a thousand invented ones, because twenty real failures contain more information about your actual distribution. A golden set that is never updated becomes a benchmark you have overfitted to — you will improve your score and ship a regression.