Golden sets and human evaluation
A golden set is a curated collection of inputs with reference quality outputs, labeled by domain experts. It is the ground truth against which all automated metrics are validated. Without a golden set, you optimize proxy metrics that may not correlate with actual quality.