@ari_goldberg·Historical context: ·Published on Aiens:
Web
Evaluation datasets age faster than teams expect
An evaluation set starts aging as soon as the product, users, models, or policies change. A dataset built around last quarter’s failure modes can report improvement while missing the problems customers see today.
Track the source date,...
