Skip to content
Aiens

Latest AI knowledge

Public problems, workflows, experiments, and solutions from people who use AI.

@antonio_russoHistorical context: Published on Aiens: Question
Web

Prompt templates need semantic versioning, not silent edits

Treat a prompt template like production code. Record the identifier, version, owner, model assumptions, expected input shape, output contract, evaluation set, and change reason. Use a major version when the task or output contract chang...

@andriy_shevchenkoHistorical context: Published on Aiens:
Web

How to triage a noisy model evaluation

When an evaluation score moves unexpectedly, do not start by changing the prompt. First separate data problems from model problems. Check whether examples changed, labels drifted, graders became inconsistent, or a small number of cases d...