CODING · EDITORIAL CLASSIFICATION · NOT A BENCHMARK
DO I NEED THE BIG MODEL FOR…
Write unit tests for a simple function
Small-model jobNO — START SMALL
“A tight function signature and examples do most of the work.”
WHY THIS VERDICTSTART WITH
START WITH
THE WORK.
- 01
The work is constrained enough to evaluate cheaply.
- 02
A clear schema, rubric, or example carries much of the workload.
- 03
Most failures can be detected before they become expensive.
RECOMMENDED SETUPSmall, fast model + schema + deterministic checks
NON-NEGOTIABLE
Mutation-test or inspect assertions so the tests cannot pass vacuously.
REASONING2/5
AMBIGUITY2/5
ERROR COST2/5
CONTEXT2/5