recipe
Reproducible eval sample
· 2 min read
Two eval runs see the same prompts, so a score change comes from your change and not from the sample. Sample 50 lines from a JSONL file with a fixed ...
tag
#sip
1 post tagged #sip
tag
1 post tagged #sip
Two eval runs see the same prompts, so a score change comes from your change and not from the sample. Sample 50 lines from a JSONL file with a fixed ...