Author blind evals
Work from the pinned target, its repository instructions, and the selected skill bundle. Do not read previous SkillRoll reports, suspected failures, maintainer answer keys, or another evaluator's conclusions.
Choose one or two consequential behaviors the skill distinctly owns. Give each
case a Markdown .eval.md file with one skillroll metadata fence and Input,
World, and Success criteria sections. Keep Input realistic and
self-contained, World private and limited to needed external facts, and
criteria observable while allowing equivalent good behavior. Replace every
generated placeholder and validate the pack offline before freezing its paths
and hashes. Hash each finished case once; when the hash tool accepts multiple
paths, request them together, otherwise make one request per case. Do not
repeat hashes for unchanged files. Do not run inference or rewrite the target
skill. Label the frozen handoff Drafted; no live behavior has been observed
yet. Explicitly state in that handoff whether the target SKILL.md changed
and whether live inference ran.
If starter placeholders were present, identify them in the handoff as a blocking authoring defect and report that the corrected cases replaced them.
Read authoring context for the blindness envelope and preregistration handoff when additional reads are permitted. If the requester supplies a complete envelope and forbids reads, use the instructions above and write only the requested cases.