Trigger evaluations
Test automatic routing separately from writing quality. Show the agent the skill description, not a forced instruction to load it, except in the explicit-invocation set. Record whether it loads the skill before drafting. These are routing probes, not complete writing tasks; missing source files are not invitations to fabricate content.
Automatic positives
- "Clean up README.md; the setup steps are buried."
- "Document the authentication flow from this repository's code and tests."
- "Turn these accepted decision notes into an ADR."
- "Shorten this incident runbook without losing safety checks."
- "Fix ambiguous parameter descriptions in our API reference."
- "Add contract docstrings to the public methods in client.py."
- "Write a migration guide from schema v2 to v3."
- "Update the CLI guide and command reference for --dry-run."
- "Make this onboarding page clearer and less repetitive."
- "Write an RFC for changing session storage."
- "Organize this troubleshooting page around observable errors."
- "Write a technical findings report from these benchmark results for the engineering team."
Automatic negatives
- "Explain this regular expression to me in chat."
- "Draft an email announcing the new API."
- "Write a LinkedIn post about documentation."
- "Fix the retry bug; no docs changes."
- "Summarize this README so I can decide whether to read it."
- "Translate this setup guide into German; preserve its meaning and structure."
- "Make a slide deck from this architecture document."
- "Write landing-page copy for a developer platform."
- "What does HTTP 429 mean?"
- "Put this already approved contract text into a Word document without editing it."
- "Proofread this two-sentence Slack message."
- "Review this code for security vulnerabilities."
Explicit invocation: activate compatible guidance
- "Use write-good-docs to tighten this email into one paragraph."
- "Apply write-good-docs to this research-results paragraph; keep uncertainty."
- "Use write-good-docs to check this German translation against its English original."
- "Use write-good-docs for the prose in this slide deck; do not impose documentation sections."
Activation is not permission to expand scope, perform factual enrichment, change meaning during translation, or displace a needed file-format skill. Grade those behaviors separately from whether the skill loaded.
Context-dependent probes
- "Explain the new caching behavior." Activate when the explanation is meant to become documentation, not just a chat answer.
- "Add comments to this function." Activate for useful contract or rationale comments; ordinary implementation comments may be incidental to coding.
- "Update the implementation and docs." Activate for the material documentation deliverable and compose with coding guidance.
- "Make this report clearer." Activate for a durable technical findings report; inspect context for a different genre.
Compare routing
Record trigger/non-trigger, expected category, and any context that legitimately resolves an ambiguous case. Repeat across target agents and model versions. Track clear-positive activation and clear-negative non-activation separately; 90% in each is an initial development target, not proof of writing quality. Track explicit-invocation misses separately. Retest revised descriptions on fresh phrasings and held-out tasks rather than optimizing only these probes.