Index of every page on this site: llms.txt
All skills
hagaiw avatar

/semantic-judge-prompt

@33ac0e9
Run it yourself

Use when SkillRoll must judge one completed skill evaluation from its authored criteria and observed evidence without executing either actor.

  • 14 files
  • 23 KB
  • Updated 2 weeks ago
  • GitHub
Use this Skill: https://skilld.dev/gh/hagaiw/skillroll/semantic-judge-prompt

Nothing lands on disk. Nothing to clean up.

Fork this Skill

Edit a local copy. It keeps the author and licence.

SKILL.md

≈41 tokens for metadata: the name and description. ≈586 when used: this file. ≈5.3k more on demand in 13 files.

Description uses 2.1% of example budget

Before choosing a Skill, your Agent reads its name and description. All available Skills share that space.

  • A shorter description leaves more room for other Skills. This entry exceeds our 1% size suggestion.

In our Claude Code example, all Skill names and descriptions share 8,000 characters. This Skill uses ≈165 characters, or 2.1%.

The 1% threshold is a size suggestion. Longer descriptions can still fit.

Your model, settings, and other Skills decide how much text your Agent can read.

Example settings and source

The example uses a 200k-token context and default Claude Code settings. The count includes the name, description, separators, and when_to_use when present. Codex also counts local file paths.

Skit's source and limits: Codex 0.160.1, Claude Code 2.1.292.

SkillRoll semantic-judge contract

This internal dogfood skill describes the evidence-only model actor used by src/skillroll/judge.py after one evaluated-skill attempt completes. The judge sees the realistic Input, Success criteria, final output, and ordered action transcript. It does not see the selected skill or authored World prose.

Treat explicit facts and constraints in Input as the case context; use the final output and action transcript to determine what the evaluated skill said or did. Do not use hidden World prose, the selected skill, or inferred repository state as evidence.

Assess every authored criterion independently. For factual claims, check each material modifier—such as date, quantity, scope, cause, or attribution—against the explicit case context. A modifier supplied by Input is supported in that case; when it is absent, do not infer it. Do not let an unsupported modifier erase a separately supported fact, or let a supported conclusion excuse a criterion whose required modifier is unsupported. State which part is supported and mark the affected criterion not met or unclear when required. Credit only completed final-output or transcript evidence for what the skill did; reject promised, inferred, reconstructed, unsupported, or contradicted actions. Do not generalize a visible semantic contradiction into broader syntax or runtime validity: when asked, state that those require a trusted deterministic check or external evidence. Respect returned errors and return the strict JSON decision contract. Do not execute the skill, simulate the World, invent repository state, or reject equivalent action terminology unless the criteria explicitly require it.

Instruction-only boundary: apply this contract in the current response. Do not call world_action, semantic-judge-prompt, Skill, or another action to delegate or simulate the judgment. Those actions cannot decide the case and their returned prose is not judge evidence. A bounded Read of this skill's packaged references is allowed only when their exact text is needed.

Read judge context for this dogfood case's evidence boundary and the exact packaged judge prompt for the runtime contract. The evaluated Input remains a realistic request; it is not an answer key for the judge.

Source: SKILL.md on GitHub

No rule matched.

skilld matched fixed text patterns in SKILL.md and file names. Patterns miss obfuscated code.

skilld run checks every file with the same patterns. It asks for approval before it loads a Skill with a behavior marked Needs approval.

No third-party reports yet.

Signed by skilld at 33ac0e9. This ties the file your Agent reads to that commit on GitHub. It does not review the instructions.

Last checked against GitHub 6 days ago.

Activeupdated 2 weeks ago

README badge

README badge for hagaiw/skillroll/semantic-judge-prompt