---
name: judge-evaluation
description: Use when changing or evaluating judge prompts, scoring thresholds, usage floors, or judgment eval corpora.
user-invocable: false
metadata:
  internal: true
title: judge-evaluation
canonical_url: https://skilld.dev/gh/kunchenguid/compact-adviser/judge-evaluation
last_updated: 2026-09-29T02:18:42.000Z
---

> **Skill from skilld.dev.** Follow the instructions below for this session. You do not need to install anything.
>
> If the user asked to install this Skill, run `npx skilld install kunchenguid/compact-adviser/judge-evaluation`. Install writes the Skill files into the project, so every session loads them.

- Judge design rule, measured: two one-sentence atomic questions composed in code beat any single question that folds two judgments together (TypeSafe's own guidance). Hill-climb prompt changes with `eval/tools/earn.py` (paired bootstrap) and read the usage-floor ladder with `eval/tools/schedule.py`; a clause stays only if it earns its place.
- Judgment eval harness: `packages/pi-extension/eval/`. Session transcripts, labels, worksheets, and results stay in gitignored `eval/local/`. See that README for the corpus contract and label rubric.
