All skills
mblode avatar

/ax-audit

@57eb304
by Matthew Blodemblode/agent-skills136 stars
12

Audits agentic products for tool parity, authority, approval payloads, recovery, and trust using 27 rules and a ship verdict. Use when asked for an "AX audit", to review an agent approval flow, or whether an agent can operate the product. For human-facing API ergonomics use dx-audit; for ordinary UI use ui-design.

Use this Skill: https://skilld.dev/gh/mblode/agent-skills/ax-audit

This session only. Nothing lands on disk.

referencesoutput-format.md

≈1.3k tokens on demand. Your agent reads this file only when SKILL.md points to it.

Output Format

Output structure for ax-audit results: a findings table, then the AX relationship summary.

Table of contents

Findings table

Each finding is a JSON object (schema is compatible with ui-design Audit mode findings, so the two reports merge):

{
  "rule": "trust-no-confidence-cues",
  "layer": "ax",
  "category": "trust",
  "feature": "agent-chat",
  "surface": "ChatPanel",
  "file": "src/chat/ChatPanel.tsx",
  "line": 42,
  "result": "fail",
  "defaultTier": "fix-this-sprint",
  "assignedTier": "fix-this-sprint",
  "tierReason": "Default tier; agent chat surface.",
  "observed": "Agent output rendered in <AssistantMessage> with no citation, source, or reasoning child components.",
  "evidence": ["src/chat/ChatPanel.tsx:42, <AssistantMessage content={message.content} /> with no children"],
  "fix": "Add a <Sources> or <Reasoning> component inside agent message rendering.",
  "suppressed": false
}

Field reference

Field Values / notes
rule Rule slug, matches the rule filename without .md
layer arch (Layer 1) or ax (Layer 2)
category arch: parity | granularity | context | comm. ax: trust | control | context | comm
feature One of 4 playbooks: agent-chat, agent-tool-execution, agent-config, agent-dashboard
surface Component or page name the finding sits on (groups the report)
file, line Evidence location; required on every fail/warn
result pass | warn | fail | unknown | out-of-scope. unknown: the evidence was reachable and no judgment could be reached, which counts against the self-check. out-of-scope: the layer the rule audits is not in this scope at all (no orchestrator in a UI-only diff, no connector code in a tool-handler slice), which does not. Both require a reason in observed
defaultTier, assignedTier, tierReason Tier from the rule file, tier after surface override, and one-sentence justification. Tier is the only ship-impact signal; no separate severity field
observed What the code actually does, in one sentence
evidence Array of file:line: excerpt strings backing the finding
fix Concrete change; a snippet or one-sentence instruction
suppressed true when an ax-audit-ignore:<slug> comment covers the match, report suppressed counts, never silently drop

AX relationship summary

Produced after findings, only when agentic features are detected. Four fields naming the user-agent relationship in behavioral terms:

{
  "axSummary": {
    "evolutionStage": {
      "stage": 2,
      "label": "Task-Aware",
      "behavior": "Agent tracks current task state and adjusts in the moment, but starts fresh each session with no memory of user preferences or history."
    },
    "trustSignal": {
      "level": "moderate",
      "reasoning": "Escape hatches present for all agent actions. Confidence cues missing: agent output has no rationale or source attribution."
    },
    "keyGap": "Agent accumulates no session context; every interaction starts cold. Users re-explain preferences and constraints each time.",
    "trustQuestion": "Will users accept inline rationale (sources, reasoning steps) on every agent response, or will it feel like noise?"
  }
}

AX relationship summary: field descriptions

Field Description
evolutionStage Which of the 4 stages (see ax-evolution-curve.md). Describe the behavior, not the label (label for JSON, behavior for the reader).
trustSignal high | moderate | low with one-sentence reasoning, from the trust-critical rules that ran: escalation, escape hatch, approval gates and what they showed, access scope, unprompted action, confidence cues.
keyGap Single most important architectural or trust gap. One sentence, specific enough to act on.
trustQuestion One question for the designer/developer to answer before the next round; only prototyping or research can resolve it.

Terminal rendering

Terminal (not JSON) format:

═══════════════════════════════════════════════════════════
AX VERDICT: ⚠️ READY WITH FOLLOW-UP (0 blockers, 4 fix-this-sprint)

Surfaces:            2 (ChatPanel, ToolExecutionPanel)
Findings:            6
  Release blockers:  0
  Fix this sprint:   4   ⚠️
  Backlog:           2   📋

AX Relationship:
  Stage:       Task-Aware (2 of 4)
  Trust:       Moderate: escape hatches present, confidence cues missing
  Key gap:     No session context; every interaction starts cold
  Question:    Will users accept inline rationale on every response?

Cross-reference:     Run ui-design Audit mode for traditional UX findings
═══════════════════════════════════════════════════════════

Source: SKILL.md on GitHub

No alerts13d3 checks · Risk SAFE
  • Gen Agent Trust Hub13d

    The skill is a specialized auditing framework for AI agent products, focusing on architectural integrity and user trust. It uses standard shell tools for static analysis of codebases. The analysis found no malicious behavior, obfuscation, or data exfiltration risks.

  • Socket13d

    No alerts

  • Snyk13d

    Risk: LOW · No issues

Signed by skilld at 57eb304. This ties the file your Agent reads to that commit on GitHub. It does not review the instructions.

Last checked against GitHub 4 hours ago.

Activeupdated 2 weeks ago

README badge

README badge for mblode/agent-skills/ax-audit