Index of every page on this site: llms.txt
All skills
tejasshukla2007 avatar

/content-quality-audit

@1b012a3
Run it yourself

Evaluates the visible text of a webpage for AI discoverability quality. Checks factual correctness of major claims, detects contextual drift and undefined jargon that could mislead AI chunkers, and flags low information density paragraphs that rely on marketing fluff over concrete facts.

  • 3 files
  • 9.6 KB
  • Apache-2
  • Updated 2 months ago
  • GitHub
Use this Skill: https://skilld.dev/gh/tejasshukla2007/brand-ai-readiness-audit/content-quality-audit

Nothing lands on disk. Nothing to clean up.

Fork this Skill

Edit a local copy. It keeps the author and licence.

SKILL.md

≈78 tokens for metadata: the name and description. ≈1k when used: this file. ≈289 more on demand in 1 file.

Description uses 3.9% of example budget

Before choosing a Skill, your Agent reads its name and description. All available Skills share that space.

  • A shorter description leaves more room for other Skills. This entry exceeds our 1% size suggestion.

In our Claude Code example, all Skill names and descriptions share 8,000 characters. This Skill uses ≈312 characters, or 3.9%.

The 1% threshold is a size suggestion. Longer descriptions can still fit.

Your model, settings, and other Skills decide how much text your Agent can read.

Example settings and source

The example uses a 200k-token context and default Claude Code settings. The count includes the name, description, separators, and when_to_use when present. Codex also counts local file paths.

Skit's source and limits: Codex 0.160.1, Claude Code 2.1.292.

Linguistic Clarity & Content Quality Audit

When to use

Execute this skill when the audit orchestrator requests an evaluation of a domain's content quality for AI discoverability and generative engine optimization.

Inputs

  • target_url: The full URL or domain name to be audited.

Procedure

  1. Fetch the raw HTML content of the target_url homepage.
  2. Execute python scripts/extract_text.py passing the full HTML via stdin. The script extracts visible text, brand ground truth (from <title> and <meta> tags), and breaks content into numbered paragraphs [P1], [P2], etc.
  3. Read the Tool Output Data. You are provided with:
    • BRAND GROUND TRUTH: The page's <title> and <meta> tags. Use this to understand the core domain/purpose of the brand.
    • VISIBLE TEXT: The cleaned text of the webpage, broken into numbered paragraphs.
  4. Handling Bot Protection: If the visible text says Error: No HTML provided. (meaning the fetch failed due to a 403 Forbidden firewall), you MUST skip the 3 rules below and emit exactly one finding (ID: CQA-000, Title: Content Quality Audit Inconclusive: Bot Protection Active, Severity: medium) advising the user to whitelist AI crawlers.
  5. Evaluate the text against the Deterministic Grading Rubric below. For each finding, use the exact text snippet or paragraph number as evidence.
  6. Format all detected issues strictly into the JSON structure defined in references/finding_schema.json.

Deterministic Grading Rubric

1. Factual Correctness (Tiered Verification)

Extract major claims and statistics.

  • Step 1: Check your internal memory. If verified, go straight to Outcome.
  • Step 2: Only if internal memory lacks the knowledge, use your web search tool (if available) to verify it against third-party sources.
  • Outcome:
    • If demonstrably FALSE: Emit a critical finding.
    • If it cannot be verified internally or externally: Pass (assume true, as the structural citation checks in the freshness skill will catch unlinked claims).
    • If TRUE: Pass.

2. Contextual Drift (Semantic Isolation)

  • Brand Alignment: Compare each paragraph against the Brand Ground Truth (derived from <title> and <meta> tags). If a paragraph drifts completely off-topic, flag it.
  • Jargon Isolation: Assume the reader (the AI chunker) has ZERO human common sense. If a highly niche term, double-meaning, or metaphor (e.g., using the word "Apple" without surrounding tech keywords like "Mac" or "software", or using an undefined acronym) is used but not defined within the same paragraph, it is an AI parsing risk. The AI will misclassify the context.

3. Substance Assessment (Fluff vs. Fact)

Use your holistic semantic judgment to scan for "Information Density."

  • If a paragraph's primary purpose is emotional persuasion (relying on marketing buzzwords like 'revolutionary', 'best-in-class') rather than providing concrete, verifiable nouns or quantifiable data, flag it as a "Low Information Density" risk. AI engines penalize abstract marketing and prioritize dense, factual text.

Evaluation Rubric

Condition Finding ID Title Severity Priority
HTML fetch failed (bot protection) CQA-000 Content Quality Audit Inconclusive: Bot Protection Active medium medium
Demonstrably false claim detected CQA-001 Factually Incorrect Claim Detected critical critical
Paragraph drifts off-topic or contains undefined jargon/acronyms CQA-002 Contextual Drift or Undefined Jargon Risk medium medium
Paragraph relies on marketing fluff without concrete facts CQA-003 Low Information Density Paragraph low low

Output

For every violation found, emit a JSON finding that strictly conforms to the schema in references/finding_schema.json.

  • evidence: MUST contain the exact text snippet or paragraph number (e.g., "[P4] Our revolutionary product...")
  • suggested_action.summary: Provide the exact rewritten sentence or the exact noun/statistic needed to fix it.

IMPORTANT: Output ONLY the raw JSON array. Do not include markdown code blocks (```json).

Source: SKILL.md on GitHub

skilld matched fixed text patterns in SKILL.md and file names. Patterns miss obfuscated code.

skilld run checks every file with the same patterns. It asks for approval before it loads a Skill with a behavior marked Needs approval.

No third-party reports yet.

Signed by skilld at 1b012a3. This ties the file your Agent reads to that commit on GitHub. It does not review the instructions.

Last checked against GitHub last month.

Steadyupdated 2 months ago

README badge

README badge for tejasshukla2007/brand-ai-readiness-audit/content-quality-audit