Index of every page on this site: llms.txt
All skills
nvidia avatar

NVIDIA/SkillEvaluator

Multi-tier framework for evaluating AI agent skills and plugins with quality gates, security scanning, harness compatibility checks, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior. Ships reusable CI templates that bring every check to any repository.

main Updated 1 hour agoGitHub
README badge for nvidia/skillevaluator

Repository statistics

  • Indexed skills

    6

  • Skill groups

    2

  • GitHub stars

    4,287

  • Forks

    554

6 total

Reference skills

5 skills

Evaluate mathematical expressions and unit conversions. Handles arithmetic, percentages, exponents, and common unit conversions (temperature, distance, weight). No external dependencies.

Updated

Use when converting an existing benchmark, rubric, verifier, task YAML/JSON, or domain check into SkillEvaluator BYOG/BYOT custom evaluation.

Updated

Analyze text content and produce statistics including word count, line count, character count, sentence count, average word length, and most frequent words. Use when asked to analyze, count, or summarize a text or a text file (inline text or a file path such as input.txt), or when a request names text-analyzer.

Updated

Call any REST API dynamically. Make GET, POST, PUT, DELETE requests to any endpoint with custom headers and JSON body.

Updated

Required for 4+ step requests; add tasks at start and update status after each step.

Updated

Skills

1 skill

Run and interpret SkillEvaluator for agent skills. Use for any skill benchmark or eval - validating or scoring a SKILL.md, writing evals.json test cases or evals config, explaining benchmark reports, verdicts and exit codes, or gating skills in CI.

Updated

The badge links readers to this page. It shows the skilld mark and no counts, and it follows the reader's light or dark GitHub theme.

<a href="https://skilld.dev/gh/nvidia/skillevaluator"> <picture> <source media="(prefers-color-scheme: dark)" srcset="https://skilld.dev/b/nvidia/skillevaluator?theme=dark"> <source media="(prefers-color-scheme: light)" srcset="https://skilld.dev/b/nvidia/skillevaluator?theme=light"> <img alt="Skill repository on skilld.dev" src="https://skilld.dev/b/nvidia/skillevaluator?theme=light"> </picture> </a>