All skills
nvidia avatar

/mcore-create-issue

@416539c
by NVIDIA Corporationnvidia/skills3.5k stars
424

Investigate a failing GitHub Actions run or job and create a GitHub issue for the failure.

Use this Skill: https://skilld.dev/gh/nvidia/skills/mcore-create-issue

This session only. Nothing lands on disk.

BENCHMARK.md

≈711 tokens on demand. Your agent reads this file only when SKILL.md points to it.

Evaluation Report

Evaluation of the mcore-create-issue skill before publication through NVSkills-Eval.

This benchmark summarizes 3-Tier Evaluation from NVSkills-Eval results for the skill. The goal is to document whether the skill is safe, discoverable, effective, and useful for agents before it is published for broader workflow use.

Evaluation Summary

  • Skill: mcore-create-issue
  • Evaluation date: 2026-05-29
  • NVSkills-Eval profile: external
  • Overall verdict: PASS
  • Tier 3 live agent evaluation: not available in this report

Agents Used

  • Tier 3 agent details were not available in this report.

Metrics Used

Reported benchmark dimensions:

  • Security: checks whether skill-assisted execution avoids unsafe behavior such as secret leakage, destructive commands, or unauthorized access.
  • Correctness: checks whether the agent follows the expected workflow and produces the correct final output.
  • Discoverability: checks whether the agent loads the skill when relevant and avoids using it when irrelevant.
  • Effectiveness: checks whether the agent performs measurably better with the skill than without it.
  • Efficiency: checks whether the agent uses fewer tokens and avoids redundant work.

Underlying evaluation signals used in this run:

  • No Tier 3 evaluation signal details were available in this report.

Test Tasks

Tier 3 evaluation task details were not available in this report.

Results

Tier 3 dimension rollup was not available in this report.

Tier 1: Static Validation Summary

Tier 1 validation passed with observations. NVSkills-Eval ran 9 checks and found 8 total findings.

Top findings:

  • MEDIUM QUALITY/quality_correctness: SKILL_SPEC recommended field missing: 'metadata.tags' (skills/mcore-create-issue/SKILL.md)
  • MEDIUM SCHEMA/body_recommended_section: Missing recommended section: '## Instructions' (skills/mcore-create-issue/SKILL.md)
  • MEDIUM SCHEMA/body_recommended_section: Missing recommended section: '## Examples' (skills/mcore-create-issue/SKILL.md)
  • MEDIUM SECURITY/Unknown (SQP-2): The skill creates GitHub issues and assigns users automatically without explicitly warning the user before performing th (SKILL.md:123)
  • LOW QUALITY/quality_discoverability: No '## Purpose' section (skills/mcore-create-issue/SKILL.md)

Tier 2: Deduplication Summary

Tier 2 validation passed. NVSkills-Eval ran 2 checks and found 0 total findings.

Notable observations:

  • Context Deduplication: Collected 1 file(s)
  • Inter-Skill Deduplication: Parsed skill 'mcore-create-issue': 90 char description

Publication Recommendation

The skill is suitable to proceed toward NVSkills-Eval publication based on this benchmark. Skill owners should keep this file with the skill and refresh it when the evaluation dataset, skill behavior, or target agents materially change.

Source: SKILL.md on GitHub

1 warning3mo3 checks · Risk SAFE
  • Gen Agent Trust Hub3mo

    This skill automates the process of investigating CI failures and creating GitHub issues for the NVIDIA/Megatron-LM repository. While authored by a trusted vendor and using official tools, it contains potential surfaces for command injection and indirect prompt injection through its handling of user-provided URLs and external log data.

  • Socket3mo

    No alerts

  • Snyk3mo

    Risk: MEDIUM · 1 issue

Signed by skilld at 416539c. This ties the file your Agent reads to that commit on GitHub. It does not review the instructions.

Last checked against GitHub yesterday.

Activeupdated 4 months ago
user_invocable
true
argument
GitHub Actions run or job URL
metadata
{
  "author": "Philip Petrakian <ppetrakian@nvidia.com>"
}
Other metadata
when_to_use
User shares a GitHub Actions URL and wants to file a bug report; 'create an issue for this failure', 'file a bug for this CI run', 'triage this GitHub Actions failure'.

README badge

README badge for nvidia/skills/mcore-create-issue