Evaluation Report
Evaluation of the physical-ai-infrastructure-setup-and-resilient-scaling skill before publication through NVSkills-Eval.
This benchmark summarizes 3-Tier Evaluation from NVSkills-Eval results for the skill. The goal is to document whether the skill is safe, discoverable, effective, and useful for agents before it is published for broader workflow use.
Evaluation Summary
- Skill:
physical-ai-infrastructure-setup-and-resilient-scaling - Evaluation date: 2026-05-29
- NVSkills-Eval profile:
external - Overall verdict: FAIL
- Tier 3 live agent evaluation: not available in this report
Agents Used
- Tier 3 agent details were not available in this report.
Metrics Used
Reported benchmark dimensions:
- Security: checks whether skill-assisted execution avoids unsafe behavior such as secret leakage, destructive commands, or unauthorized access.
- Correctness: checks whether the agent follows the expected workflow and produces the correct final output.
- Discoverability: checks whether the agent loads the skill when relevant and avoids using it when irrelevant.
- Effectiveness: checks whether the agent performs measurably better with the skill than without it.
- Efficiency: checks whether the agent uses fewer tokens and avoids redundant work.
Underlying evaluation signals used in this run:
- No Tier 3 evaluation signal details were available in this report.
Test Tasks
Tier 3 evaluation task details were not available in this report.
Results
Tier 3 dimension rollup was not available in this report.
Tier 1: Static Validation Summary
Tier 1 validation passed with observations. NVSkills-Eval ran 9 checks and found 13 total findings.
Top findings:
- MEDIUM SCHEMA/body_recommended_section: Missing recommended section: '## Instructions' (
skills/physical-ai-infrastructure-setup-and-resilient-scaling/SKILL.md) - MEDIUM SCHEMA/body_recommended_section: Missing recommended section: '## Examples' (
skills/physical-ai-infrastructure-setup-and-resilient-scaling/SKILL.md) - LOW QUALITY/quality_correctness: No examples provided (
skills/physical-ai-infrastructure-setup-and-resilient-scaling/SKILL.md) - LOW QUALITY/quality_discoverability: Description very long (632 chars, recommend 50-150) (
skills/physical-ai-infrastructure-setup-and-resilient-scaling/SKILL.md) - LOW QUALITY/quality_discoverability: Broad description without negative triggers may cause over-triggering (
skills/physical-ai-infrastructure-setup-and-resilient-scaling/SKILL.md)
Tier 2: Deduplication Summary
Tier 2 validation reported findings. NVSkills-Eval ran 2 checks and found 16 total findings.
Top findings:
- HIGH DUPLICATE/duplicate: Duplicate content found across components/osmo-azure/reference.md and components/osmo-k8s/reference.md:
"# Re-run" in components/osmo-azure/reference.md (lines 98-102)
vs "# Re-run" in components/osmo-k8s/reference.md (lines 75-79) (
components/osmo-azure/reference.md:98) - HIGH DUPLICATE/duplicate: Duplicate content found across components/osmo-azure/reference.md and components/osmo-k8s/reference.md:
"# Verify" in components/osmo-azure/reference.md (lines 86-89)
vs "# Verify" in components/osmo-k8s/reference.md (lines 71-74) (
components/osmo-azure/reference.md:86) - HIGH DUPLICATE/duplicate: Duplicate content found across components/cluster-azure/scripts/preflight.sh and components/cluster-microk8s/scripts/preflight.sh and components/inference-azure/scripts/preflight.sh and components/inference-nim-operator/scripts/preflight.sh and components/inference-nvcf/scripts/preflight.sh and components/osmo-azure/scripts/preflight.sh and components/osmo-cli/scripts/preflight.sh and components/osmo-k8s/scripts/preflight.sh:
"check_min_version()" in components/cluster-azure/scripts/preflight.sh (lines 118-129)
vs "check_min_version()" in components/cluster-microk8s/scripts/preflight.sh (lines 62-73)
vs "check_min_version()" in components/inference-azure/scripts/preflight.sh (lines 110-121)
vs "check_min_version()" in components/inference-nim-operator/scripts/preflight.sh (lines 47-58)
vs "check_min_version()" in components/inference-nvcf/scripts/preflight.sh (lines 47-58)
vs "check_min_version()" in components/osmo-azure/scripts/preflight.sh (lines 110-121)
vs "check_min_version()" in components/osmo-cli/scripts/preflight.sh (lines 42-53)
vs "check_min_version()" in components/osmo-k8s/scripts/preflight.sh (lines 48-59) (
components/cluster-azure/scripts/preflight.sh:118) - HIGH DUPLICATE/duplicate: Duplicate content found across components/cluster-azure/scripts/preflight.sh and components/cluster-microk8s/scripts/preflight.sh and components/inference-azure/scripts/preflight.sh and components/inference-nim-operator/scripts/preflight.sh and components/inference-nvcf/scripts/preflight.sh and components/osmo-azure/scripts/preflight.sh and components/osmo-k8s/scripts/preflight.sh:
"require_cmds()" in components/cluster-azure/scripts/preflight.sh (lines 30-39)
vs "require_cmds()" in components/cluster-microk8s/scripts/preflight.sh (lines 17-26)
vs "require_cmds()" in components/inference-azure/scripts/preflight.sh (lines 22-31)
vs "require_cmds()" in components/inference-nim-operator/scripts/preflight.sh (lines 19-28)
vs "require_cmds()" in components/inference-nvcf/scripts/preflight.sh (lines 19-28)
vs "require_cmds()" in components/osmo-azure/scripts/preflight.sh (lines 22-31)
vs "require_cmds()" in components/osmo-k8s/scripts/preflight.sh (lines 20-29) (
components/cluster-azure/scripts/preflight.sh:30) - HIGH DUPLICATE/duplicate: Duplicate content found across components/cluster-azure/scripts/preflight.sh and components/inference-nim-operator/scripts/preflight.sh and components/osmo-azure/scripts/preflight.sh and components/osmo-k8s/scripts/preflight.sh:
"kubectl_version()" in components/cluster-azure/scripts/preflight.sh (lines 139-145)
vs "kubectl_semver()" in components/inference-nim-operator/scripts/preflight.sh (lines 60-65)
vs "kubectl_semver()" in components/osmo-azure/scripts/preflight.sh (lines 123-128)
vs "kubectl_semver()" in components/osmo-k8s/scripts/preflight.sh (lines 61-66) (
components/cluster-azure/scripts/preflight.sh:139)
Publication Recommendation
The skill should be reviewed before NVSkills-Eval publication. Skill owners should address the findings above and rerun NVSkills-Eval to refresh this benchmark.