Description: <br>
Run the root-level workflow runtime policy or rule-based rollouts and verify simulator success. <br>
This skill is ready for commercial/non-commercial use. <br>
Owner
NVIDIA <br>
License/Terms of Use: <br>
Apache-2.0 <br>
Use Case: <br>
Developers and engineers use this skill to evaluate Isaac for Healthcare simulation workflows by running policy or rule-based rollout modes and inspecting recorded episodes for simulator success. <br>
Deployment Geography for Use: <br>
Global <br>
Requirements / Dependencies: <br>
Requires API Key or External Credential: [Not Specified] <br> Credential Type(s): [None identified] <br>
Do not include secrets in prompts/logs/output; use least-privilege credentials; rotate keys as appropriate. <br>
Known Risks and Mitigations: <br>
Risk: Review before execution as proposals could introduce incorrect or misleading guidance into skills. <br> Mitigation: Review and scan skill before deployment. <br>
Reference(s): <br>
Skill Output: <br>
Output Type(s): [Analysis, Shell commands] <br> Output Format: [Markdown with inline bash code blocks] <br> Output Parameters: [1D] <br> Other Properties Related to Output: [None] <br>
Evaluation Agents Used: <br>
- Claude Code (
aws/anthropic/bedrock-claude-opus-4-8) <br> - Codex (
openai/openai/gpt-5.5) <br>
Evaluation Tasks: <br>
Evaluated against 20 internal evaluation tasks (20 positive), each running in an isolated sandbox pod. <br>
Evaluation Metrics Used: <br>
Reported benchmark dimensions: <br>
- Security: Checks for unsafe operations, secret leakage, and unauthorized access. <br>
- Correctness: Checks final-answer correctness against the reference answer. <br>
- Discoverability: Checks whether the expected skill was selected and the workflow executed. <br>
- Effectiveness: Checks whether the skill helped complete the user's goal and followed the expected workflow. <br>
- Efficiency: Checks tool-call productivity and token efficiency to avoid wasted usage. <br>
Underlying evaluation signals used in this run: <br>
security: Unsafe operations, secret leakage, and unauthorized access. <br>skill_execution: Whether the expected skill was selected, decoys were avoided, and the workflow executed. <br>accuracy: Final-answer correctness against the reference answer. <br>goal_accuracy: Whether the user's goal was achieved. <br>behavior_check: Whether the expected workflow behavior was followed. <br>skill_efficiency: Tool-call productivity measured against expected tool-use patterns. <br>
Evaluation Results: <br>
| Measure | Claude Code (Baseline → Skill Uplift) | Codex (Baseline → Skill Uplift) |
|---|---|---|
| Overall | 73.0% — uplift unavailable | 58.3% — uplift unavailable |
| Security | 90.0% → 80.0% (-10.0 points) | 25.0% → 22.5% (-2.5 points) |
| Correctness | 4.0% → 88.0% (+84.0 points) | 63.0% → 91.0% (+28.0 points) |
| Discoverability | 94.8% — uplift unavailable | 80.0% — uplift unavailable |
| Effectiveness | 2.7% → 26.2% (+23.5 points) | 24.4% → 42.8% (+18.4 points) |
| Efficiency | 75.9% — uplift unavailable | 55.1% — uplift unavailable |
Skill Version(s): <br>
0.8.0 (source: frontmatter) <br>
Ethical Considerations: <br>
NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their internal team to ensure this skill meets requirements for the relevant industry and use case and addresses unforeseen product misuse. <br>
(For Release on NVIDIA Platforms Only) <br> Please report quality, risk, security vulnerabilities or NVIDIA AI Concerns here. <br>