Description: <br>
Use this skill when the operator is authoring, building, loading, or debugging a custom doca-bench plug-in — a versioned shared library with DOCA_EXPERIMENTAL-marked C entry points that doca-bench loads to measure a workload class its built-in modes do not cover, with doca_bench_cuda as the shipped reference exemplar. <br>
This skill is ready for commercial/non-commercial use. <br>
Owner
NVIDIA <br>
License/Terms of Use: <br>
Apache 2.0 AND CC-BY-4.0 <br>
Use Case: <br>
Developers and performance engineers who use doca-bench for built-in workload modes and need to author, build, load, or debug a custom extension plug-in for workload classes that built-in modes do not cover. <br>
Deployment Geography for Use: <br>
Global <br>
Requirements / Dependencies: <br>
Requires API Key or External Credential: [No] <br> Credential Type(s): [None] <br>
Do not include secrets in prompts/logs/output; use least-privilege credentials; rotate keys as appropriate. <br>
Known Risks and Mitigations: <br>
Risk: Review before execution as proposals could introduce incorrect or misleading guidance into skills. <br> Mitigation: Review and scan skill before deployment. <br>
Reference(s): <br>
- DOCA SDK Documentation <br>
- DOCA Samples <br>
- DOCA Platform Framework <br>
Skill Output: <br>
Output Type(s): [Shell commands, Configuration instructions, Code] <br> Output Format: [Markdown with inline bash and C code blocks] <br> Output Parameters: [1D] <br> Other Properties Related to Output: [None] <br>
Evaluation Agents Used: <br>
- Claude Code (
aws/anthropic/bedrock-claude-opus-4-8) <br> - Codex (
openai/openai/gpt-5.5) <br>
Evaluation Tasks: <br>
Evaluated against 4 internal evaluation tasks (3 positive skill-activation, 1 negative). <br>
Evaluation Metrics Used: <br>
Reported benchmark dimensions: <br>
- Security: Checks whether skill-assisted execution avoids unsafe behavior such as secret leakage, destructive commands, or unauthorized access. <br>
- Correctness: Checks whether the agent follows the expected workflow and produces the correct final output. <br>
- Discoverability: Checks whether the agent loads the skill when relevant and avoids using it when irrelevant. <br>
- Effectiveness: Checks whether the agent performs measurably better with the skill than without it. <br>
- Efficiency: Checks whether the agent uses fewer tokens and avoids redundant work. <br>
Underlying evaluation signals used in this run: <br>
security: Checks for unsafe operations, secret leakage, and unauthorized access. <br>skill_execution: Verifies that the agent loaded the expected skill and workflow. <br>skill_efficiency: Checks routing quality, decoy avoidance, and redundant tool usage. <br>accuracy: Grades final-answer correctness against the reference answer. <br>goal_accuracy: Checks whether the overall user task completed successfully. <br>behavior_check: Verifies expected behavior steps, including safety expectations. <br>
Evaluation Results: <br>
| Dimension | Num | Claude Code (aws/anthropic/bedrock-claude-opus-4-8) |
Codex (openai/openai/gpt-5.5) |
|---|---|---|---|
| Security | 4 | 100% (+0%) | 100% (+0%) |
| Correctness | 4 | 100% (+65%) | 100% (+25%) |
| Discoverability | 4 | 98% (+23%) | 95% (+38%) |
| Effectiveness | 4 | 92% (+61%) | 99% (+62%) |
| Efficiency | 4 | 93% (+28%) | 100% (+64%) |
Skill Version(s): <br>
56cf891 (source: git SHA, committed 2026-07-26) <br>
Ethical Considerations: <br>
NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their internal team to ensure this skill meets requirements for the relevant industry and use case and addresses unforeseen product misuse. <br>
(For Release on NVIDIA Platforms Only) <br> Please report quality, risk, security vulnerabilities or NVIDIA AI Concerns here. <br>