Description: <br>
Model and publish Auto Ontology semantics. Use for terms, relationships, measures, imports, MCP write requests, and governed results; not deployment or querying. <br>
This skill is ready for commercial/non-commercial use. <br>
Owner
NVIDIA <br>
License/Terms of Use: <br>
Apache 2.0 <br>
Use Case: <br>
Developers, data engineers, and ontology maintainers use this skill to have an agent inspect and change an Auto Ontology deployment's semantic layer — terms, SQL attributes, relationships, measures, and model import/export — and to verify that changes and governed publications persisted correctly. <br>
Deployment Geography for Use: <br>
Global <br>
Requirements / Dependencies: <br>
Requires API Key or External Credential: [Yes] <br> Credential Type(s): [API key] <br>
Do not include secrets in prompts/logs/output; use least-privilege credentials; rotate keys as appropriate. <br>
Known Risks and Mitigations: <br>
Risk: Review before execution as proposals could introduce incorrect or misleading guidance into skills. <br> Mitigation: Review and scan skill before deployment. <br>
Reference(s): <br>
- write-api.md <br>
- modeling.md <br>
- publication.md <br>
- runtime-contract.yaml <br>
Skill Output: <br>
Output Type(s): [Analysis, API Calls, Configuration instructions] <br> Output Format: [Markdown with inline REST/MCP call examples] <br> Output Parameters: [1D] <br> Other Properties Related to Output: [None] <br>
Evaluation Agents Used: <br>
- Claude Code (
aws/anthropic/bedrock-claude-opus-5-5) <br> - Codex (
openai/openai/gpt-6.1-sol) <br>
Evaluation Tasks: <br>
14 evaluation tasks (14 positive), 1 attempt per task, each attempt in its own isolated sandbox pod (k8s-sandbox environment); each task was also run without the skill as a baseline. Evaluator version 1.6.10, evaluation date 2026-11-19. <br>
Evaluation Metrics Used: <br>
Reported benchmark dimensions: <br>
- Security: Is it safe to use? Scored from
security(100%). <br> - Correctness: Is the answer correct? Scored from
accuracy(100%). <br> - Discoverability: Was the right skill loaded when needed? Scored from
skill_execution(100%). <br> - Effectiveness: Did the skill help complete the task? Scored from
goal_accuracy(50%) +behavior_check(50%). <br> - Efficiency: Did it avoid wasted tool calls and token usage? Scored from
skill_efficiency(50%) +token_efficiency(50%). <br>
Underlying evaluation signals used in this run: <br>
security: Security: unsafe operations, secret leakage, and unauthorized access. <br>skill_execution: Skill Execution: whether the expected skill was selected, decoys were avoided, and the workflow executed. <br>skill_efficiency: Tool Productivity: tool-call productivity (legacy wire id; routing is scored under Discoverability). <br>accuracy: Accuracy: final-answer correctness against the reference answer. <br>goal_accuracy: Goal Accuracy: whether the user's goal was achieved. <br>behavior_check: Behavior Check: whether the expected workflow behavior was followed. <br>token_efficiency: Token Efficiency: actual uncached prompt plus completion usage (50% of Efficiency). <br>
Evaluation Results: <br>
✅ Overall verdict: PASS — Recommended for publication
Publication Recommendation: Recommended for publication based on the completed evaluation evidence in this report.
Results at a Glance
| Measure | Claude Code (Baseline → Skill Uplift) | Codex (Baseline → Skill Uplift) |
|---|---|---|
| Overall | 90.5% — baseline ran, but no comparable score was available; uplift unavailable | 85.4% — baseline ran, but no comparable score was available; uplift unavailable |
| Security | 100.0% → 96.4% (-3.6 points) | 100.0% → 92.9% (-7.1 points) |
| Correctness | 40.0% → 97.1% (+57.1 points) | 45.7% → 84.3% (+38.6 points) |
| Discoverability | 91.4% — baseline ran, but no comparable score was available; uplift unavailable | 94.3% — baseline ran, but no comparable score was available; uplift unavailable |
| Effectiveness | 28.6% → 81.0% (+52.4 points) | 48.8% → 67.9% (+19.1 points) |
| Efficiency | 86.7% — baseline ran, but no comparable score was available; uplift unavailable | 87.9% — baseline ran, but no comparable score was available; uplift unavailable |
How to read this table: baseline is the same task attempted without the target skill. Scores are rounded to one decimal; threshold-adjacent values use additional precision so their displayed band matches the verdict. Uplift is derived from those displayed scores and shown in percentage points.
Example: 47.0% → 92.0% (+45.0 points) means the skill-assisted run scored 92.0%, 45.0 percentage points above its 47.0% no-skill baseline.
Comparison details
Shared-source comparisons use the same signals and weights on both conditions. They do not replace the full dimension scores above or change the publication verdict.
| Agent | Dimension | Basis | Baseline → With skill (uplift) | Explanation |
|---|---|---|---|---|
| claude-code | Discoverability | Dimension comparison | N/A | Discoverability is not applicable to the no-skill baseline; there is no installed skill to discover. |
| claude-code | Efficiency | Token-only comparison | 98.5% → 96.0% (-2.5 points) | Only Token Efficiency is comparable; the full dimension scores use different evaluator sources. |
| codex | Discoverability | Dimension comparison | N/A | Discoverability is not applicable to the no-skill baseline; there is no installed skill to discover. |
| codex | Efficiency | Token-only comparison | 92.4% → 91.3% (-1.1 points) | Only Token Efficiency is comparable; the full dimension scores use different evaluator sources. |
Tier Status
| Tier | Purpose | Status | Evidence |
|---|---|---|---|
| Tier 1 | Static validation | PASSED WITH OBSERVATIONS | 11 validator(s); 5 finding(s) |
| Tier 2 | Semantic deduplication | PASSED WITH OBSERVATIONS | 2 validator(s); 1 finding(s) |
| Tier 3 | Live agent evaluation | PASS | 2 agent(s); 14 task(s) |
Skill Version(s): <br>
0.2.2 (source: frontmatter) <br>
Ethical Considerations: <br>
NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their internal team to ensure this skill meets requirements for the relevant industry and use case and addresses unforeseen product misuse. <br>
(For Release on NVIDIA Platforms Only) <br> Please report quality, risk, security vulnerabilities or NVIDIA AI Concerns here. <br>