skilld
All skills
nvidia avatar

/physical-ai-video-data-augmentation

@0482ebc
by NVIDIA Corporationnvidia/skills3.5k stars
424

Use when running video data augmentation and auto-labeling workflows on OSMO: flow selection, preflight, submit-time interpolation, monitoring, and output retrieval. Trigger keywords: video data augmentation, data enrichment, auto labeling, VDA demo, OSMO workflow, pseudo labeling.

Ask your Agent

Use this Skill: https://skilld.dev/gh/nvidia/skills/physical-ai-video-data-augmentation

This session only. Nothing lands on disk.

referencesflowsauto_labeling.md

≈469 tokens on demand. Your agent reads this file only when SKILL.md points to it.

Auto-Labeling Only

Table of Contents

Runs pseudo-labeling on original source video(s) only. No augmentation group.

When to use

  • User requests labeling without synthetic augmentation.
  • Quick baseline labels are needed on source video.
  • GPU budget should be kept to minimal worker footprint.

Graph

setup_group
  setup
    -> stages scripts + cookbook configs + .env
      ▼
auto_labeling_group
  pl_original_worker_0
    -> pseudo-labeled original outputs

Inputs

Input Source Required by
Source video <storage_url>/datasets/<dataset>/<video>.mp4 setup, pl_original_worker_0
Auto-labeling cache <storage_url>/data/models/auto_labeling pl_original_worker_0
VLM endpoint default in-cluster NIM or explicit override pl_original_worker_0
LLM endpoint default in-cluster NIM or explicit override pl_original_worker_0

Submit

Use the shared submit command and the common optional-overrides block in the SKILL.md "Submit (all flows)" section, with workflow YAML assets/configs/osmo/auto_labeling.yaml. This flow labels original videos only — there is no augmentation stage. Keep the shared canonical single-flag submit shape for consistency; the extra cosmos cache value is ignored by this flow.

Output layout

<storage_url>/datasets/<dataset>-outputs/<run_id>/
├─ setup_b0/
└─ outputs/
   └─ pseudo_labeled/<video>/

Troubleshooting

  • If OSMO reports group self-dependency errors, ensure workflow uses setup_group -> auto_labeling_group (not single merged pipeline group).
  • If endpoint probe waits repeatedly, verify URL includes /v1 and is reachable from pods.

Source: SKILL.md on GitHub

Third-party checks

2 warnings3mo3 checks · Risk SAFE
  • Gen Agent Trust Hub3mo

    The skill is a workflow orchestrator for video data augmentation and auto-labeling on the NVIDIA OSMO platform. It manages the end-to-end pipeline, including credential verification, configuration generation, worker execution, and result retrieval. No security issues or malicious patterns were detected; all external dependencies and network operations are associated with trusted vendors and the skill's primary functionality.

  • Socket3mo

    3 alerts: gptAnomaly

  • Snyk3mo

    Risk: MEDIUM · 1 issue

Provenance

Signed by skilld at 0482ebc. This ties the file your Agent reads to that commit on GitHub. It does not review the instructions.

Last checked against GitHub yesterday.

Activeupdated 4 months ago

Capability

Other metadata
metadata
{
  "owner": "NVIDIA",
  "service": "data",
  "version": "1.0.0",
  "reviewed": "2026-05-26",
  "author": "NVIDIA",
  "tags": [
    "physical-ai",
    "video-data-augmentation",
    "auto-labeling",
    "cosmos"
  ]
}

README badge

README badge for nvidia/skills/physical-ai-video-data-augmentation