skilld
All skills
nvidia avatar

/deepstream-sop

@4cb1092
by NVIDIA Corporationnvidia/skills3.5k stars
424

Use this skill when building, deploying, evaluating, debugging, or measuring latency for the DeepStream SOP Inference Microservice — a GPU-accelerated FastAPI service that detects whether operators perform assembly-line steps in order via event boundary detection (GEBD) plus VLM classification. Trigger even if the user does not name it: verify operator step sequence, detect missing or out-of-order SOP steps, score factory/work-cell video for procedure compliance, run VLM-based SOP checking on industrial cameras, or call /v1/chat/completions with a file, RTSP, or Basler camera. Also trigger for its internals: SOPVideoProcessor, DeepStream GEBD model (e.g. DDM) via Triton CAPI, nvds_custom_postprocess, Cosmos Reason 1/2 vLLM, SSE streaming, Kafka NvProto/JSON output, Basler/Pylon camera + emulation, Docker compose, chunk-level latency. Do NOT trigger for generic DeepStream pipelines, object detection/tracking, NIM imports, or video summarization.

Ask your Agent

Use this Skill: https://skilld.dev/gh/nvidia/skills/deepstream-sop

This session only. Nothing lands on disk.

referencesexample_sop_prompt.md

≈259 tokens on demand. Your agent reads this file only when SKILL.md points to it.

SOP Inference Microservice — Generation Prompt

Skill: deepstream-sop/SKILL.md Configs: deepstream-sop/configs/ Reference code: deepstream-sop/references/

What to Build

A production-ready FastAPI microservice for SOP compliance monitoring on industrial video feeds:

  • GPU-accelerated event boundary detection — Generic Event Boundary Detection (GEBD) model, default DDM — via DeepStream + Triton CAPI
  • Action classification via embedded vLLM (Cosmos Reason 1 or 2; VLLM_MODEL_PATH is required — no default)
  • SOP sequence and checker compliance (missing / misordered steps)
  • OpenAI-compatible SSE chat completions API (/v1/chat/completions)
  • Video input: files, HTTP/HTTPS URLs, RTSP streams, Basler industrial cameras
  • Kafka messaging: publish chunk results via NvProto (VisionLLM protobuf) or JSON schema

All implementation patterns, file mappings, critical rules, and verification steps are in deepstream-sop/skill.md. Follow each section to generate the complete service.

Source: SKILL.md on GitHub

Third-party checks

2 warnings27d3 checks · Risk MEDIUM
  • Gen Agent Trust Hub27d

    This skill provides a framework for building an industrial SOP monitoring microservice. It uses multi-stage processing, including Vision-Language Models and custom logic. Security observations include dynamic code generation based on configuration files, execution of build scripts via subprocess, and reliance on external research repositories for model weights and code.

  • Socket27d

    2 alerts: gptSecurity, gptAnomaly

  • Snyk27d

    Risk: LOW · No issues

Provenance

Signed by skilld at 4cb1092. This ties the file your Agent reads to that commit on GitHub. It does not review the instructions.

Last checked against GitHub yesterday.

Activeupdated 3 months ago

Capability

owner
windy@nvidia.com
service
deepstream-sop
version
1.0.0
Other metadata
reviewed
2026-04-08
metadata
{
  "author": "Wind Yuan <windy@nvidia.com>",
  "tags": [
    "deepstream",
    "sop",
    "vlm",
    "triton",
    "gpu"
  ],
  "languages": [
    "python"
  ],
  "frameworks": [
    "deepstream",
    "triton",
    "fastapi"
  ],
  "domain": "video-analytics"
}

README badge

README badge for nvidia/skills/deepstream-sop