All skills
nvidia avatar

/tilegym-converting-cutile-to-julia

@2bf003b
by NVIDIA Corporationnvidia/tilegym821 stars
89

Converts cuTile Python GPU kernels (@ct.kernel) to cuTile.jl Julia equivalents. Handles kernel syntax translation, 0-indexed to 1-indexed conversion, broadcasting differences, memory layout (row-major to column-major), type system mapping, and launch API differences. Use when converting, porting, or translating cuTile Python kernels to Julia cuTile.jl, or debugging/optimizing existing Julia cuTile translations.

  • 17 files
  • 115 KB
  • CC-BY-4
  • Updated 4 months ago
  • GitHub

Use this Skill: https://skilld.dev/gh/nvidia/tilegym/tilegym-converting-cutile-to-julia

This session only. Nothing lands on disk.

SKILL.md

β‰ˆ113 tokens always: the name and description. β‰ˆ1.6k when used: this file. β‰ˆ16k more on demand in 8 files.

cuTile Python β†’ cuTile.jl (Julia) Conversion

Convert @ct.kernel Python kernels to Julia function ... end cuTile.jl kernels.

Workflow Selection

Architecture

Julia kernels are standalone β€” no Python bridge, no pytest integration. The Julia sub-project lives in julia/ at the repo root with its own Project.toml for dependency management.

julia/                          # Self-contained Julia sub-project
β”œβ”€β”€ Project.toml                # Dependencies: CUDA.jl, cuTile.jl, NNlib.jl, Test
β”œβ”€β”€ kernels/                    # cuTile.jl kernel implementations
β”‚   β”œβ”€β”€ add.jl                  # ← Ground-truth: 1D element-wise with alpha scaling (tensor+tensor, tensor+scalar)
β”‚   β”œβ”€β”€ matmul.jl               # ← Ground-truth: 2D tiled MMA, standard Julia layout (M,K)Γ—(K,N)β†’(M,N)
β”‚   └── softmax.jl              # ← Ground-truth: 3 strategies (TMA, online, chunked) using ct.load/ct.store
└── test/                       # Julia-native tests (using Test stdlib)
    β”œβ”€β”€ runtests.jl             # Test runner entry point
    β”œβ”€β”€ test_add.jl
    β”œβ”€β”€ test_matmul.jl
    └── test_softmax.jl

Ground-truth reference: Always consult julia/kernels/*.jl and julia/test/*.jl for patterns that compile and pass tests. These are the canonical examples of working cuTile.jl code.

Instructions

  1. Analyze the Python kernel: identify patterns, shapes, dtypes, operations
  2. Write Julia kernel β€” julia/kernels/<op>.jl with cuTile.jl kernel + bridge function(s)
  3. Convert kernel signature (see translations/workflow.md Phase 2)
  4. Convert kernel body (apply references/api-mapping.md + references/critical-rules.md)
  5. Write Julia test β€” julia/test/test_<op>.jl using Test stdlib + NNlib.jl for reference
  6. Register test β€” add include(...) in julia/test/runtests.jl
  7. Validate β€” run the bundled validator: python <skill-dir>/scripts/validate_cutile_jl.py <file.jl>
  8. Test β€” run julia --project=julia/ julia/test/runtests.jl

Full conversion checklist with post-conversion verification β†’ translations/workflow.md

⚠️ Top Pitfalls

The most dangerous translation errors. Full rules (17 total) in references/critical-rules.md.

# Pitfall One-line fix
1 ct.full() doesn't exist in Julia Use fill(val, shape), zeros(T, dims...), or ones(T, dims...)
2 max(a, b) on tiles β†’ IRError Use max.(a, b) (broadcast dot)
3 IRError / MethodError mentioning IRStructurizer Compiler bug β€” file upstream with minimal reproducer
4 ct.launch arg order silently wrong Args are positional β€” match kernel signature exactly
5 ct.load with order β€” index positions wrong order remaps BOTH shape AND index (Critical Rule 16)

Worked Examples

Side-by-side Python β†’ Julia conversions matching the released Julia kernels in julia/kernels/. Each directory contains cutile_python.py (before) and cutile_julia.jl (after).

# Example Key Patterns When to Reference
01 add 1D ct.load/ct.store, alpha scaling, scalar broadcast, fill/zeros, keyword load/store Starting point; basic TMA + element-wise patterns
02 matmul muladd, TF32 conversion, K-loop with for, 2D swizzle, standard Julia layout, ct.@compiler_options MMA / tensor core operations
03 softmax Persistent scheduling, for loops, gather/scatter, padding_mode, multi-pass Large-tensor reduction patterns

These match the released kernels in julia/kernels/ (add.jl, matmul.jl, softmax.jl). The examples are simplified teaching versions β€” always consult julia/kernels/*.jl for the canonical, tested implementations.

Reference Documents

Category Document Content
Workflows translations/workflow.md Full conversion workflow with todo list, validation loop, checklist
Rules references/critical-rules.md 17 Critical Rules for cuTile Python β†’ Julia conversion
API references/api-mapping.md Python↔Julia bidirectional API mapping + kernel patterns
Testing references/testing.md Julia-native test patterns, tolerances, failure diagnosis
Debugging references/debugging.md Julia-specific error diagnosis + IR debug commands
Scripts scripts/validate_cutile_jl.py Static validation for Julia anti-patterns (run it)
Ground Truth julia/kernels/*.jl + julia/test/*.jl Actual working implementations in the codebase

Environment Setup

Prerequisite β€” Julia: this skill requires the Julia version declared in julia/Project.toml under [compat] julia. If julia --version is missing or older than that, install from the official Julia site at https://julialang.org/install/ following the verified installer instructions for your OS. Resume below once julia --version is compatible.

Then, from the repo root:

# Install Julia dependencies declared in julia/Project.toml
julia --project=julia/ -e 'using Pkg; Pkg.instantiate()'

# Run tests
julia --project=julia/ julia/test/runtests.jl

Requirements:

  • Julia (minimum version declared in julia/Project.toml under [compat] julia)
  • CUDA 13.1+ driver
  • Blackwell GPU (compute capability 10+)
  • Dependencies managed via julia/Project.toml: CUDA.jl, cuTile.jl, NNlib.jl, Test

Source: SKILL.md on GitHub

No third-party reports yet.

Signed by skilld at 2bf003b. This ties the file your Agent reads to that commit on GitHub. It does not review the instructions.

Last checked against GitHub 4 days ago.

Activeupdated 4 months ago
Other metadata
metadata
{
  "author": "TileGym Team <TileGym@nvidia.com>",
  "tags": [
    "cutile",
    "julia",
    "conversion",
    "gpu",
    "kernel"
  ]
}

README badge

README badge for nvidia/tilegym/tilegym-converting-cutile-to-julia