/

/airunway-aks-setup

351

Set up AI Runway on AKS — from bare cluster to running model. Covers cluster verification, controller install, GPU assessment, provider setup, and first deployment. WHEN: "setup AI Runway", "onboard AKS cluster", "install AI Runway", "airunway setup", "deploy model to AKS", "GPU inference on AKS", "KAITO setup on AKS", "run LLM on AKS", "vLLM on AKS", "set up model serving on AKS", "AI Runway controller".

11 files
24.1 KB
MIT
Updated 2 months ago
GitHub
No alerts

Ask your Agent

Use this Skill: https://skilld.dev/gh/microsoft/skills/airunway-aks-setup

This session only. Nothing lands on disk.

referencesstepsstep-3-gpu.md

834 B raw

≈209 tokens on demand. Your agent reads this file only when SKILL.md points to it.

Step 3 — GPU Assessment

Goal: Match detected hardware to known profiles and surface compatibility constraints.

Load and consult gpu-profiles.md.

For each GPU type detected in Step 1:

Look up the model in gpu-profiles.md
Report: VRAM per card, total cluster VRAM, supported dtypes, recommended attention backend
Surface compatibility warnings:

GPU	Warning
T4	Does not support bfloat16. Set `--dtype float16` in serving args.
V100	Does not support bfloat16; limited flash attention. Use xformers backend.

CPU-only path: Note CPU-only inference is available via KAITO + llama.cpp. Recommend google/gemma-3-1b-it-qat-q8_0-gguf.

Use the Model Sizing Guide in model-sizing.md to calculate maximum model size for the cluster.

Source: SKILL.md on GitHub

Third-party checks

No alerts15d3 checks · Risk SAFE

Gen Agent Trust Hub15d
This skill provides a structured walkthrough for setting up AI Runway on Azure Kubernetes Service (AKS). It includes cluster verification, controller installation, hardware assessment, and model deployment using standard tools like kubectl and make. The skill follows secure practices for handling HuggingFace tokens and manages infrastructure transparently within the user's provided Kubernetes context.
Socket15d
No alerts
Snyk15d
Risk: LOW · No issues

Provenance

Signed by skilld at b3c238e. This ties the file your Agent reads to that commit on GitHub. It does not review the instructions.

Last checked against GitHub yesterday.

Activeupdated 2 months ago

Capability

metadata: { "author": "Microsoft", "version": "1.1.1" }
argument-hint: [skip-to-step N]

/airunway-aks-setup