Index of every page on this site: llms.txt
All skills
microsoft avatar

/airunway-aks-setup

@0d60658
by microsoftmicrosoft/skills3.2k stars
373
Run it yourself

Set up AI Runway on AKS — from bare cluster to running model. Covers cluster verification, controller install, GPU assessment, provider setup, and first deployment. WHEN: "setup AI Runway", "onboard AKS cluster", "install AI Runway", "airunway setup", "deploy model to AKS", "GPU inference on AKS", "KAITO setup on AKS", "run LLM on AKS", "vLLM on AKS", "set up model serving on AKS", "AI Runway controller".

Use this Skill: https://skilld.dev/gh/microsoft/skills/airunway-aks-setup

Nothing lands on disk. Nothing to clean up.

Fork this Skill

Edit a local copy. It keeps the author and licence.

SKILL.md

≈108 tokens for metadata: the name and description. ≈981 when used: this file. ≈5.4k more on demand in 11 files.

Description uses 5.4% of example budget

Before choosing a Skill, your Agent reads its name and description. All available Skills share that space.

  • A shorter description leaves more room for other Skills. This entry exceeds our 1% size suggestion.

In our Claude Code example, all Skill names and descriptions share 8,000 characters. This Skill uses ≈429 characters, or 5.4%.

The 1% threshold is a size suggestion. Longer descriptions can still fit.

Your model, settings, and other Skills decide how much text your Agent can read.

Example settings and source

The example uses a 200k-token context and default Claude Code settings. The count includes the name, description, separators, and when_to_use when present. Codex also counts local file paths.

Skit's source and limits: Codex 0.160.1, Claude Code 2.1.292.

AI Runway AKS Setup

This skill walks users from a bare Kubernetes cluster to a running AI model deployment. Follow each step in sequence unless the user provides skip-to-step N to resume from a specific phase.

Cost awareness: GPU node pools incur significant compute charges (A100-80GB can cost $3–5+/hr). Confirm the user understands cost implications before provisioning GPU resources.

Prerequisites

This skill assumes an AKS cluster already exists. If the user does not have a cluster, hand off to the azure-kubernetes skill first to provision one (with a GPU node pool unless CPU-only inference is acceptable), then return here.

Quick Reference

Property Value
Best for End-to-end AI Runway onboarding on AKS
CLI tools kubectl, make, curl
MCP tools None
Related skills azure-kubernetes (cluster setup), azure-diagnostics (baseline troubleshooting), optional aks-gpu-inference (existing GPU/inference Day-2 incidents only)

When to Use This Skill

Use this skill when the user wants to:

  • Set up AI Runway on an existing AKS cluster from scratch
  • Install the AI Runway controller and CRDs
  • Assess GPU hardware compatibility for model deployment
  • Choose and install an inference provider (KAITO, Dynamo, KubeRay)
  • Deploy their first AI model to AKS via AI Runway
  • Resume a partially-complete AI Runway setup from a specific step

GPU setup versus Day-2 incidents

Keep initial GPU node-pool, provider, controller, and model setup in this skill. For an incident affecting an existing GPU or inference deployment, load optional-gpu-day2.md before deciding whether to offer the focused optional add-on.

MCP Tools

This skill uses no MCP tools. All cluster operations are performed directly via kubectl and make.

Rules

  1. Execute steps in sequence — load the reference for each step as you reach it
  2. Report cluster state at each step: ✓ healthy, ✗ missing/failed
  3. Ask for user confirmation before any install or deployment action
  4. If a step is already complete, report status and skip to the next step
  5. If the user provides skip-to-step N, start at step N; assume prior steps are complete

Steps

# Step Reference
1 Cluster Verification — context check, node inventory, GPU detection step-1-verify.md
2 Controller Installation — CRD + controller deployment step-2-controller.md
3 GPU Assessment — detect GPU models, flag dtype/attention constraints step-3-gpu.md
4 Provider Setup — recommend and install inference provider step-4-provider.md
5 First Deployment — pick a model, deploy, verify Ready step-5-deploy.md
6 Summary — recap, smoke test, next steps step-6-summary.md

Error Handling

Error / Symptom Likely Cause Remediation
No kubeconfig context Not connected to a cluster Run az aks get-credentials or equivalent
Controller in CrashLoopBackOff Config or RBAC issue kubectl logs -n airunway-system -l control-plane=controller-manager --previous
Provider not ready Image pull or RBAC issue kubectl logs <pod-name> -n <namespace> for the provider pod
ModelDeployment stuck in Pending GPU scheduling failure or provider not ready kubectl describe modeldeployment <name> -n <namespace> events
bfloat16 errors at inference T4 or V100 lacks bfloat16 support Add --dtype float16 to serving args

For full error handling and rollback procedures, see troubleshooting.md.

Source: SKILL.md on GitHub

skilld matched fixed text patterns in SKILL.md and file names. Patterns miss obfuscated code.

skilld run checks every file with the same patterns. It asks for approval before it loads a Skill with a behavior marked Needs approval.

No alerts1mo3 checks · Risk SAFE
  • Gen Agent Trust Hub1mo

    This skill provides a structured workflow for deploying AI models on Azure Kubernetes Service (AKS) using AI Runway. It includes considerations for hardware compatibility and follows recommended security practices for managing credentials via Kubernetes Secrets. The skill interacts with cluster metadata and model outputs, which is standard for Kubernetes management tasks.

  • Socket1mo

    No alerts

  • Snyk1mo

    Risk: LOW · No issues

Signed by skilld at 0d60658. This ties the file your Agent reads to that commit on GitHub. It does not review the instructions.

Last checked against GitHub yesterday.

Activeupdated last month
metadata
{
  "author": "Microsoft",
  "version": "1.1.2"
}
argument-hint
[skip-to-step N]

README badge

README badge for microsoft/skills/airunway-aks-setup