/finetuning

Full Pipeline Workflow

End-to-end fine-tuning on Microsoft Foundry in 9 phases.

Prerequisites

• Microsoft Foundry resource with fine-tuning enabled
• Python 3.10+ with openai and requests
• Azure CLI (az) authenticated
• A clear task definition: what should the model do differently after fine-tuning?

Phase 1: Define the Task

Answer before touching data or models:

1. What task? (e.g., "translate natural language to Python code")
2. What does good output look like? Write 5 examples by hand.
3. What does bad output look like? Write 3 anti-examples.
4. How will you measure success? Define evaluation dimensions (see references/grader-design.md).
5. Which base model? Pick 1-3 candidates from the supported model list.

Phase 2: Prepare the Dataset

Option A: You Have Data

1. Convert to SFT JSONL format (see references/dataset-formats.md)
2. Split: 80% train, 10% validation, 10% held-out test
3. Remove or fix low-quality examples

Option B: Synthetic Data

1. Generate using LLM prompts (see workflows/dataset-creation.md)
2. Convert to SFT JSONL with scripts/convert_dataset.py

Option C: Hybrid (Seed + Synthetic)

1. Use existing data as seed, generate synthetic variations
2. Merge, deduplicate, and quality-filter

Checkpoint: You should have training.jsonl, validation.jsonl, and test.jsonl (never used for training).

Phase 3: Establish Baselines

1. Deploy base model (or use existing deployment)
2. Record scores — this is your "zero" that every fine-tune must beat

Phase 4: Choose Training Type

See references/training-types.md for the full decision framework.

Most projects start with SFT. Move to RFT/DPO only if SFT isn't sufficient.

Phase 5: Upload and Submit Training

Use scripts/submit_training.py or the API directly. See references/hyperparameters.md for starting HP values.

Foundry CLI alternative (no Python):

azd ai finetuning jobs submit -f ./fine-tune-job.yaml

Phase 6: Monitor and Analyze

1. Wait for completion or use scripts/monitor_training.py
2. Analyze training curves with scripts/check_training.py
3. Read references/training-curves.md to interpret results
4. Check for overfitting — consider deploying an earlier checkpoint if detected

Phase 7: Evaluate Fine-Tuned Model

1. Deploy fine-tuned model (see references/deployment.md for format/SKU)
2. Compare against baseline and previous experiments
3. Delete deployment after evaluation

Phase 8: Iterate

Follow workflows/iterative-training.md:

• Adjust hyperparameters based on training curves
• Try different data subsets or augmentations
• Test different base models
• Track everything in your leaderboard

Phase 9: Ship

When the model convincingly beats baseline:

1. Deploy with production-appropriate capacity
2. Monitor with Application Insights
3. Periodically re-evaluate against test set for regression
4. Retrain as new data becomes available