skilld
All skills
microsoft avatar

/microsoft-foundry

@04110d9
by microsoftmicrosoft/skills3.1k stars
351

Build, deploy, evaluate, optimize, fine-tune, and manage Microsoft Foundry agents, models, and resources end to end. USE FOR: foundry, azd ai agent, azd provision/deploy, hosted agent scaffold/develop/run/deploy/troubleshoot, prompt agent create, create agent, update agent, add tool to agent, invoke agent, agent.yaml, agent insights, pull agent insights, evaluate agent, batch eval, continuous eval, continuous monitoring, agent CI/CD, optimize prompt, improve prompt, prompt optimizer, optimize agent instructions, Agent Optimizer scaffold, dataset curation from traces, deploy model, model fine-tuning (SFT/DPO/RFT), Foundry project, RBAC, role assignment, permissions, quota, capacity, region, deployment failure, AI Services, create Foundry resource, knowledge index, customize deployment, onboard, availability, training-data, grader, distillation, large file upload. DO NOT USE FOR: Azure Functions, App Service, general Azure deploy (use azure-deploy), general Azure prep (use azure-prepare).

Ask your Agent

Use this Skill: https://skilld.dev/gh/microsoft/skills/microsoft-foundry

This session only. Nothing lands on disk.

foundry-agentobservereferencesoptimize-deploy.md

≈395 tokens on demand. Your agent reads this file only when SKILL.md points to it.

Steps 6–7 — Optimize Prompt & Deploy New Version

Step 6 — Optimize Prompt

⛔ Guardrail: When optimizing after a dataset update, do NOT remove dataset rows or weaken evaluators to recover scores. Score drops on a harder dataset are expected — they mean test coverage improved, not that the agent regressed. Optimize for NEW failure patterns only.

Use prompt_optimize with:

Parameter Required Description
developerMessage ✅ Agent's current system prompt / instructions
deploymentName ✅ Model for optimization (e.g., gpt-4o-mini)
projectEndpoint or foundryAccountResourceId ✅ At least one required
requestedChanges Concise improvement suggestions from cluster analysis

Example requestedChanges: "Be more specific when answering geography questions", "Always cite sources when providing factual claims"

Use the optimized prompt returned by the tool. Do NOT manually rewrite.

Step 7 — Deploy New Version

Always confirm before deploying. Show the user a diff or summary of prompt changes and wait for explicit sign-off.

After approval:

  1. Use agent_update to create a new agent version with the optimized prompt
  2. Use agent_get to verify the updated version is running
  3. If the updated version is not running, read and follow the troubleshoot skill before continuing

Next Steps

When the new version is running → proceed to Step 8: Re-Evaluate.

Source: SKILL.md on GitHub

Third-party checks

2 warnings3d4 checks · Risk SAFE
  • Gen Agent Trust Hub3d

    This skill provides a comprehensive environment for managing the end-to-end lifecycle of AI agents, models, and infrastructure on Microsoft Foundry. It includes sub-skills for deployment, evaluation, fine-tuning, and troubleshooting. The skill utilizes dynamic code execution and shell command wrappers, which are used within the context of local development and cloud orchestration. All external resources and dependencies originate from trusted organizations and well-known services.

  • Socket3d

    2 alerts: gptSecurity, gptAnomaly

  • Snyk3d

    Risk: LOW · No issues

  • Runlayer7mo

    36/36 files flagged

Provenance

Signed by skilld at 04110d9. This ties the file your Agent reads to that commit on GitHub. It does not review the instructions.

Last checked against GitHub 19 hours ago.

Activeupdated last week

Capability

metadata
{
  "author": "Microsoft",
  "version": "1.2.26"
}

README badge

README badge for microsoft/skills/microsoft-foundry