All skills
microsoft avatar

/microsoft-foundry

@04110d9
by microsoftmicrosoft/skills3.1k stars
351

Build, deploy, evaluate, optimize, fine-tune, and manage Microsoft Foundry agents, models, and resources end to end. USE FOR: foundry, azd ai agent, azd provision/deploy, hosted agent scaffold/develop/run/deploy/troubleshoot, prompt agent create, create agent, update agent, add tool to agent, invoke agent, agent.yaml, agent insights, pull agent insights, evaluate agent, batch eval, continuous eval, continuous monitoring, agent CI/CD, optimize prompt, improve prompt, prompt optimizer, optimize agent instructions, Agent Optimizer scaffold, dataset curation from traces, deploy model, model fine-tuning (SFT/DPO/RFT), Foundry project, RBAC, role assignment, permissions, quota, capacity, region, deployment failure, AI Services, create Foundry resource, knowledge index, customize deployment, onboard, availability, training-data, grader, distillation, large file upload. DO NOT USE FOR: Azure Functions, App Service, general Azure deploy (use azure-deploy), general Azure prep (use azure-prepare).

Use this Skill: https://skilld.dev/gh/microsoft/skills/microsoft-foundry

This session only. Nothing lands on disk.

foundry-agenttroubleshoottroubleshoot.md

≈1.6k tokens on demand. Your agent reads this file only when SKILL.md points to it.

Foundry Agent Troubleshoot

Troubleshoot and debug Foundry agents by collecting Hosted Agent logs with azd, discovering observability connections, and querying Application Insights telemetry.

Quick Reference

Property Value
MCP servers azure
Hosted Agent CLI azd ai agent show, sessions, monitor
Related skills trace (telemetry analysis)
Preferred query tool monitor_resource_log_query (Azure MCP) — preferred over azure-kusto for App Insights
CLI references azd ai agent show, azd ai agent sessions, azd ai agent monitor, az cognitiveservices account connection

When to Use This Skill

  • Agent is not responding or returning errors
  • Hosted agent version is not becoming active
  • Need to view hosted-agent session logs
  • Diagnose latency or timeout issues
  • Query Application Insights for agent traces and exceptions
  • Investigate agent runtime failures

Workflow

Step 1: Collect Agent Information

Use the project endpoint and agent name from the project context (see Common Project Context Resolution). Ask the user only for values not already resolved:

  • Project endpoint — Microsoft Foundry project endpoint URL
  • Agent name — Name of the agent to troubleshoot

Step 2: Identify a Hosted Agent

Treat an azure.yaml service with host: azure.ai.agent as Hosted. Run:

azd ai agent show --output json

If azd returns Hosted Agent details, proceed to Step 3. If the command fails for an identified Hosted Agent, diagnose the reported error instead of proceeding to Step 4. Proceed to Step 4 only when azure.yaml has no Hosted Agent service.

Step 3: Retrieve Logs (Hosted Agents Only)

Hosted Agent logs are scoped to sessions. Use azd for session discovery and log retrieval.

invocations_ws agents: use the client-supplied agent_session_id from the WebSocket upgrade URL. It is not created by azd ai agent invoke. Pass it to azd ai agent monitor --session-id. See the invocations-ws skill for the URL contract.

  1. Check agent version status. Use the result from Step 2 and verify that the deployed version is active.

  2. Read logs from the current session. monitor automatically reuses the session saved by the last azd invoke:

    azd ai agent monitor --tail 100
  3. Select another session when needed. If no session is saved or the user needs a different one, run:

    azd ai agent sessions list --output table
    azd ai agent monitor --session-id <session-id> --tail 100

    In multi-agent projects, add --agent-name <service-name> to sessions list and pass the service name positionally to monitor. Pass the same --user-identity used for invoke when header-based isolation is enabled.

  4. Choose the log stream. Use --follow for live logs and --type system for container events:

    azd ai agent monitor --session-id <session-id> --follow
    azd ai agent monitor --session-id <session-id> --type system
  5. Interpret the logs. Review stdout, stderr, and system events. Highlight errors and warnings.

If no session exists, use azd ai agent invoke to trigger the Hosted Agent only when remote invocation is within the user's request.

Step 4: Discover Observability Connections

List the project connections to find Application Insights or Azure Monitor resources using the Azure CLI command documented at: az cognitiveservices account connection

Refer to the documentation above for the exact command syntax and parameters. Look for connections of type ApplicationInsights or AzureMonitor in the output.

If no observability connection is found, inform the user and suggest setting up Application Insights for the project. Ask if they want to proceed without telemetry data.

Step 5: Query Application Insights Telemetry

Use monitor_resource_log_query (Azure MCP tool) to run KQL queries against the Application Insights resource discovered in Step 4. This is preferred over delegating to the azure-kusto skill. Pass the App Insights resource ID and the KQL query directly.

⚠️ Always pass subscription explicitly to Azure MCP tools like monitor_resource_log_query — they don't extract it from resource IDs.

Use * contains "<response_id>" or * contains "<agent_name>" filters to narrow down results to the specific agent instance.

Step 6: Summarize Findings

Present a summary to the user including:

  • Agent status — Hosted Agent version status when available
  • Log errors — key errors from hosted-agent session logs
  • Telemetry insights — exceptions, failed requests, latency trends
  • Recommended actions — specific steps to resolve identified issues

Error Handling

Error Cause Resolution
Agent not found Invalid agent name or project endpoint Verify the azure.yaml service name and run azd ai agent show
Hosted Agent not active Hosted Agent is still provisioning or failed Check deployment status, identity permissions, and system logs, then recheck status
Session logs unavailable The session does not exist or has not been invoked Run azd ai agent sessions list; invoke with azd when authorized, then retry monitor
No saved session ID azd has not persisted an invoke session Select one from azd ai agent sessions list and pass --session-id
No observability connection Application Insights not configured for the project Suggest configuring Application Insights for the Foundry project
Kusto query failed Invalid cluster/database or insufficient permissions Verify Application Insights resource details and reader permissions
No telemetry data Agent not instrumented or too recent Check if Application Insights SDK is configured; data may take a few minutes to appear

Additional Resources

Source: SKILL.md on GitHub

2 warnings3d4 checks · Risk SAFE
  • Gen Agent Trust Hub3d

    This skill provides a comprehensive environment for managing the end-to-end lifecycle of AI agents, models, and infrastructure on Microsoft Foundry. It includes sub-skills for deployment, evaluation, fine-tuning, and troubleshooting. The skill utilizes dynamic code execution and shell command wrappers, which are used within the context of local development and cloud orchestration. All external resources and dependencies originate from trusted organizations and well-known services.

  • Socket3d

    2 alerts: gptSecurity, gptAnomaly

  • Snyk3d

    Risk: LOW · No issues

  • Runlayer7mo

    36/36 files flagged

Signed by skilld at 04110d9. This ties the file your Agent reads to that commit on GitHub. It does not review the instructions.

Last checked against GitHub yesterday.

Activeupdated last week
metadata
{
  "author": "Microsoft",
  "version": "1.2.26"
}

README badge

README badge for microsoft/skills/microsoft-foundry