Use when testing an agent or LLM application offline in LangSmith before it ships, including building and maintaining evaluation datasets, writing the target function and evaluators, aligning LLM judges with human labels, running and comparing experiments, and diagnosing why an experiment scored badly.
Repository statistics
Indexed skills
5
Skill groups
1
GitHub stars
1,349
Forks
112
Skills
5 totalUse when monitoring an agent or LLM application in production, including choosing quality signals, scoring live runs or threads with online evaluators in LangSmith, and turning the resulting feedback into alerts, review queues, or failure analysis. Covers LLM judges, code evaluators, decision models, and targeted judge chains.
Use when adding, fixing, or reviewing LangSmith tracing for an agent or LLM application, including choosing instrumentation for LangChain, LangGraph, Deep Agents, other agent frameworks, or OpenTelemetry; sending traces to the right agent environment or project; grouping turns into threads; metadata; sampling and conditional tracing; redacting sensitive data; distributed tracing across services; and finding traces after they land.
Inspect an agent repository and optional traces, interview the user, write reviewed Task Specs, build and audit Harbor tasks, and bootstrap reusable project World Knowledge Skills. Use for agent evals, benchmark design, Task generation, controlled Environments, synthetic data, Verifiers, Harbor runs, calibration, or continuous benchmark maintenance.
Provides the latest guidance for building or modifying LLM applications with the LangChain open source libraries: Deep Agents, LangGraph, and LangChain, including how the libraries best fit together. The stack evolves quickly, so it's important to verify prior knowledge against this guidance. Also covers when Managed Deep Agents fits.
Add to your README
The badge links readers to this page. It shows the skilld mark and no counts, and it follows the reader's light or dark GitHub theme.
<a href="https://skilld.dev/gh/langchain-ai/langchain-skills">
<picture>
<source media="(prefers-color-scheme: dark)" srcset="https://skilld.dev/b/langchain-ai/langchain-skills?theme=dark">
<source media="(prefers-color-scheme: light)" srcset="https://skilld.dev/b/langchain-ai/langchain-skills?theme=light">
<img alt="Skill repository on skilld.dev" src="https://skilld.dev/b/langchain-ai/langchain-skills?theme=light">
</picture>
</a>