LangSmith provides tracing, evaluation, and debugging workflows for LLM applications. This skill is useful when an agent team needs structured observability around prompts, chains, tool calls, datasets, and eval runs across multiple frameworks.
Scanned 6/8/2026
Install via CLI
Skills Directoryopenskills install agentskillexchange/skills---
name: "LangSmith SDK for LLM Tracing and Evaluation"
slug: "langsmith-sdk-for-llm-tracing-and-evaluation"
description: "LangSmith provides tracing, evaluation, and debugging workflows for LLM applications. This skill is useful when an agent team needs structured observability around prompts, chains, tool calls, datasets, and eval runs across multiple frameworks."
github_stars: 843
verification: "security_reviewed"
source: "https://github.com/langchain-ai/langsmith-sdk"
author: "langchain-ai"
category: "Monitoring & Alerts"
framework: "Multi-Framework"
tool_ecosystem:
github_repo: "langchain-ai/langsmith-sdk"
github_stars: 843
---
# LangSmith SDK for LLM Tracing and Evaluation
LangSmith provides tracing, evaluation, and debugging workflows for LLM applications. This skill is useful when an agent team needs structured observability around prompts, chains, tool calls, datasets, and eval runs across multiple frameworks.
## Installation
Use the upstream install or setup path that matches your environment:
- pip install -U langsmith
- pnpm add langsmith
Requirements and caveats from upstream:
- [](https://github.com/langchain-ai/langsmith-sdk/releases)
- [](https://pypi.org/project/langsmith/)
- This repository contains the Python and Javascript SDK's for interacting with the [LangSmith platform](https://smith.langchain.com/). Please see [LangSmith Documentation](https://docs.smith.langchain.com/)
Basic usage or getting-started notes:
- bash
- export LANGSMITH_TRACING=true
- export LANGSMITH_API_KEY=ls_...
- Source: https://github.com/langchain-ai/langsmith-sdk
- Extracted from upstream docs: https://raw.githubusercontent.com/langchain-ai/langsmith-sdk/HEAD/README.md
## Source
- [Agent Skill Exchange](https://agentskillexchange.com/skills/langsmith-sdk-for-llm-tracing-and-evaluation/)
No comments yet. Be the first to comment!
Ultra-compressed communication mode. Cuts token usage ~75% by speaking like caveman while keeping full technical accuracy. Supports intensity levels: lite, full (default), ultra, wenyan-lite, wenyan-full, wenyan-ultra. Use when user says "caveman mode", "talk like caveman", "use caveman", "less tokens", "be brief", or invokes /caveman. Also auto-triggers when token efficiency is requested.
Adversarial multi-agent planning skill. Self-orchestrates 5 hostile category members (unspecified-low, unspecified-high, deep, ultrabrain, artistry) via team-mode for ruthless cross-critique debate, distills only the defensible insights, then MANDATORILY hands the distilled insight bundle to the `plan` agent for executable plan formalization. Use when planning needs maximum rigor and surfacing of weak assumptions, blind spots, and over-engineering. Triggers: 'hyperplan', 'hpp', '/hyperplan', ...
**Complete production-ready guide for Google Gemini embeddings API** This skill provides comprehensive coverage of the `gemini-embedding-001` model for generating text embeddings, including SDK usage, REST API patterns, batch processing, RAG integration with Cloudflare Vectorize, and advanced use cases like semantic search and document clustering. ---
Interview, source-challenge, verify, save, and ADR-gate fuzzy coding requests into Codex-ready implementation specs. Use when a feature, bugfix, refactor, migration, repo-wide change, or architecture task needs user-verified requirements, source-backed decisions, durable architecture decisions, acceptance criteria, validation commands, rollout notes, saved spec/ADR files, and a Codex execution prompt. Do not use when already fully specified or when the user wants direct implementation now.
Use when a repo needs CodeGraph plus ast-grep for Codex MCP setup, exploration, impact analysis, structural search, or safe refactor planning.
