LangSmith

SKILL.md

---
name: oo-langsmith
description: "LangSmith (langchain.com). Use this skill for ANY LangSmith request — reading, creating, and updating data. Whenever a task involves LangSmith, use this skill instead of calling the API directly."
allowed-tools: [Bash(oo *)]
metadata:
  title: "LangSmith"
  author: "OOMOL"
  version: "1.0.0"
  services: ["langsmith"]
  icon: "https://static.oomol.com/logo/third-party/langsmith.svg"
---

# LangSmith

Operate **LangSmith** through your OOMOL-connected account. This skill calls the `langsmith` connector with the [oo CLI](https://github.com/oomol-lab/oo-cli); OOMOL injects credentials server-side, so you never handle raw tokens.

## Running an action

Assume the user has already installed the oo CLI, signed in, and connected LangSmith. **Do not run `oo auth login` or open the connection URL proactively — just run the action.** Fall back to [First-time setup](#first-time-setup) only when a command actually fails with an auth or connection error.

**1. Inspect the contract** to get the authoritative input/output schema before building a payload:

```bash
oo connector schema "langsmith" --action "<action_name>"
```

**2. Run the action** with a JSON payload that matches the input schema:

```bash
oo connector run "langsmith" --action "<action_name>" --data '<json>' --json
```

- `--data` takes a JSON object string or `@path/to/file.json`; omit it to send `{}`.
- The response is `{ "data": ..., "meta": { "executionId": "..." } }`; the execution id lives under `meta.executionId`.

Each action is listed below with a one-line description; actions that change state carry a `[write]` or `[destructive]` tag. Before constructing `--data`, fetch the action's live schema with `oo connector schema` to get its authoritative input fields.

## Available actions

- `create_dataset` — Create a LangSmith dataset. [write]
- `create_example` — Create a LangSmith dataset example with JSON inputs, outputs, and metadata. [write]
- `create_project` — Create a LangSmith tracing project. [write]
- `get_dataset` — Get a LangSmith dataset by ID.
- `get_example` — Get a LangSmith dataset example by ID.
- `get_project` — Get a LangSmith tracing project by ID.
- `list_datasets` — List LangSmith datasets with optional name, type, and pagination filters.
- `list_examples` — List LangSmith dataset examples with optional dataset and text filters.
- `list_projects` — List LangSmith tracing projects with optional name and pagination filters.
- `list_workspaces` — List LangSmith workspaces visible to the connected API key.

## Safety

- Untagged actions are reads (get / list / search) — safe to run directly.
- **Actions tagged `[write]` change LangSmith state — confirm the exact payload and effect with the user before running.**
- **Actions tagged `[destructive]` remove or overwrite data — always confirm the target and get explicit approval first.**

## First-time setup

These are **one-time** steps — do not repeat them on every call. Run a step only when a command fails for the matching reason.

- **`oo: command not found`** — install the oo CLI (other platforms: <https://cli.oomol.com/install-guide.md>):

  ```bash
  curl -fsSL https://cli.oomol.com/install.sh | bash    # macOS / Linux
  ```

  ```powershell
  irm https://cli.oomol.com/install.ps1 | iex           # Windows PowerShell
  ```

- **Not signed in / authentication error** — sign in to your OOMOL account once:

  ```bash
  oo auth login
  ```

- **`scope_missing` / `credential_expired` / `app_not_ready` / `app_not_found`** — LangSmith is not connected, or the connection expired or lacks a scope. Connect once (auth type: API key) at:

  ```text
  https://console.oomol.com/app-connections?provider=langsmith
  ```

- **HTTP 402 / `OOMOL_INSUFFICIENT_CREDIT`** — billing stop. Recharge at `https://console.oomol.com/billing/token-recharge` before retrying.

## Resources

- LangSmith homepage: https://www.langchain.com/langsmith