Skip to content

Conversation

@ayoung19
Copy link
Contributor

@ayoung19 ayoung19 commented Nov 4, 2025

Overview

Type of change

Type: Update existing documentation

Related issues/PRs

  • GitHub issue:
  • Feature PR:
  • Linear issue: LS-5491
  • Slack thread:

Checklist

  • I have read the contributing guidelines
  • I have tested my changes locally using docs dev
  • All code examples have been tested and work correctly
  • I have used root relative paths for internal links
  • I have updated navigation in src/docs.json if needed
  • I have gotten approval from the relevant reviewers
  • (Internal team members only / optional) I have created a preview deployment using the Create Preview Branch workflow

Additional notes

@ayoung19 ayoung19 requested a review from katmayb as a code owner November 4, 2025 09:47
Copilot AI review requested due to automatic review settings November 4, 2025 09:47
@github-actions github-actions bot added the langsmith For docs changes to LangSmith label Nov 4, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Nov 4, 2025

Mintlify preview ID generated: preview-LS5491-1762249709-e1c3492

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR updates the custom output rendering documentation to reflect a new feature: configuring custom rendering at the annotation queue level in addition to the dataset level. The documentation has been reorganized to improve clarity and flow, removing API configuration examples and streamlining the content.

Key changes:

  • Added annotation queue-level custom rendering configuration alongside existing dataset-level configuration
  • Reorganized content flow by removing the separate "Overview" section and integrating its content into the introduction
  • Removed API configuration instructions (Python/TypeScript code examples) and "Prerequisites" section

![Run detail pane showing custom rendering](/langsmith/images/custom-output-rendering-run-details.png)

- **Annotation queues**: When experiments are added to annotation queues for review:
- **Annotation queues**: When reviewing runs in annotation queues:
Copy link

Copilot AI Nov 4, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[nitpick] Consider using a more specific verb. 'When reviewing runs' could be 'When you review runs' to maintain consistency with the second-person voice per the style guide.

Suggested change
- **Annotation queues**: When reviewing runs in annotation queues:
- **Annotation queues**: When you review runs in annotation queues:

Copilot uses AI. Check for mistakes.
Configure custom rendering at two levels:

- **For datasets**: Apply custom rendering to all runs associated with that dataset, wherever they appear—in experiments, run detail panes, or annotation queues.
- **For annotation queues**: Apply custom rendering to all runs within a specific annotation queue, regardless of which dataset they come from. This takes precedence over dataset-level configuration.
Copy link

Copilot AI Nov 4, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[nitpick] The precedence note appears twice (here and in the Info box at line 52-54). Consider removing the precedence mention from line 22 to avoid redundancy, keeping only the more prominent Info callout.

Suggested change
- **For annotation queues**: Apply custom rendering to all runs within a specific annotation queue, regardless of which dataset they come from. This takes precedence over dataset-level configuration.
- **For annotation queues**: Apply custom rendering to all runs within a specific annotation queue, regardless of which dataset they come from.

Copilot uses AI. Check for mistakes.
@ayoung19 ayoung19 merged commit 06966d7 into main Nov 4, 2025
17 checks passed
@ayoung19 ayoung19 deleted the LS-5491 branch November 4, 2025 23:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

langsmith For docs changes to LangSmith

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants