Skip to content

Harden Braintrust tracing and online scoring - #18

Open
samsel wants to merge 2 commits into
mainfrom
fix/braintrust-online-scoring-tracing
Open

Harden Braintrust tracing and online scoring#18
samsel wants to merge 2 commits into
mainfrom
fix/braintrust-online-scoring-tracing

Conversation

@samsel

@samsel samsel commented Jun 30, 2026

Copy link
Copy Markdown
Owner

Summary

  • codify Braintrust online scoring setup with shared scorer slugs and a repeatable setup command
  • align Braintrust project naming across production tracing, evals, and scorer pushes
  • convert xAI image generation into a child Braintrust span with image artifacts and metadata instead of a flat manual log

Verification

  • pnpm exec tsc --noEmit
  • pnpm test:unit
  • pnpm check:boundaries
  • pnpm braintrust:setup-online-scoring:dry-run -- --json
  • pnpm exec tsx --import ./evals/server-only-shim.mjs -e "import('./braintrust/online-scorers.ts').then(() => console.log('online scorers loaded'))"
  • pnpm build

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant