Skip to content

docs(mastra): Document classifier evaluation tracing - #19878

Merged
andreiborza merged 2 commits into
masterfrom
docs/mastra-classifier-evaluations
Oct 9, 2026
Merged

andreiborza merged 2 commits into
masterfrom
docs/mastra-classifier-evaluations

Conversation

@sentry-junior

@sentry-junior sentry-junior Bot commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

DESCRIBE YOUR PR

Document tracing of Mastra Classifier evaluations (for example Jev), which now show up as gen_ai.evaluate spans. The new section in the Mastra guide covers a setup example, the data captured, how Mastra's span output processors filter it, and privacy controls. It follows the Vercel AI Jev section from #19692. The Mastra span mapping table gets a CLASSIFIER_EVALUATION row, and the TypeSafe page now links to the new section.

Shipped in Sentry JavaScript SDK 11.6.0 via getsentry/sentry-javascript#25044. Mastra added Classifier in @mastra/core 1.69.0.

IS YOUR CHANGE URGENT?

  • Urgent deadline (GA date, etc.): YYYY-MM-DD
  • Other deadline: YYYY-MM-DD
  • No deadline: Not urgent, can wait up to 1 week+

via Andrei Borza.

--

View Junior Session [Sentry]

Co-Authored-By: Andrei Borza <andrei.borza@sentry.io>
@vercel

vercel Bot commented Oct 9, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
sentry-docs Ready Ready Preview Oct 9, 2026 12:01pm UTC
1 Skipped Deployment
Project Deployment Actions Updated
develop-docs Ignored Ignored Preview Oct 9, 2026 12:01pm UTC

Request Review

@github-actions github-actions Bot added the Priority: Normal Docs review has no urgent deadline label Oct 9, 2026
@cursor

cursor Bot commented Oct 9, 2026 •

Copy link
Copy Markdown
Contributor

The plan checks page duration, 5xx responses, and error events on the changed guide pages. An issue escalates when 5xx responses appear or error events rise from zero.

Monitoring in production

Services: sentry-docs.

Mention @change-monitor in a comment to update the plan.

Plan

What changed

The Mastra guide now documents Classifier evaluation tracing. Those evaluations now show as gen_ai.evaluate spans. The span map table now includes CLASSIFIER_EVALUATION. The shared span map table also ships on the Mastra Cloudflare guide. The TypeSafe page now links to that Mastra section. sentry-docs must deploy before this text is live.

Risk

A broken include can fail both Mastra guide pages. A markdown fault can fail the TypeSafe page. Readers then see an error page instead of the guide. The blast stays on those JavaScript guide pages.

Intended effect

This change only adds documentation. Telemetry cannot show the new heading or table row. The executor cannot confirm the new text from Sentry. Treat intended_effect as unknown. Absent would mean the live Mastra guide still lacks the Classifier section.

Regression watch

Traces sample at 30 percent. Span counts are sampled. Sitewide /:path*? p50-p95 was 89-907ms in this window. Mastra and TypeSafe page duration should stay inside that band. Mastra pages produced 287 /:path*? spans. TypeSafe pages produced 103. Sitewide /:path*? volume was 1,120,443 spans. Escalate if either page count falls to zero while sitewide volume holds.

Watch Baseline Window Source Escalate when
5xx on Mastra or TypeSafe URLs 0 responses 2026-10-08T10:00:00Z to 2026-10-09T10:00:00Z Sentry org sentry project docs. Query environment:production http.status_code:>=500 with http.url matching those paths any 5xx appears
Error events on Mastra or TypeSafe URLs 0 events 2026-10-08T10:00:00Z to 2026-10-09T10:00:00Z Sentry org sentry project docs. Query environment:production with url matching /platforms/javascript/guides/mastra/ or /configuration/integrations/typesafe count rises above 0
Mastra /:path*? p75 duration 241ms, hold inside 89-907ms 2026-10-08T10:00:00Z to 2026-10-09T10:00:00Z Sentry org sentry project docs. Query environment:production transaction:"/:path*?" with Mastra http.target or http.url p75 rises above 907ms
TypeSafe /:path*? p75 duration 403ms, hold inside 89-907ms 2026-10-08T10:00:00Z to 2026-10-09T10:00:00Z Sentry org sentry project docs. Query environment:production transaction:"/:path*?" with TypeSafe http.target or http.url p75 rises above 907ms

If error events rise, inspect code tabs and MDX render on those pages.

Not observable

Live page content is not in Sentry. The new heading, table row, and anchor are not queryable. Client LCP is not available for these paths. Transactions use the catch-all /:path*? name. Pageload transaction.op returned no rows.

Keep the Quick Start focused on setup and document classifier
evaluation tracing under the Mastra Agent Tracing section, like
Workers AI for Cloudflare.

Co-Authored-By: Andrei Borza <andrei.borza@sentry.io>
@andreiborza
andreiborza merged commit f84bdac into master Oct 9, 2026
27 checks passed
@andreiborza
andreiborza deleted the docs/mastra-classifier-evaluations branch October 9, 2026 12:13
andreiborza added a commit that referenced this pull request Oct 9, 2026
## DESCRIBE YOUR PR

Document tracing of `TypeSafeClassifier` runs from
`@langchain/typesafe`, which now show up as `gen_ai.evaluate` spans.
This applies to standalone calls, calls from LangGraph nodes, and the
classifiers that the `@langchain/typesafe` agent middleware creates.

The LangChain page gets a new section with a setup example, the data
captured, and privacy controls, plus the supported `@langchain/typesafe`
range. The LangGraph page gets a short section with a `StateGraph` node
example that points to the LangChain section. The TypeSafe page now
links to it. This follows the Mastra classifier section from #19878. The
new sections are hidden on Cloudflare because the SDK has no test
coverage there.

Shipped in [Sentry JavaScript SDK
11.6.0](https://github.com/getsentry/sentry-javascript/releases/tag/11.6.0)
via getsentry/sentry-javascript#25120, with agent and LangGraph coverage
in getsentry/sentry-javascript#25132.

## IS YOUR CHANGE URGENT?

- [ ] Urgent deadline (GA date, etc.):
- [ ] Other deadline:
- [x] None: Not urgent, can wait up to 1 week+

## PRE-MERGE CHECKLIST

- [ ] Checked Vercel preview for correctness, including links
- [ ] PR was reviewed and approved by any necessary SMEs (subject matter
experts)
- [ ] PR was reviewed and approved by a member of the [Sentry docs
team](https://github.com/orgs/getsentry/teams/docs)

<!-- junior-request-attribution:start -->
via **Andrei Borza**.
<!-- junior-request-attribution:end -->

<!-- junior-session-footer:start -->
<!-- junior-conversation-id:slack%3AC0BKK9QLCUA%3A1791540225.414269 -->

--

[View Junior
Session](https://junior-prod.sentry.dev/conversations/slack%3AC0BKK9QLCUA%3A1791540225.414269)
[[Sentry]](https://sentry.sentry.io/explore/conversations/slack%3AC0BKK9QLCUA%3A1791540225.414269/?project=4510944073809921)

<!-- junior-session-footer:end -->

---------

Co-authored-by: sentry-junior[bot] <264270552+sentry-junior[bot]@users.noreply.github.com>
Co-authored-by: Andrei Borza <andrei.borza@sentry.io>

This branch was successfully deployed

1 active deployment
Preview – sentry-docs — 169dcc4e Deployed Oct 9, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Priority: Normal Docs review has no urgent deadline

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants