fix(llmobs): fix assessment argument description for custom evals #15032

Yun-Kim · 2025-10-24T16:40:26Z

Description

Corrects the docstring description of the assessment argument in submit_evaluation(). There is no functional change but the docstring description was incorrect.

Testing

Risks

Additional Notes

github-actions · 2025-10-24T16:41:14Z

CODEOWNERS have been resolved as:

releasenotes/notes/fix-llmobs-evals-assessment-98f964a9f249913e.yaml    @DataDog/apm-python
ddtrace/llmobs/_llmobs.py                                               @DataDog/ml-observability
tests/llmobs/test_llmobs_service.py                                     @DataDog/ml-observability

github-actions · 2025-10-24T17:05:51Z

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 239 ± 4 ms.

The average import time from base is: 242 ± 3 ms.

The import time difference between this PR and base is: -2.8 ± 0.2 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 2.043 ms (0.85%)

ddtrace.bootstrap.sitecustomize 1.369 ms (0.57%)

ddtrace.bootstrap.preload 1.369 ms (0.57%)

ddtrace.internal.remoteconfig.client 0.682 ms (0.29%)

ddtrace 0.674 ms (0.28%)

ddtrace.internal._unpatched 0.028 ms (0.01%)

json 0.028 ms (0.01%)

json.decoder 0.028 ms (0.01%)

re 0.028 ms (0.01%)

enum 0.028 ms (0.01%)

types 0.028 ms (0.01%)

pr-commenter · 2025-10-24T18:03:25Z

Performance SLOs

Comparing candidate yunkim/fix-assessment-description (da16854) with baseline main (429f02c)

📈 Performance Regressions (1 suite)

📈 iastaspects - 118/118

✅ add_aspect

Time: ✅ 0.404µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.9%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +5.0%

✅ add_inplace_aspect

Time: ✅ 0.402µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.2%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.8%

✅ add_inplace_noaspect

Time: ✅ 0.317µs (SLO: <10.000µs 📉 -96.8%) vs baseline: -0.1%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%

✅ add_noaspect

Time: ✅ 0.277µs (SLO: <10.000µs 📉 -97.2%) vs baseline: +0.2%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.8%

✅ bytearray_aspect

Time: ✅ 1.499µs (SLO: <10.000µs 📉 -85.0%) vs baseline: 📈 +10.6%

Memory: ✅ 38.142MB (SLO: <39.000MB -2.2%) vs baseline: +5.0%

✅ bytearray_extend_aspect

Time: ✅ 1.529µs (SLO: <10.000µs 📉 -84.7%) vs baseline: +0.3%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.8%

✅ bytearray_extend_noaspect

Time: ✅ 0.617µs (SLO: <10.000µs 📉 -93.8%) vs baseline: +0.5%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ bytearray_noaspect

Time: ✅ 0.484µs (SLO: <10.000µs 📉 -95.2%) vs baseline: +0.6%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ bytes_aspect

Time: ✅ 1.422µs (SLO: <10.000µs 📉 -85.8%) vs baseline: +9.9%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.6%

✅ bytes_noaspect

Time: ✅ 0.497µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +0.5%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ bytesio_aspect

Time: ✅ 1.360µs (SLO: <10.000µs 📉 -86.4%) vs baseline: +0.2%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +5.1%

✅ bytesio_noaspect

Time: ✅ 0.491µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -1.5%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +4.7%

✅ capitalize_aspect

Time: ✅ 0.739µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +0.7%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +5.0%

✅ capitalize_noaspect

Time: ✅ 0.434µs (SLO: <10.000µs 📉 -95.7%) vs baseline: -1.1%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ casefold_aspect

Time: ✅ 0.731µs (SLO: <10.000µs 📉 -92.7%) vs baseline: -1.4%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ casefold_noaspect

Time: ✅ 0.374µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +1.4%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ decode_aspect

Time: ✅ 0.728µs (SLO: <10.000µs 📉 -92.7%) vs baseline: -0.3%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ decode_noaspect

Time: ✅ 0.424µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +0.3%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.7%

✅ encode_aspect

Time: ✅ 0.705µs (SLO: <10.000µs 📉 -93.0%) vs baseline: -0.5%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ encode_noaspect

Time: ✅ 0.402µs (SLO: <10.000µs 📉 -96.0%) vs baseline: +1.1%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.8%

✅ format_aspect

Time: ✅ 3.416µs (SLO: <10.000µs 📉 -65.8%) vs baseline: +0.6%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.8%

✅ format_map_aspect

Time: ✅ 4.305µs (SLO: <10.000µs 📉 -57.0%) vs baseline: 📈 +17.1%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.8%

✅ format_map_noaspect

Time: ✅ 0.779µs (SLO: <10.000µs 📉 -92.2%) vs baseline: -0.2%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.8%

✅ format_noaspect

Time: ✅ 0.599µs (SLO: <10.000µs 📉 -94.0%) vs baseline: -0.5%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ index_aspect

Time: ✅ 0.355µs (SLO: <10.000µs 📉 -96.4%) vs baseline: -1.5%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ index_noaspect

Time: ✅ 0.277µs (SLO: <10.000µs 📉 -97.2%) vs baseline: -0.5%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ join_aspect

Time: ✅ 1.370µs (SLO: <10.000µs 📉 -86.3%) vs baseline: +0.5%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ join_noaspect

Time: ✅ 0.494µs (SLO: <10.000µs 📉 -95.1%) vs baseline: ~same

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ ljust_aspect

Time: ✅ 2.589µs (SLO: <20.000µs 📉 -87.1%) vs baseline: ~same

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +5.0%

✅ ljust_noaspect

Time: ✅ 0.408µs (SLO: <10.000µs 📉 -95.9%) vs baseline: ~same

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +4.8%

✅ lower_aspect

Time: ✅ 2.210µs (SLO: <10.000µs 📉 -77.9%) vs baseline: +0.7%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ lower_noaspect

Time: ✅ 0.373µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +1.0%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%

✅ lstrip_aspect

Time: ✅ 2.223µs (SLO: <20.000µs 📉 -88.9%) vs baseline: ~same

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.7%

✅ lstrip_noaspect

Time: ✅ 0.385µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +0.2%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +5.0%

✅ modulo_aspect

Time: ✅ 0.996µs (SLO: <10.000µs 📉 -90.0%) vs baseline: -0.2%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +5.1%

✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 1.572µs (SLO: <10.000µs 📉 -84.3%) vs baseline: +0.4%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.7%

✅ modulo_aspect_for_bytes

Time: ✅ 0.983µs (SLO: <10.000µs 📉 -90.2%) vs baseline: +0.4%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 1.238µs (SLO: <10.000µs 📉 -87.6%) vs baseline: +1.0%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%

✅ modulo_noaspect

Time: ✅ 0.623µs (SLO: <10.000µs 📉 -93.8%) vs baseline: -1.3%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ replace_aspect

Time: ✅ 5.497µs (SLO: <10.000µs 📉 -45.0%) vs baseline: 📈 +10.4%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ replace_noaspect

Time: ✅ 0.464µs (SLO: <10.000µs 📉 -95.4%) vs baseline: +0.1%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ repr_aspect

Time: ✅ 0.904µs (SLO: <10.000µs 📉 -91.0%) vs baseline: -1.3%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.8%

✅ repr_noaspect

Time: ✅ 0.414µs (SLO: <10.000µs 📉 -95.9%) vs baseline: -0.5%

Memory: ✅ 38.162MB (SLO: <39.000MB -2.1%) vs baseline: +5.0%

✅ rstrip_aspect

Time: ✅ 1.901µs (SLO: <20.000µs 📉 -90.5%) vs baseline: ~same

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.7%

✅ rstrip_noaspect

Time: ✅ 0.381µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -0.5%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ slice_aspect

Time: ✅ 0.493µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +0.6%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +5.1%

✅ slice_noaspect

Time: ✅ 0.452µs (SLO: <10.000µs 📉 -95.5%) vs baseline: +0.6%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.8%

✅ stringio_aspect

Time: ✅ 1.547µs (SLO: <10.000µs 📉 -84.5%) vs baseline: +0.2%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.8%

✅ stringio_noaspect

Time: ✅ 0.717µs (SLO: <10.000µs 📉 -92.8%) vs baseline: -1.2%

Memory: ✅ 38.142MB (SLO: <39.000MB -2.2%) vs baseline: +4.9%

✅ strip_aspect

Time: ✅ 2.227µs (SLO: <20.000µs 📉 -88.9%) vs baseline: +0.5%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +5.0%

✅ strip_noaspect

Time: ✅ 0.386µs (SLO: <10.000µs 📉 -96.1%) vs baseline: -0.7%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%

✅ swapcase_aspect

Time: ✅ 2.392µs (SLO: <10.000µs 📉 -76.1%) vs baseline: -0.3%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +5.2%

✅ swapcase_noaspect

Time: ✅ 0.538µs (SLO: <10.000µs 📉 -94.6%) vs baseline: +0.7%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +4.8%

✅ title_aspect

Time: ✅ 2.337µs (SLO: <10.000µs 📉 -76.6%) vs baseline: -0.2%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ title_noaspect

Time: ✅ 0.501µs (SLO: <10.000µs 📉 -95.0%) vs baseline: ~same

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +5.0%

✅ translate_aspect

Time: ✅ 3.277µs (SLO: <10.000µs 📉 -67.2%) vs baseline: +1.3%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ translate_noaspect

Time: ✅ 1.040µs (SLO: <10.000µs 📉 -89.6%) vs baseline: -0.4%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%

✅ upper_aspect

Time: ✅ 2.370µs (SLO: <10.000µs 📉 -76.3%) vs baseline: +8.2%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +4.8%

✅ upper_noaspect

Time: ✅ 0.373µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.7%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%

🟡 Near SLO Breach (5 suites)

🟡 djangosimple - 30/30

✅ appsec

Time: ✅ 20.597ms (SLO: <22.300ms -7.6%) vs baseline: +0.1%

Memory: ✅ 65.273MB (SLO: <67.000MB -2.6%) vs baseline: +4.8%

✅ exception-replay-enabled

Time: ✅ 1.344ms (SLO: <1.450ms -7.3%) vs baseline: -0.1%

Memory: ✅ 64.722MB (SLO: <67.000MB -3.4%) vs baseline: +4.9%

✅ iast

Time: ✅ 20.536ms (SLO: <22.250ms -7.7%) vs baseline: ~same

Memory: ✅ 65.260MB (SLO: <67.000MB -2.6%) vs baseline: +4.7%

✅ profiler

Time: ✅ 15.509ms (SLO: <16.550ms -6.3%) vs baseline: +0.2%

Memory: ✅ 54.166MB (SLO: <54.500MB 🟡 -0.6%) vs baseline: +4.9%

✅ resource-renaming

Time: ✅ 20.592ms (SLO: <21.750ms -5.3%) vs baseline: +0.3%

Memory: ✅ 65.292MB (SLO: <67.000MB -2.5%) vs baseline: +4.9%

✅ span-code-origin

Time: ✅ 25.395ms (SLO: <28.200ms -9.9%) vs baseline: -0.2%

Memory: ✅ 67.589MB (SLO: <69.500MB -2.7%) vs baseline: +4.7%

✅ tracer

Time: ✅ 20.498ms (SLO: <21.750ms -5.8%) vs baseline: ~same

Memory: ✅ 65.254MB (SLO: <67.000MB -2.6%) vs baseline: +4.7%

✅ tracer-and-profiler

Time: ✅ 22.712ms (SLO: <23.500ms -3.4%) vs baseline: +0.1%

Memory: ✅ 66.780MB (SLO: <67.500MB 🟡 -1.1%) vs baseline: +5.1%

✅ tracer-dont-create-db-spans

Time: ✅ 19.369ms (SLO: <21.500ms -9.9%) vs baseline: +0.4%

Memory: ✅ 65.273MB (SLO: <66.000MB 🟡 -1.1%) vs baseline: +4.8%

✅ tracer-minimal

Time: ✅ 16.608ms (SLO: <17.500ms -5.1%) vs baseline: -0.3%

Memory: ✅ 65.274MB (SLO: <66.000MB 🟡 -1.1%) vs baseline: +4.8%

✅ tracer-native

Time: ✅ 20.473ms (SLO: <21.750ms -5.9%) vs baseline: -0.1%

Memory: ✅ 71.467MB (SLO: <72.500MB 🟡 -1.4%) vs baseline: +5.1%

✅ tracer-no-caches

Time: ✅ 18.481ms (SLO: <19.650ms -5.9%) vs baseline: +0.2%

Memory: ✅ 65.254MB (SLO: <67.000MB -2.6%) vs baseline: +4.9%

✅ tracer-no-databases

Time: ✅ 18.802ms (SLO: <20.100ms -6.5%) vs baseline: +0.4%

Memory: ✅ 65.252MB (SLO: <67.000MB -2.6%) vs baseline: +4.8%

✅ tracer-no-middleware

Time: ✅ 20.168ms (SLO: <21.500ms -6.2%) vs baseline: -0.1%

Memory: ✅ 65.273MB (SLO: <67.000MB -2.6%) vs baseline: +4.9%

✅ tracer-no-templates

Time: ✅ 20.342ms (SLO: <22.000ms -7.5%) vs baseline: ~same

Memory: ✅ 65.252MB (SLO: <67.000MB -2.6%) vs baseline: +4.8%

🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 18.104ms (SLO: <19.850ms -8.8%) vs baseline: ~same

Memory: ✅ 65.202MB (SLO: <66.500MB 🟡 -2.0%) vs baseline: +4.7%

✅ errortracking-enabled-user

Time: ✅ 18.091ms (SLO: <19.400ms -6.7%) vs baseline: ~same

Memory: ✅ 65.236MB (SLO: <66.500MB 🟡 -1.9%) vs baseline: +4.7%

✅ tracer-enabled

Time: ✅ 18.090ms (SLO: <19.450ms -7.0%) vs baseline: +0.2%

Memory: ✅ 65.160MB (SLO: <66.500MB -2.0%) vs baseline: +4.8%

🟡 errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.071ms (SLO: <2.300ms -9.9%) vs baseline: -0.2%

Memory: ✅ 52.140MB (SLO: <53.500MB -2.5%) vs baseline: +4.9%

✅ errortracking-enabled-user

Time: ✅ 2.077ms (SLO: <2.250ms -7.7%) vs baseline: +0.3%

Memory: ✅ 52.042MB (SLO: <53.500MB -2.7%) vs baseline: +4.3%

✅ tracer-enabled

Time: ✅ 2.073ms (SLO: <2.300ms -9.9%) vs baseline: ~same

Memory: ✅ 52.455MB (SLO: <53.500MB 🟡 -2.0%) vs baseline: +5.1%

🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 4.597ms (SLO: <4.750ms -3.2%) vs baseline: ~same

Memory: ✅ 61.951MB (SLO: <65.000MB -4.7%) vs baseline: +4.8%

✅ appsec-post

Time: ✅ 6.618ms (SLO: <6.750ms 🟡 -2.0%) vs baseline: -0.1%

Memory: ✅ 61.935MB (SLO: <65.000MB -4.7%) vs baseline: +4.7%

✅ appsec-telemetry

Time: ✅ 4.583ms (SLO: <4.750ms -3.5%) vs baseline: -0.1%

Memory: ✅ 61.991MB (SLO: <65.000MB -4.6%) vs baseline: +4.9%

✅ debugger

Time: ✅ 1.857ms (SLO: <2.000ms -7.1%) vs baseline: -0.3%

Memory: ✅ 45.436MB (SLO: <47.000MB -3.3%) vs baseline: +4.6%

✅ iast-get

Time: ✅ 1.857ms (SLO: <2.000ms -7.2%) vs baseline: -0.4%

Memory: ✅ 42.369MB (SLO: <49.000MB 📉 -13.5%) vs baseline: +4.8%

✅ profiler

Time: ✅ 1.912ms (SLO: <2.100ms -9.0%) vs baseline: -0.2%

Memory: ✅ 46.635MB (SLO: <47.000MB 🟡 -0.8%) vs baseline: +4.4%

✅ resource-renaming

Time: ✅ 3.372ms (SLO: <3.650ms -7.6%) vs baseline: ~same

Memory: ✅ 52.140MB (SLO: <53.500MB -2.5%) vs baseline: +4.5%

✅ tracer

Time: ✅ 3.362ms (SLO: <3.650ms -7.9%) vs baseline: -0.2%

Memory: ✅ 52.258MB (SLO: <53.500MB -2.3%) vs baseline: +4.9%

✅ tracer-native

Time: ✅ 3.362ms (SLO: <3.650ms -7.9%) vs baseline: +0.2%

Memory: ✅ 58.186MB (SLO: <60.000MB -3.0%) vs baseline: +4.7%

🟡 flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 3.959ms (SLO: <4.200ms -5.7%) vs baseline: -0.1%

Memory: ✅ 62.246MB (SLO: <66.000MB -5.7%) vs baseline: +4.9%

✅ iast-enabled

Time: ✅ 2.450ms (SLO: <2.800ms 📉 -12.5%) vs baseline: +1.0%

Memory: ✅ 58.904MB (SLO: <60.000MB 🟡 -1.8%) vs baseline: +4.9%

✅ tracer-enabled

Time: ✅ 2.064ms (SLO: <2.250ms -8.3%) vs baseline: ~same

Memory: ✅ 52.180MB (SLO: <54.500MB -4.3%) vs baseline: +4.4%

⚠️ Unstable Tests (1 suite)

⚠️

coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.271µs (SLO: <20.000µs 📉 -33.6%) vs baseline: ~same

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%

✅ context_with_data_no_listeners

Time: ✅ 3.277µs (SLO: <10.000µs 📉 -67.2%) vs baseline: -0.2%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%

✅ get_item_exists

Time: ✅ 0.586µs (SLO: <10.000µs 📉 -94.1%) vs baseline: -0.2%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%

✅ get_item_missing

Time: ✅ 0.636µs (SLO: <10.000µs 📉 -93.6%) vs baseline: -0.5%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%

✅ set_item

Time: ✅ 24.344µs (SLO: <30.000µs 📉 -18.9%) vs baseline: -0.4%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%

✅ All Tests Passing (17 suites)

✅ httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 81.553µs (SLO: <100.000µs 📉 -18.4%) vs baseline: ~same

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%

✅ b3_headers

Time: ✅ 14.169µs (SLO: <20.000µs 📉 -29.2%) vs baseline: +0.2%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%

✅ b3_single_headers

Time: ✅ 13.291µs (SLO: <20.000µs 📉 -33.5%) vs baseline: -0.4%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 64.366µs (SLO: <80.000µs 📉 -19.5%) vs baseline: +1.1%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 66.019µs (SLO: <80.000µs 📉 -17.5%) vs baseline: +0.4%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%

✅ empty_headers

Time: ✅ 1.611µs (SLO: <10.000µs 📉 -83.9%) vs baseline: +1.0%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%

✅ full_t_id_datadog_headers

Time: ✅ 23.065µs (SLO: <30.000µs 📉 -23.1%) vs baseline: +0.4%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.8%

✅ invalid_priority_header

Time: ✅ 6.606µs (SLO: <10.000µs 📉 -33.9%) vs baseline: +0.3%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%

✅ invalid_span_id_header

Time: ✅ 6.575µs (SLO: <10.000µs 📉 -34.2%) vs baseline: -0.2%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%

✅ invalid_tags_header

Time: ✅ 6.604µs (SLO: <10.000µs 📉 -34.0%) vs baseline: +0.3%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ invalid_trace_id_header

Time: ✅ 6.604µs (SLO: <10.000µs 📉 -34.0%) vs baseline: +0.3%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%

✅ large_header_no_matches

Time: ✅ 28.248µs (SLO: <30.000µs -5.8%) vs baseline: ~same

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.6%

✅ large_valid_headers_all

Time: ✅ 29.159µs (SLO: <40.000µs 📉 -27.1%) vs baseline: -0.6%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%

✅ medium_header_no_matches

Time: ✅ 9.918µs (SLO: <20.000µs 📉 -50.4%) vs baseline: -0.3%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ medium_valid_headers_all

Time: ✅ 11.359µs (SLO: <20.000µs 📉 -43.2%) vs baseline: +0.3%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%

✅ none_propagation_style

Time: ✅ 1.739µs (SLO: <10.000µs 📉 -82.6%) vs baseline: +1.6%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.8%

✅ tracecontext_headers

Time: ✅ 35.173µs (SLO: <40.000µs 📉 -12.1%) vs baseline: +1.8%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%

✅ valid_headers_all

Time: ✅ 6.582µs (SLO: <10.000µs 📉 -34.2%) vs baseline: ~same

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%

✅ valid_headers_basic

Time: ✅ 6.162µs (SLO: <10.000µs 📉 -38.4%) vs baseline: -0.1%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ wsgi_empty_headers

Time: ✅ 1.597µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +0.1%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%

✅ wsgi_invalid_priority_header

Time: ✅ 6.666µs (SLO: <10.000µs 📉 -33.3%) vs baseline: +0.9%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%

✅ wsgi_invalid_span_id_header

Time: ✅ 1.594µs (SLO: <10.000µs 📉 -84.1%) vs baseline: +0.7%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ wsgi_invalid_tags_header

Time: ✅ 6.625µs (SLO: <10.000µs 📉 -33.7%) vs baseline: ~same

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%

✅ wsgi_invalid_trace_id_header

Time: ✅ 6.611µs (SLO: <10.000µs 📉 -33.9%) vs baseline: -0.9%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%

✅ wsgi_large_header_no_matches

Time: ✅ 28.877µs (SLO: <40.000µs 📉 -27.8%) vs baseline: ~same

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%

✅ wsgi_large_valid_headers_all

Time: ✅ 29.856µs (SLO: <40.000µs 📉 -25.4%) vs baseline: -0.4%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%

✅ wsgi_medium_header_no_matches

Time: ✅ 10.272µs (SLO: <20.000µs 📉 -48.6%) vs baseline: +1.3%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%

✅ wsgi_medium_valid_headers_all

Time: ✅ 11.587µs (SLO: <20.000µs 📉 -42.1%) vs baseline: -0.3%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.8%

✅ wsgi_valid_headers_all

Time: ✅ 6.640µs (SLO: <10.000µs 📉 -33.6%) vs baseline: -0.3%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%

✅ wsgi_valid_headers_basic

Time: ✅ 6.200µs (SLO: <10.000µs 📉 -38.0%) vs baseline: +0.4%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%

✅ httppropagationinject - 16/16

✅ ids_only

Time: ✅ 22.505µs (SLO: <30.000µs 📉 -25.0%) vs baseline: +4.4%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%

✅ with_all

Time: ✅ 28.928µs (SLO: <40.000µs 📉 -27.7%) vs baseline: +0.2%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%

✅ with_dd_origin

Time: ✅ 26.349µs (SLO: <30.000µs 📉 -12.2%) vs baseline: +4.0%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%

✅ with_priority_and_origin

Time: ✅ 24.851µs (SLO: <40.000µs 📉 -37.9%) vs baseline: +0.4%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%

✅ with_sampling_priority

Time: ✅ 21.663µs (SLO: <30.000µs 📉 -27.8%) vs baseline: +1.4%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%

✅ with_tags

Time: ✅ 27.579µs (SLO: <40.000µs 📉 -31.1%) vs baseline: +2.1%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.8%

✅ with_tags_invalid

Time: ✅ 29.786µs (SLO: <40.000µs 📉 -25.5%) vs baseline: +4.8%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%

✅ with_tags_max_size

Time: ✅ 28.797µs (SLO: <40.000µs 📉 -28.0%) vs baseline: +4.5%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 33.979µs (SLO: <40.000µs 📉 -15.1%) vs baseline: +6.7%

Memory: ✅ 38.142MB (SLO: <39.000MB -2.2%) vs baseline: +4.9%

✅ re_expand_noaspect

Time: ✅ 28.510µs (SLO: <40.000µs 📉 -28.7%) vs baseline: ~same

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +5.0%

✅ re_findall_aspect

Time: ✅ 2.906µs (SLO: <10.000µs 📉 -70.9%) vs baseline: ~same

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ re_findall_noaspect

Time: ✅ 1.420µs (SLO: <10.000µs 📉 -85.8%) vs baseline: +0.6%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ re_finditer_aspect

Time: ✅ 4.428µs (SLO: <10.000µs 📉 -55.7%) vs baseline: ~same

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +5.0%

✅ re_finditer_noaspect

Time: ✅ 1.405µs (SLO: <10.000µs 📉 -86.0%) vs baseline: -0.2%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +5.0%

✅ re_fullmatch_aspect

Time: ✅ 2.865µs (SLO: <10.000µs 📉 -71.4%) vs baseline: +6.9%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ re_fullmatch_noaspect

Time: ✅ 1.284µs (SLO: <10.000µs 📉 -87.2%) vs baseline: -0.7%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ re_group_aspect

Time: ✅ 2.980µs (SLO: <10.000µs 📉 -70.2%) vs baseline: +1.6%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +5.0%

✅ re_group_noaspect

Time: ✅ 1.593µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -1.1%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.8%

✅ re_groups_aspect

Time: ✅ 3.113µs (SLO: <10.000µs 📉 -68.9%) vs baseline: +1.2%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +4.8%

✅ re_groups_noaspect

Time: ✅ 1.688µs (SLO: <10.000µs 📉 -83.1%) vs baseline: -0.3%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ re_match_aspect

Time: ✅ 2.683µs (SLO: <10.000µs 📉 -73.2%) vs baseline: -0.6%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +4.8%

✅ re_match_noaspect

Time: ✅ 1.296µs (SLO: <10.000µs 📉 -87.0%) vs baseline: +0.2%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +5.0%

✅ re_search_aspect

Time: ✅ 2.567µs (SLO: <10.000µs 📉 -74.3%) vs baseline: -0.5%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.7%

✅ re_search_noaspect

Time: ✅ 1.190µs (SLO: <10.000µs 📉 -88.1%) vs baseline: -0.7%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.7%

✅ re_sub_aspect

Time: ✅ 3.388µs (SLO: <10.000µs 📉 -66.1%) vs baseline: -0.6%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.7%

✅ re_sub_noaspect

Time: ✅ 1.527µs (SLO: <10.000µs 📉 -84.7%) vs baseline: -0.4%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +5.0%

✅ re_subn_aspect

Time: ✅ 3.702µs (SLO: <10.000µs 📉 -63.0%) vs baseline: +1.1%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.7%

✅ re_subn_noaspect

Time: ✅ 1.618µs (SLO: <10.000µs 📉 -83.8%) vs baseline: -0.2%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.7%

✅ iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 4.520µs (SLO: <10.000µs 📉 -54.8%) vs baseline: +7.9%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +5.0%

✅ ospathbasename_noaspect

Time: ✅ 1.080µs (SLO: <10.000µs 📉 -89.2%) vs baseline: +0.5%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%

✅ ospathjoin_aspect

Time: ✅ 6.115µs (SLO: <10.000µs 📉 -38.9%) vs baseline: -0.7%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.7%

✅ ospathjoin_noaspect

Time: ✅ 2.322µs (SLO: <10.000µs 📉 -76.8%) vs baseline: +1.3%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ ospathnormcase_aspect

Time: ✅ 3.496µs (SLO: <10.000µs 📉 -65.0%) vs baseline: +1.1%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%

✅ ospathnormcase_noaspect

Time: ✅ 0.566µs (SLO: <10.000µs 📉 -94.3%) vs baseline: -1.3%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +4.8%

✅ ospathsplit_aspect

Time: ✅ 4.760µs (SLO: <10.000µs 📉 -52.4%) vs baseline: -0.1%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ ospathsplit_noaspect

Time: ✅ 1.600µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +0.2%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ ospathsplitdrive_aspect

Time: ✅ 3.672µs (SLO: <10.000µs 📉 -63.3%) vs baseline: +0.3%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.7%

✅ ospathsplitdrive_noaspect

Time: ✅ 0.702µs (SLO: <10.000µs 📉 -93.0%) vs baseline: +0.9%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ ospathsplitext_aspect

Time: ✅ 4.546µs (SLO: <10.000µs 📉 -54.5%) vs baseline: +0.7%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +5.1%

✅ ospathsplitext_noaspect

Time: ✅ 1.384µs (SLO: <10.000µs 📉 -86.2%) vs baseline: +0.3%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +5.1%

✅ iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.463µs (SLO: <10.000µs 📉 -85.4%) vs baseline: +0.9%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ rsplit_noaspect

Time: ✅ 0.575µs (SLO: <10.000µs 📉 -94.3%) vs baseline: -1.5%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ split_aspect

Time: ✅ 1.399µs (SLO: <10.000µs 📉 -86.0%) vs baseline: -0.8%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ split_noaspect

Time: ✅ 0.572µs (SLO: <10.000µs 📉 -94.3%) vs baseline: +0.4%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ splitlines_aspect

Time: ✅ 1.355µs (SLO: <10.000µs 📉 -86.5%) vs baseline: -2.0%

Memory: ✅ 38.142MB (SLO: <39.000MB -2.2%) vs baseline: +5.1%

✅ splitlines_noaspect

Time: ✅ 0.583µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -0.2%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ iastpropagation - 2/2

✅ no-propagation

Time: ✅ 48.699µs (SLO: <60.000µs 📉 -18.8%) vs baseline: +0.2%

Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +4.9%

✅ otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.456ms (SLO: <42.000ms -3.7%) vs baseline: +0.6%

Memory: ✅ 34.977MB (SLO: <39.000MB 📉 -10.3%) vs baseline: +5.0%

✅ add-link

Time: ✅ 36.761ms (SLO: <38.550ms -4.6%) vs baseline: +2.0%

Memory: ✅ 34.642MB (SLO: <39.000MB 📉 -11.2%) vs baseline: +3.9%

✅ add-metrics

Time: ✅ 219.185ms (SLO: <232.000ms -5.5%) vs baseline: -0.8%

Memory: ✅ 34.898MB (SLO: <39.000MB 📉 -10.5%) vs baseline: +4.8%

✅ add-tags

Time: ✅ 212.082ms (SLO: <221.600ms -4.3%) vs baseline: +1.0%

Memory: ✅ 34.485MB (SLO: <39.000MB 📉 -11.6%) vs baseline: +3.4%

✅ get-context

Time: ✅ 29.018ms (SLO: <31.300ms -7.3%) vs baseline: +0.2%

Memory: ✅ 34.918MB (SLO: <39.000MB 📉 -10.5%) vs baseline: +5.0%

✅ is-recording

Time: ✅ 29.672ms (SLO: <31.000ms -4.3%) vs baseline: +1.4%

Memory: ✅ 34.957MB (SLO: <39.000MB 📉 -10.4%) vs baseline: +5.0%

✅ record-exception

Time: ✅ 63.319ms (SLO: <65.850ms -3.8%) vs baseline: +0.3%

Memory: ✅ 34.819MB (SLO: <39.000MB 📉 -10.7%) vs baseline: +4.5%

✅ set-status

Time: ✅ 31.953ms (SLO: <34.150ms -6.4%) vs baseline: +0.6%

Memory: ✅ 34.977MB (SLO: <39.000MB 📉 -10.3%) vs baseline: +4.9%

✅ start

Time: ✅ 28.713ms (SLO: <30.150ms -4.8%) vs baseline: -1.0%

Memory: ✅ 34.682MB (SLO: <39.000MB 📉 -11.1%) vs baseline: +4.0%

✅ start-finish

Time: ✅ 33.761ms (SLO: <35.350ms -4.5%) vs baseline: -0.3%

Memory: ✅ 34.937MB (SLO: <39.000MB 📉 -10.4%) vs baseline: +5.0%

✅ start-finish-telemetry

Time: ✅ 34.169ms (SLO: <35.450ms -3.6%) vs baseline: +0.2%

Memory: ✅ 34.918MB (SLO: <39.000MB 📉 -10.5%) vs baseline: +4.9%

✅ update-name

Time: ✅ 31.448ms (SLO: <33.400ms -5.8%) vs baseline: +1.7%

Memory: ✅ 34.957MB (SLO: <39.000MB 📉 -10.4%) vs baseline: +5.1%

✅ otelspan - 22/22

✅ add-event

Time: ✅ 40.364ms (SLO: <47.150ms 📉 -14.4%) vs baseline: +0.6%

Memory: ✅ 43.733MB (SLO: <47.000MB -7.0%) vs baseline: +4.7%

✅ add-metrics

Time: ✅ 319.533ms (SLO: <344.800ms -7.3%) vs baseline: +1.2%

Memory: ✅ 652.575MB (SLO: <675.000MB -3.3%) vs baseline: +4.9%

✅ add-tags

Time: ✅ 287.577ms (SLO: <314.000ms -8.4%) vs baseline: -0.5%

Memory: ✅ 653.107MB (SLO: <675.000MB -3.2%) vs baseline: +4.7%

✅ get-context

Time: ✅ 80.329ms (SLO: <92.350ms 📉 -13.0%) vs baseline: +0.3%

Memory: ✅ 39.679MB (SLO: <46.500MB 📉 -14.7%) vs baseline: +4.9%

✅ is-recording

Time: ✅ 38.025ms (SLO: <44.500ms 📉 -14.5%) vs baseline: +0.2%

Memory: ✅ 43.170MB (SLO: <47.500MB -9.1%) vs baseline: +4.8%

✅ record-exception

Time: ✅ 57.935ms (SLO: <67.650ms 📉 -14.4%) vs baseline: -0.5%

Memory: ✅ 39.957MB (SLO: <47.000MB 📉 -15.0%) vs baseline: +4.9%

✅ set-status

Time: ✅ 43.996ms (SLO: <50.400ms 📉 -12.7%) vs baseline: +0.8%

Memory: ✅ 43.176MB (SLO: <47.000MB -8.1%) vs baseline: +4.9%

✅ start

Time: ✅ 37.238ms (SLO: <43.450ms 📉 -14.3%) vs baseline: -0.1%

Memory: ✅ 43.225MB (SLO: <47.000MB -8.0%) vs baseline: +4.9%

✅ start-finish

Time: ✅ 82.224ms (SLO: <88.000ms -6.6%) vs baseline: +0.5%

Memory: ✅ 34.564MB (SLO: <46.500MB 📉 -25.7%) vs baseline: +4.7%

✅ start-finish-telemetry

Time: ✅ 83.544ms (SLO: <89.000ms -6.1%) vs baseline: +0.2%

Memory: ✅ 34.583MB (SLO: <46.500MB 📉 -25.6%) vs baseline: +4.9%

✅ update-name

Time: ✅ 38.837ms (SLO: <45.150ms 📉 -14.0%) vs baseline: +0.1%

Memory: ✅ 43.518MB (SLO: <47.000MB -7.4%) vs baseline: +5.1%

✅ packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 341.588ms (SLO: <354.300ms -3.6%) vs baseline: -0.8%

Memory: ✅ 37.769MB (SLO: <40.000MB -5.6%) vs baseline: +2.7%

✅ cache_on

Time: ✅ 0.386µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +0.5%

Memory: ✅ 36.638MB (SLO: <39.000MB -6.1%) vs baseline: +4.9%

✅ packagesupdateimporteddependencies - 24/24

✅ import_many

Time: ✅ 155.570µs (SLO: <170.000µs -8.5%) vs baseline: ~same

Memory: ✅ 36.380MB (SLO: <38.500MB -5.5%) vs baseline: +3.0%

✅ import_many_cached

Time: ✅ 120.473µs (SLO: <130.000µs -7.3%) vs baseline: -0.3%

Memory: ✅ 36.706MB (SLO: <38.500MB -4.7%) vs baseline: +4.5%

✅ import_many_stdlib

Time: ✅ 1.612ms (SLO: <1.750ms -7.9%) vs baseline: -0.6%

Memory: ✅ 36.790MB (SLO: <38.500MB -4.4%) vs baseline: +3.4%

✅ import_many_stdlib_cached

Time: ✅ 0.974ms (SLO: <1.100ms 📉 -11.4%) vs baseline: -0.4%

Memory: ✅ 36.670MB (SLO: <38.500MB -4.8%) vs baseline: +3.1%

✅ import_many_unknown

Time: ✅ 826.550µs (SLO: <890.000µs -7.1%) vs baseline: -0.6%

Memory: ✅ 36.649MB (SLO: <38.500MB -4.8%) vs baseline: +3.3%

✅ import_many_unknown_cached

Time: ✅ 795.549µs (SLO: <870.000µs -8.6%) vs baseline: ~same

Memory: ✅ 36.670MB (SLO: <38.500MB -4.8%) vs baseline: +2.9%

✅ import_one

Time: ✅ 19.801µs (SLO: <30.000µs 📉 -34.0%) vs baseline: +0.6%

Memory: ✅ 37.195MB (SLO: <39.000MB -4.6%) vs baseline: +5.3%

✅ import_one_cache

Time: ✅ 6.272µs (SLO: <10.000µs 📉 -37.3%) vs baseline: -0.5%

Memory: ✅ 36.457MB (SLO: <38.500MB -5.3%) vs baseline: +2.9%

✅ import_one_stdlib

Time: ✅ 18.865µs (SLO: <20.000µs -5.7%) vs baseline: +1.2%

Memory: ✅ 36.523MB (SLO: <38.500MB -5.1%) vs baseline: +3.1%

✅ import_one_stdlib_cache

Time: ✅ 6.370µs (SLO: <10.000µs 📉 -36.3%) vs baseline: +0.4%

Memory: ✅ 36.601MB (SLO: <38.500MB -4.9%) vs baseline: +3.7%

✅ import_one_unknown

Time: ✅ 45.725µs (SLO: <50.000µs -8.6%) vs baseline: ~same

Memory: ✅ 36.702MB (SLO: <38.500MB -4.7%) vs baseline: +3.8%

✅ import_one_unknown_cache

Time: ✅ 6.317µs (SLO: <10.000µs 📉 -36.8%) vs baseline: +0.6%

Memory: ✅ 36.693MB (SLO: <38.500MB -4.7%) vs baseline: +3.8%

✅ ratelimiter - 12/12

✅ defaults

Time: ✅ 2.336µs (SLO: <10.000µs 📉 -76.6%) vs baseline: -1.2%

Memory: ✅ 31.811MB (SLO: <34.000MB -6.4%) vs baseline: +4.9%

✅ high_rate_limit

Time: ✅ 2.420µs (SLO: <10.000µs 📉 -75.8%) vs baseline: +0.5%

Memory: ✅ 31.792MB (SLO: <34.000MB -6.5%) vs baseline: +4.9%

✅ long_window

Time: ✅ 2.349µs (SLO: <10.000µs 📉 -76.5%) vs baseline: +0.5%

Memory: ✅ 31.772MB (SLO: <34.000MB -6.6%) vs baseline: +4.7%

✅ low_rate_limit

Time: ✅ 2.359µs (SLO: <10.000µs 📉 -76.4%) vs baseline: +0.2%

Memory: ✅ 31.752MB (SLO: <34.000MB -6.6%) vs baseline: +4.6%

✅ no_rate_limit

Time: ✅ 0.832µs (SLO: <10.000µs 📉 -91.7%) vs baseline: -0.8%

Memory: ✅ 31.733MB (SLO: <34.000MB -6.7%) vs baseline: +4.7%

✅ short_window

Time: ✅ 2.470µs (SLO: <10.000µs 📉 -75.3%) vs baseline: -1.3%

Memory: ✅ 31.772MB (SLO: <34.000MB -6.6%) vs baseline: +4.7%

✅ recursivecomputation - 8/8

✅ deep

Time: ✅ 309.515ms (SLO: <320.950ms -3.6%) vs baseline: +0.2%

Memory: ✅ 32.991MB (SLO: <34.500MB -4.4%) vs baseline: +4.9%

✅ deep-profiled

Time: ✅ 327.777ms (SLO: <359.150ms -8.7%) vs baseline: ~same

Memory: ✅ 37.350MB (SLO: <39.000MB -4.2%) vs baseline: +5.0%

✅ medium

Time: ✅ 7.046ms (SLO: <7.400ms -4.8%) vs baseline: ~same

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.8%

✅ shallow

Time: ✅ 0.955ms (SLO: <1.050ms -9.1%) vs baseline: +0.6%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.8%

✅ samplingrules - 8/8

✅ average_match

Time: ✅ 137.053µs (SLO: <290.000µs 📉 -52.7%) vs baseline: -1.0%

Memory: ✅ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +4.9%

✅ high_match

Time: ✅ 172.783µs (SLO: <480.000µs 📉 -64.0%) vs baseline: -1.0%

Memory: ✅ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +4.9%

✅ low_match

Time: ✅ 98.610µs (SLO: <120.000µs 📉 -17.8%) vs baseline: +0.1%

Memory: ✅ 600.955MB (SLO: <700.000MB 📉 -14.1%) vs baseline: +4.9%

✅ very_low_match

Time: ✅ 2.665ms (SLO: <8.500ms 📉 -68.6%) vs baseline: +0.1%

Memory: ✅ 68.307MB (SLO: <75.000MB -8.9%) vs baseline: +4.8%

✅ sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.513µs (SLO: <20.000µs 📉 -47.4%) vs baseline: +0.8%

Memory: ✅ 32.539MB (SLO: <34.000MB -4.3%) vs baseline: +4.6%

✅ all-enabled

Time: ✅ 39.810µs (SLO: <50.000µs 📉 -20.4%) vs baseline: -0.3%

Memory: ✅ 32.617MB (SLO: <34.000MB -4.1%) vs baseline: +5.0%

✅ collectipvariant_exists

Time: ✅ 40.452µs (SLO: <50.000µs 📉 -19.1%) vs baseline: -0.7%

Memory: ✅ 32.676MB (SLO: <34.000MB -3.9%) vs baseline: +5.1%

✅ no-collectipvariant

Time: ✅ 39.733µs (SLO: <50.000µs 📉 -20.5%) vs baseline: -0.7%

Memory: ✅ 32.578MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%

✅ no-useragentvariant

Time: ✅ 38.446µs (SLO: <50.000µs 📉 -23.1%) vs baseline: -0.5%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +4.9%

✅ obfuscation-no-query

Time: ✅ 40.340µs (SLO: <50.000µs 📉 -19.3%) vs baseline: -0.3%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +4.9%

✅ obfuscation-regular-case-explicit-query

Time: ✅ 75.764µs (SLO: <90.000µs 📉 -15.8%) vs baseline: +0.5%

Memory: ✅ 33.030MB (SLO: <34.000MB -2.9%) vs baseline: +5.0%

✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.960µs (SLO: <90.000µs 📉 -14.5%) vs baseline: +0.6%

Memory: ✅ 32.991MB (SLO: <34.000MB -3.0%) vs baseline: +4.8%

✅ obfuscation-send-querystring-disabled

Time: ✅ 154.350µs (SLO: <170.000µs -9.2%) vs baseline: +0.2%

Memory: ✅ 33.030MB (SLO: <34.500MB -4.3%) vs baseline: +4.9%

✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.292µs (SLO: <160.000µs -7.3%) vs baseline: ~same

Memory: ✅ 33.030MB (SLO: <34.500MB -4.3%) vs baseline: +4.9%

✅ obfuscation-worst-case-implicit-query

Time: ✅ 154.209µs (SLO: <170.000µs -9.3%) vs baseline: -0.3%

Memory: ✅ 33.010MB (SLO: <34.500MB -4.3%) vs baseline: +4.8%

✅ useragentvariant_exists_1

Time: ✅ 39.369µs (SLO: <50.000µs 📉 -21.3%) vs baseline: -0.6%

Memory: ✅ 32.637MB (SLO: <34.000MB -4.0%) vs baseline: +4.9%

✅ useragentvariant_exists_2

Time: ✅ 40.278µs (SLO: <50.000µs 📉 -19.4%) vs baseline: -0.9%

Memory: ✅ 32.617MB (SLO: <34.000MB -4.1%) vs baseline: +4.9%

✅ useragentvariant_exists_3

Time: ✅ 39.780µs (SLO: <50.000µs 📉 -20.4%) vs baseline: -0.9%

Memory: ✅ 32.578MB (SLO: <34.000MB -4.2%) vs baseline: +4.8%

✅ useragentvariant_not_exists_1

Time: ✅ 38.996µs (SLO: <50.000µs 📉 -22.0%) vs baseline: -1.4%

Memory: ✅ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +4.5%

✅ useragentvariant_not_exists_2

Time: ✅ 39.141µs (SLO: <50.000µs 📉 -21.7%) vs baseline: -0.8%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +4.9%

✅ span - 26/26

✅ add-event

Time: ✅ 19.852ms (SLO: <22.500ms 📉 -11.8%) vs baseline: -0.2%

Memory: ✅ 48.788MB (SLO: <53.000MB -7.9%) vs baseline: +4.7%

✅ add-metrics

Time: ✅ 90.289ms (SLO: <93.500ms -3.4%) vs baseline: +0.1%

Memory: ✅ 735.666MB (SLO: <961.000MB 📉 -23.4%) vs baseline: +4.8%

✅ add-tags

Time: ✅ 147.563ms (SLO: <155.000ms -4.8%) vs baseline: +0.4%

Memory: ✅ 735.877MB (SLO: <962.500MB 📉 -23.5%) vs baseline: +4.8%

✅ get-context

Time: ✅ 18.241ms (SLO: <20.500ms 📉 -11.0%) vs baseline: -0.3%

Memory: ✅ 47.667MB (SLO: <53.000MB 📉 -10.1%) vs baseline: +4.9%

✅ is-recording

Time: ✅ 18.602ms (SLO: <20.500ms -9.3%) vs baseline: ~same

Memory: ✅ 47.585MB (SLO: <53.000MB 📉 -10.2%) vs baseline: +4.8%

✅ record-exception

Time: ✅ 37.658ms (SLO: <40.000ms -5.9%) vs baseline: +0.7%

Memory: ✅ 42.043MB (SLO: <53.000MB 📉 -20.7%) vs baseline: +4.8%

✅ set-status

Time: ✅ 20.205ms (SLO: <22.000ms -8.2%) vs baseline: +0.3%

Memory: ✅ 47.625MB (SLO: <53.000MB 📉 -10.1%) vs baseline: +4.8%

✅ start

Time: ✅ 18.502ms (SLO: <20.500ms -9.7%) vs baseline: +1.6%

Memory: ✅ 47.562MB (SLO: <53.000MB 📉 -10.3%) vs baseline: +4.7%

✅ start-finish

Time: ✅ 50.841ms (SLO: <52.500ms -3.2%) vs baseline: +0.9%

Memory: ✅ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +4.9%

✅ start-finish-telemetry

Time: ✅ 51.944ms (SLO: <54.500ms -4.7%) vs baseline: +0.3%

Memory: ✅ 32.204MB (SLO: <34.000MB -5.3%) vs baseline: +4.8%

✅ start-finish-traceid128

Time: ✅ 55.154ms (SLO: <57.000ms -3.2%) vs baseline: +2.5%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.7%

✅ start-traceid128

Time: ✅ 18.744ms (SLO: <22.500ms 📉 -16.7%) vs baseline: +0.7%

Memory: ✅ 47.555MB (SLO: <53.000MB 📉 -10.3%) vs baseline: +4.7%

✅ update-name

Time: ✅ 18.805ms (SLO: <22.000ms 📉 -14.5%) vs baseline: +0.3%

Memory: ✅ 48.212MB (SLO: <53.000MB -9.0%) vs baseline: +4.8%

✅ telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.022µs (SLO: <20.000µs 📉 -84.9%) vs baseline: +1.8%

Memory: ✅ 32.224MB (SLO: <34.000MB -5.2%) vs baseline: +5.0%

✅ 1-count-metrics-100-times

Time: ✅ 201.117µs (SLO: <220.000µs -8.6%) vs baseline: +1.5%

Memory: ✅ 32.204MB (SLO: <34.000MB -5.3%) vs baseline: +4.9%

✅ 1-distribution-metric-1-times

Time: ✅ 3.307µs (SLO: <20.000µs 📉 -83.5%) vs baseline: +1.4%

Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +4.7%

✅ 1-distribution-metrics-100-times

Time: ✅ 214.827µs (SLO: <220.000µs -2.4%) vs baseline: +0.3%

Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +4.9%

✅ 1-gauge-metric-1-times

Time: ✅ 2.203µs (SLO: <20.000µs 📉 -89.0%) vs baseline: +2.3%

Memory: ✅ 32.204MB (SLO: <34.000MB -5.3%) vs baseline: +5.0%

✅ 1-gauge-metrics-100-times

Time: ✅ 137.868µs (SLO: <150.000µs -8.1%) vs baseline: +0.8%

Memory: ✅ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +4.9%

✅ 1-rate-metric-1-times

Time: ✅ 3.163µs (SLO: <20.000µs 📉 -84.2%) vs baseline: +2.7%

Memory: ✅ 32.224MB (SLO: <34.000MB -5.2%) vs baseline: +5.0%

✅ 1-rate-metrics-100-times

Time: ✅ 218.652µs (SLO: <250.000µs 📉 -12.5%) vs baseline: +2.4%

Memory: ✅ 32.204MB (SLO: <34.000MB -5.3%) vs baseline: +4.9%

✅ 100-count-metrics-100-times

Time: ✅ 20.287ms (SLO: <22.000ms -7.8%) vs baseline: +1.4%

Memory: ✅ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +4.7%

✅ 100-distribution-metrics-100-times

Time: ✅ 2.237ms (SLO: <2.300ms -2.7%) vs baseline: -0.7%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.7%

✅ 100-gauge-metrics-100-times

Time: ✅ 1.406ms (SLO: <1.550ms -9.3%) vs baseline: +0.2%

Memory: ✅ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +4.8%

✅ 100-rate-metrics-100-times

Time: ✅ 2.211ms (SLO: <2.550ms 📉 -13.3%) vs baseline: +0.9%

Memory: ✅ 32.204MB (SLO: <34.000MB -5.3%) vs baseline: +4.9%

✅ flush-1-metric

Time: ✅ 4.689µs (SLO: <20.000µs 📉 -76.6%) vs baseline: +1.0%

Memory: ✅ 32.224MB (SLO: <34.000MB -5.2%) vs baseline: +5.0%

✅ flush-100-metrics

Time: ✅ 174.249µs (SLO: <250.000µs 📉 -30.3%) vs baseline: -0.6%

Memory: ✅ 32.204MB (SLO: <34.000MB -5.3%) vs baseline: +4.8%

✅ flush-1000-metrics

Time: ✅ 2.121ms (SLO: <2.500ms 📉 -15.2%) vs baseline: ~same

Memory: ✅ 32.893MB (SLO: <34.500MB -4.7%) vs baseline: +4.6%

✅ tracer - 6/6

✅ large

Time: ✅ 29.557ms (SLO: <32.950ms 📉 -10.3%) vs baseline: +0.4%

Memory: ✅ 33.384MB (SLO: <34.500MB -3.2%) vs baseline: +5.0%

✅ medium

Time: ✅ 2.931ms (SLO: <3.200ms -8.4%) vs baseline: +0.6%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.8%

✅ small

Time: ✅ 331.302µs (SLO: <370.000µs 📉 -10.5%) vs baseline: +0.4%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.5%

ℹ️ Scenarios Missing SLO Configuration (9 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

coreapiscenario-core_dispatch_listeners
coreapiscenario-core_dispatch_no_listeners
coreapiscenario-core_dispatch_with_results_listeners
coreapiscenario-core_dispatch_with_results_no_listeners
djangosimple-baseline
errortrackingdjangosimple-baseline
errortrackingflasksqli-baseline
flasksimple-baseline
flasksqli-baseline

…5032) ## Description Corrects the docstring description of the `assessment` argument in `submit_evaluation()`. There is no functional change but the docstring description was incorrect.  ## Testing  ## Risks  ## Additional Notes  (cherry picked from commit 314c76e)

…5032) Corrects the docstring description of the `assessment` argument in `submit_evaluation()`. There is no functional change but the docstring description was incorrect.     (cherry picked from commit 314c76e)

…ckport 3.17] (#15033) Backport 314c76e from #15032 to 3.17. ## Description Corrects the docstring description of the `assessment` argument in `submit_evaluation()`. There is no functional change but the docstring description was incorrect.  ## Testing  ## Risks  ## Additional Notes  Co-authored-by: Yun Kim <35776586+Yun-Kim@users.noreply.github.com>

fix arg name

4a54c5a

Yun-Kim requested review from a team as code owners October 24, 2025 16:40

Yun-Kim requested review from avara1986 and mabdinur October 24, 2025 16:40

Yun-Kim added backport 3.3 backport 3.17 and removed backport 3.3 labels Oct 24, 2025

sabrenner approved these changes Oct 24, 2025

View reviewed changes

Merge branch 'main' into yunkim/fix-assessment-description

da16854

Yun-Kim enabled auto-merge (squash) October 24, 2025 17:05

Yun-Kim merged commit 314c76e into main Oct 24, 2025
503 checks passed

Yun-Kim deleted the yunkim/fix-assessment-description branch October 24, 2025 18:04

dd-octo-sts bot mentioned this pull request Oct 24, 2025

fix(llmobs): fix assessment argument description for custom evals [backport 3.17] #15033

Merged

fix(llmobs): fix assessment argument description for custom evals #15032

fix(llmobs): fix assessment argument description for custom evals #15032

Uh oh!

Conversation

Yun-Kim commented Oct 24, 2025

Description

Testing

Risks

Additional Notes

Uh oh!

github-actions bot commented Oct 24, 2025

Uh oh!

github-actions bot commented Oct 24, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Bootstrap import analysis

Summary

Import time breakdown

Uh oh!

pr-commenter bot commented Oct 24, 2025

Performance SLOs

✅ add_aspect

✅ add_inplace_aspect

✅ add_inplace_noaspect

✅ add_noaspect

✅ bytearray_aspect

✅ bytearray_extend_aspect

✅ bytearray_extend_noaspect

✅ bytearray_noaspect

✅ bytes_aspect

✅ bytes_noaspect

✅ bytesio_aspect

✅ bytesio_noaspect

✅ capitalize_aspect

✅ capitalize_noaspect

✅ casefold_aspect

✅ casefold_noaspect

✅ decode_aspect

✅ decode_noaspect

✅ encode_aspect

✅ encode_noaspect

✅ format_aspect

✅ format_map_aspect

✅ format_map_noaspect

✅ format_noaspect

✅ index_aspect

✅ index_noaspect

✅ join_aspect

✅ join_noaspect

✅ ljust_aspect

✅ ljust_noaspect

✅ lower_aspect

✅ lower_noaspect

✅ lstrip_aspect

✅ lstrip_noaspect

✅ modulo_aspect

✅ modulo_aspect_for_bytearray_bytearray

✅ modulo_aspect_for_bytes

✅ modulo_aspect_for_bytes_bytearray

✅ modulo_noaspect

✅ replace_aspect

✅ replace_noaspect

✅ repr_aspect

✅ repr_noaspect

✅ rstrip_aspect

✅ rstrip_noaspect

✅ slice_aspect

✅ slice_noaspect

✅ stringio_aspect

✅ stringio_noaspect

✅ strip_aspect

✅ strip_noaspect

✅ swapcase_aspect

✅ swapcase_noaspect

✅ title_aspect

✅ title_noaspect

✅ translate_aspect

✅ translate_noaspect

✅ upper_aspect

✅ upper_noaspect

✅ appsec

github-actions bot commented Oct 24, 2025 •

edited

Loading