1 Release published by 1 person

• v3.10.2 3.10.2

  published Jul 9, 2025

59 Pull requests merged by 19 people

• ci: remove async_mode=False from aiothttp and asyncpg tests

  #13985 merged Jul 14, 2025

• ci: remove 2.21 backport action

  #13986 merged Jul 14, 2025

• ci: update system-tests GitHub Actions ref

  #13989 merged Jul 14, 2025

• ci: use dd-octo-sts in package job

  #13948 merged Jul 14, 2025

• docs(readme): replace ci visibility with test optimization

  #13958 merged Jul 14, 2025

• fix(tracing): ensure tracer.wrap preserves decorated function’s type

  #13906 merged Jul 12, 2025

• chore(llmobs): support dataset versioning/description

  #13969 merged Jul 11, 2025

• chore(llmobs): add internal support for creating/getting projects

  #13968 merged Jul 11, 2025

• chore(tracing): avoid resetting Tracer.enabled in Tracer._recreate

  #13745 merged Jul 11, 2025

• chore(profiling): de-flake test_accuracy_stack_v2

  #13944 merged Jul 11, 2025

• chore(llmobs): fix flaky writer test

  #13920 merged Jul 11, 2025

• ci: fix chainguard claim pattern

  #13962 merged Jul 11, 2025

• ci: re-enable pytest output capture

  #13927 merged Jul 11, 2025

• ci(benchmarks): bump lower bounds for max_rss_usage SLOs

  #13961 merged Jul 11, 2025

• chore(ci): riotize-threats-fastapi

  #13939 merged Jul 11, 2025

• ci(benchmarks): increase packages microbenchmarks RSS SLO

  #13959 merged Jul 11, 2025

• ci(benchmarks): increase otelspan-start-finish-telemetry slo threshold

  #13954 merged Jul 11, 2025

• ci: fix subject pattern for dd-octo-sts chainguard

  #13949 merged Jul 10, 2025

• chore(rc): centralize tracing logic, improve debug logging, improve perf

  #13918 merged Jul 10, 2025

• ci(profiling): split v1 and v2 profiling gitlab jobs

  #13953 merged Jul 10, 2025

• ci(benchmark): remove check-big-regressions job

  #13950 merged Jul 10, 2025

• chore(llmobs): add base experiments classes

  #13930 merged Jul 10, 2025

• ci(benchmarks): add reminaing microbenchmark slo thresholds

  #13942 merged Jul 10, 2025

• ci: update gitlab testrunner image

  #13902 merged Jul 10, 2025

• chore: add some more gitignores

  #13940 merged Jul 10, 2025

• feat: set span resource name on 404 status code

  #13864 merged Jul 10, 2025

• ci: add gitlab.github-access.read octo-sts policy

  #13934 merged Jul 10, 2025

• chore(ci): move the pygoat CI step from hatch to riot

  #13395 merged Jul 10, 2025

• chore(tracer): adding additional validation for jsonpath syntax for aws payload tagging

  #13896 merged Jul 10, 2025

• chore(ci): remove errortracking from hatch since it's already on riot

  #13945 merged Jul 10, 2025

• chore(ci): update st

  #13937 merged Jul 10, 2025

• fix(tracer): add extra service names for all spans [backport 3.10]

  #13943 merged Jul 10, 2025

• fix(aap): properly manage large async request bodies

  #13921 merged Jul 10, 2025

• fix(tracer): add extra service names for all spans

  #13922 merged Jul 10, 2025

• chore(tracer): add abstract base class for AgentWriterInterface

  #13876 merged Jul 10, 2025

• chore(sca): add metastruct support for iast

  #13887 merged Jul 10, 2025

• feat(google_genai): apm and llmobs submissions for embed_content google-genai

  #13880 merged Jul 9, 2025

• feat: poc implementation of the OTel Metrics API

  #13780 merged Jul 9, 2025

• ci(benchmark): add tracer and span slos

  #13903 merged Jul 9, 2025

• docs: add end-of-life date estimate to release documentation [DPCYMGMT-2234]

  #13905 merged Jul 9, 2025

• fix(logging): fix issue with dd.* properties not getting injected onto logging records [backport 3.10]

  #13929 merged Jul 9, 2025

• chore(llmobs): add base datasets for experiments

  #13852 merged Jul 9, 2025

• ci: migrate crash tracking tests to the test agent

  #13908 merged Jul 9, 2025

• fix(logging): fix issue with dd.* properties not getting injected onto logging records

  #13924 merged Jul 9, 2025

• chore: fix spelling mistakes in codebase

  #13879 merged Jul 9, 2025

• chore: fix cargo clippy issues with new versions of rust

  #13916 merged Jul 9, 2025

• feat(llmobs): track prompt caching for openai chat completions

  #13755 merged Jul 9, 2025

• chore(llmobs): flaky crew ai test

  #13913 merged Jul 9, 2025

• chore(ci): riotize appsec_threats_flask

  #13858 merged Jul 9, 2025

• ci: update testagent version

  #13911 merged Jul 9, 2025

• chore(ci): riotize appsec_integration_django

  #13868 merged Jul 9, 2025

• chore(ci): riotize appsec_threats_django

  #13891 merged Jul 9, 2025

• chore(ci_visibility): do not require coverage.py for Test Impact Analysis with pytest

  #13889 merged Jul 9, 2025

• ci: introduce SLO based microbenchmark checks

  #13823 merged Jul 8, 2025

• chore: update scripts/ddtest to improve startup time

  #13899 merged Jul 8, 2025

• chore(ci): update system tests version

  #13912 merged Jul 8, 2025

• fix(llmobs): resolve ValueError from token metrics through LLMs with langchain

  #13909 merged Jul 8, 2025

• feat(co): add in-product enablement support

  #13633 merged Jul 8, 2025

• test(di): include botocore in exploration testing

  #13853 merged Jul 8, 2025

38 Pull requests opened by 21 people

• fix(django): simplify django db components

  #13910 opened Jul 8, 2025

• Test check-slo-breaches PR comment

  #13914 opened Jul 8, 2025

• fix(llmobs): fix input tokens counting for anthropic

  #13917 opened Jul 8, 2025

• fix(llmobs): fix input token counting for bedrock prompt caching

  #13919 opened Jul 8, 2025

• chore(ci_visibility): clean up output of pytest tests

  #13923 opened Jul 9, 2025

• feat(llmobs): trace mcp tool calls

  #13925 opened Jul 9, 2025

• fix(lib-injection): don't close stdout/stderr

  #13926 opened Jul 9, 2025

• chore: update span exit typing

  #13932 opened Jul 9, 2025

• perf(rc): avoid calling config subscribers on duplicate values

  #13933 opened Jul 9, 2025

• chore(llmobs/langchain): stop using in-process vcr

  #13935 opened Jul 10, 2025

• [WIP] ddtest local user

  #13936 opened Jul 10, 2025

• Adding cursor rules

  #13946 opened Jul 10, 2025

• fix(di): dynamic function discovery fallback

  #13947 opened Jul 10, 2025

• chore(llmobs): add dataset creation

  #13951 opened Jul 10, 2025

• chore(llmobs): refactor google util functions

  #13952 opened Jul 10, 2025

• chore(llmobs): add support for creating experiment

  #13955 opened Jul 10, 2025

• chore(ci): riotize appsec-iast-native

  #13956 opened Jul 11, 2025

• chore(ci_visibility): remove unused function

  #13960 opened Jul 11, 2025

• chore(profiling): remove unneeded variable and clean up related code

  #13964 opened Jul 11, 2025

• ci(testrunner): add dd-octo-sts and gh cli tools to testrunner image

  #13965 opened Jul 11, 2025

• add debug stmts when gunicorn fails to start

  #13966 opened Jul 11, 2025

• chore(llmobs): support running experiment tasks

  #13970 opened Jul 11, 2025

• fix(tracing): ensure tracer.wrap preserves decorated function’s type [backport 3.10]

  #13972 opened Jul 12, 2025

• chore: update starlette latest version to 0.47.1

  #13973 opened Jul 13, 2025

• chore(ci): remove unused integration_test from hatch

  #13974 opened Jul 14, 2025

• chore(ci): riotize appsec_integrations_packages

  #13975 opened Jul 14, 2025

• fix(iast): eval wrapping error

  #13976 opened Jul 14, 2025

• ci: add global lock detection

  #13977 opened Jul 14, 2025

• Merge profiling and native libraries

  #13978 opened Jul 14, 2025

• fix(iast): ast patching error in mysqlsh

  #13979 opened Jul 14, 2025

• feat(llmobs): annotate bedrock converse `toolResult` input content blocks as tool messages

  #13980 opened Jul 14, 2025

• chore(iast): skip mysqlsh from ast patching

  #13981 opened Jul 14, 2025

• chore(ci_visibility): remove deprecated pytest plugin v1

  #13982 opened Jul 14, 2025

• fix(ci_visibility): fix span parents and finishing logic for test spans

  #13983 opened Jul 14, 2025

• Consolidate libdatadog symbols in lib_native

  #13984 opened Jul 14, 2025

• chore(sampling_rules): remove support for regex and callable matchers

  #13987 opened Jul 14, 2025

• profiling: memory profiler unification draft

  #13988 opened Jul 14, 2025

• ci: improve stability of gunicorn profiling tests

  #13990 opened Jul 14, 2025

3 Issues closed by 3 people

• default dd-trace django Configuration = Results in Duplicate Spans for DB Queries

  #10833 closed Jul 11, 2025

• [BUG]: Change in behavior from `ddtrace` since version `3.10.0`

  #13892 closed Jul 9, 2025

• [FEATURE]: LLM Observability: Take into account Cached Tokens for OpenAI

  #13869 closed Jul 8, 2025

5 Issues opened by 4 people

• [BUG]: llmobs decorators do not have types

  #13971 opened Jul 12, 2025

• [FEATURE]: Provide an in-code means to APM quantization / resource renaming

  #13967 opened Jul 11, 2025

• [BUG]: Build-time deprecation warning about `project.license` usage

  #13963 opened Jul 11, 2025

• [BUG]: AttributeError: 'NoneType' object has no attribute 'lower'

  #13938 opened Jul 10, 2025

• [BUG]: Possibly unnecessary error log about psycopg patching failure

  #13931 opened Jul 9, 2025

42 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• chore(llmobs): dac strip io from OpenAI

  #13791 commented on Jul 14, 2025 • 35 new comments

• feat(llmobs): add datasets and experiments features

  #13314 commented on Jul 11, 2025 • 12 new comments

• chore(llmobs): dac strip io from langchain

  #13673 commented on Jul 14, 2025 • 8 new comments

• feat(pydantic_ai): [MLOB-3199] add PydanticAI llmobs tracing

  #13779 commented on Jul 14, 2025 • 6 new comments

• chore(llmobs): dac strip io from gemini

  #13874 commented on Jul 14, 2025 • 6 new comments

• feat(otel): add support for exporting otlp logs

  #13831 commented on Jul 14, 2025 • 4 new comments

• feat(llmobs): [MLOB-2662] [MLOB-3100] add agent manifest

  #13311 commented on Jul 11, 2025 • 3 new comments

• fix(grpc): leaking spans when using gRPC future interface

  #13847 commented on Jul 11, 2025 • 3 new comments

• chore(writer): implement native writer

  #13071 commented on Jul 14, 2025 • 3 new comments

• fix(encoding): fix encoding errors when span start or duration exceeds LONG_MAX

  #12368 commented on Jul 11, 2025 • 3 new comments

• fix(profiling): make explicitly marked main packages "my code"

  #13649 commented on Jul 14, 2025 • 2 new comments

• chore: configurable logger levels

  #13562 commented on Jul 9, 2025 • 2 new comments

• remove logic that uses import importlib_metadata

  #13809 commented on Jul 8, 2025 • 2 new comments

• chore(tracing): break circular imports and remove python2 types

  #13091 commented on Jul 14, 2025 • 1 new comment

• feat: add additional tracing on websockets

  #13332 commented on Jul 14, 2025 • 1 new comment

• fix(ci_visibility): split payload in chunks if needed

  #13825 commented on Jul 14, 2025 • 0 new comments

• fix(grpc): leaking spans when using gRPC future interface [CLONE]

  #13870 commented on Jul 11, 2025 • 0 new comments

• refactor(tracing): wrapping context for asyncio patching

  #13883 commented on Jul 8, 2025 • 0 new comments

• chore: update dramatiq latest version to 1.18.0

  #13888 commented on Jul 9, 2025 • 0 new comments

• feat(llmobs): allow span processor to return None to omit spans

  #13739 commented on Jul 10, 2025 • 0 new comments

• [MLOB-3112] make shared base classes for llmobs traced streams

  #13736 commented on Jul 11, 2025 • 0 new comments

• chore: refactor SpanAggregator <> TraceWriter interface

  #13894 commented on Jul 14, 2025 • 0 new comments

• profiling(rnd): adding linux perf to benchmarks

  #13898 commented on Jul 8, 2025 • 0 new comments

• ci: add vpa template configuration with 2x oom scaling factor and min cap

  #13669 commented on Jul 14, 2025 • 0 new comments

• feat(llmobs): langgraph submits agent manifest

  #13904 commented on Jul 14, 2025 • 0 new comments

• [BUG]: ddtrace.settings._config.Config is not deepcopy-able

  #13359 commented on Jul 8, 2025 • 0 new comments

• [BUG]: Incompatibility with `redis-py 6.2.0`: Removed `_command_stack` breaks `ddtrace` async patching

  #13598 commented on Jul 8, 2025 • 0 new comments

• [BUG]: Lazy import of debugging product is broken with Python 3.11 and bytecode < 0.15.1

  #12697 commented on Jul 9, 2025 • 0 new comments

• [BUG]: ddtrace throws logging exception during unit test runs with pytest

  #12018 commented on Jul 11, 2025 • 0 new comments

• [FEATURE]: Enable trace context propagation for async background tasks in LLM observability

  #13795 commented on Jul 11, 2025 • 0 new comments

• [BUG]: tracer.wrap overrides the type of the decorated function

  #13637 commented on Jul 11, 2025 • 0 new comments

• [BUG]: Metrics and Traces are not Correlated

  #13366 commented on Jul 12, 2025 • 0 new comments

• [BUG]: openai token count tracking: ValueError when the prompt contains <|endoftext|>

  #13397 commented on Jul 13, 2025 • 0 new comments

• [BUG]: `Error uploading (failed ddog_prof_Exporter_send: operation timed out)`

  #12814 commented on Jul 13, 2025 • 0 new comments

• [BUG]: `openai` integration failing due to circular import

  #13405 commented on Jul 14, 2025 • 0 new comments

• refactor(crashtracker): use PyO3 for crashtracker module and crashtracker_exe

  #12690 commented on Jul 7, 2025 • 0 new comments

• chore(tracing): deprecate ddtrace.settings

  #13057 commented on Jul 11, 2025 • 0 new comments

• fix(profiling): join v2 sampling thread on exit

  #13351 commented on Jul 9, 2025 • 0 new comments

• perf(telemetry): batch telemetry events into one request

  #13354 commented on Jul 11, 2025 • 0 new comments

• chore(lib): reduce noise in debug logs

  #13488 commented on Jul 14, 2025 • 0 new comments

• Merge profiling and libnative libraries.

  #13603 commented on Jul 14, 2025 • 0 new comments

• chore(profiling): delete set_max_nframes and its references

  #13641 commented on Jul 13, 2025 • 0 new comments