Fix Test Optimization to work with JDK 24 #9114

nikita-tkachenko-datadog · 2025-07-07T12:17:55Z

What Does This Do

Fixes Test Optimization to work with JDK 24.

Additional Note

Updates DD Javac Plugin and Jacoco dependencies injected by Test Optimization to their latest versions supporting JDK 24.
Update Spock dependency in a Maven smoke test case to one that supports JDK 24.
Fix Gradle version comparison in Gradle smoke tests.

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2025-07-07T12:49:35Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/maven-gradle-smoke-tests-jvm24
git_commit_date	1751873095	1751890505
git_commit_sha	`bbdc0b7`	`ae6e385`
release_version	1.51.0-SNAPSHOT~bbdc0b7f15	1.51.0-SNAPSHOT~ae6e3853a9

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1751892307	1751892307
ci_job_id	1015778685	1015778685
ci_pipeline_id	69764364	69764364
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-1i1n81ue 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-1i1n81ue 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 43 metrics, 10 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.51.0-SNAPSHOT~ae6e3853a9, baseline=1.51.0-SNAPSHOT~bbdc0b7f15

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (992.117 ms) : 0, 992117
Total [baseline] (10.62 s) : 0, 10619517
Agent [candidate] (1.006 s) : 0, 1006308
Total [candidate] (10.776 s) : 0, 10776131
section appsec
Agent [baseline] (1.179 s) : 0, 1178719
Total [baseline] (10.757 s) : 0, 10756863
Agent [candidate] (1.191 s) : 0, 1191025
Total [candidate] (10.881 s) : 0, 10881215
section iast
Agent [baseline] (1.136 s) : 0, 1136486
Total [baseline] (10.103 s) : 0, 10102633
Agent [candidate] (1.141 s) : 0, 1140525
Total [candidate] (10.884 s) : 0, 10883963
section profiling
Agent [baseline] (1.252 s) : 0, 1251528
Total [baseline] (10.934 s) : 0, 10933672
Agent [candidate] (1.261 s) : 0, 1260520
Total [candidate] (11.13 s) : 0, 11130362

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	992.117 ms	-
Agent	appsec	1.179 s	186.601 ms (18.8%)
Agent	iast	1.136 s	144.369 ms (14.6%)
Agent	profiling	1.252 s	259.411 ms (26.1%)
Total	tracing	10.62 s	-
Total	appsec	10.757 s	137.346 ms (1.3%)
Total	iast	10.103 s	-516.884 ms (-4.9%)
Total	profiling	10.934 s	314.155 ms (3.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.006 s	-
Agent	appsec	1.191 s	184.717 ms (18.4%)
Agent	iast	1.141 s	134.217 ms (13.3%)
Agent	profiling	1.261 s	254.212 ms (25.3%)
Total	tracing	10.776 s	-
Total	appsec	10.881 s	105.085 ms (1.0%)
Total	iast	10.884 s	107.832 ms (1.0%)
Total	profiling	11.13 s	354.231 ms (3.3%)

gantt
    title petclinic - break down per module: candidate=1.51.0-SNAPSHOT~ae6e3853a9, baseline=1.51.0-SNAPSHOT~bbdc0b7f15

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (684.449 ms) : 0, 684449
BytebuddyAgent [candidate] (694.772 ms) : 0, 694772
GlobalTracer [baseline] (241.866 ms) : 0, 241866
GlobalTracer [candidate] (244.566 ms) : 0, 244566
AppSec [baseline] (30.145 ms) : 0, 30145
AppSec [candidate] (30.72 ms) : 0, 30720
Debugger [baseline] (6.037 ms) : 0, 6037
Debugger [candidate] (6.188 ms) : 0, 6188
Remote Config [baseline] (675.924 µs) : 0, 676
Remote Config [candidate] (691.817 µs) : 0, 692
Telemetry [baseline] (8.21 ms) : 0, 8210
Telemetry [candidate] (8.289 ms) : 0, 8289
section appsec
BytebuddyAgent [baseline] (713.356 ms) : 0, 713356
BytebuddyAgent [candidate] (721.217 ms) : 0, 721217
GlobalTracer [baseline] (235.841 ms) : 0, 235841
GlobalTracer [candidate] (237.772 ms) : 0, 237772
IAST [baseline] (23.322 ms) : 0, 23322
IAST [candidate] (23.591 ms) : 0, 23591
AppSec [baseline] (171.019 ms) : 0, 171019
AppSec [candidate] (172.672 ms) : 0, 172672
Debugger [baseline] (5.709 ms) : 0, 5709
Debugger [candidate] (5.807 ms) : 0, 5807
Remote Config [baseline] (591.153 µs) : 0, 591
Remote Config [candidate] (615.23 µs) : 0, 615
Telemetry [baseline] (8.044 ms) : 0, 8044
Telemetry [candidate] (8.166 ms) : 0, 8166
section iast
BytebuddyAgent [baseline] (809.895 ms) : 0, 809895
BytebuddyAgent [candidate] (812.06 ms) : 0, 812060
GlobalTracer [baseline] (233.364 ms) : 0, 233364
GlobalTracer [candidate] (234.677 ms) : 0, 234677
IAST [baseline] (29.797 ms) : 0, 29797
IAST [candidate] (28.204 ms) : 0, 28204
AppSec [baseline] (27.977 ms) : 0, 27977
AppSec [candidate] (29.949 ms) : 0, 29949
Debugger [baseline] (5.911 ms) : 0, 5911
Debugger [candidate] (5.904 ms) : 0, 5904
Remote Config [baseline] (596.814 µs) : 0, 597
Remote Config [candidate] (607.508 µs) : 0, 608
Telemetry [baseline] (8.114 ms) : 0, 8114
Telemetry [candidate] (8.132 ms) : 0, 8132
section profiling
BytebuddyAgent [baseline] (681.788 ms) : 0, 681788
BytebuddyAgent [candidate] (686.593 ms) : 0, 686593
GlobalTracer [baseline] (363.456 ms) : 0, 363456
GlobalTracer [candidate] (365.264 ms) : 0, 365264
AppSec [baseline] (31.114 ms) : 0, 31114
AppSec [candidate] (32.761 ms) : 0, 32761
Debugger [baseline] (12.81 ms) : 0, 12810
Debugger [candidate] (12.405 ms) : 0, 12405
Remote Config [baseline] (661.264 µs) : 0, 661
Remote Config [candidate] (664.476 µs) : 0, 664
Telemetry [baseline] (8.838 ms) : 0, 8838
Telemetry [candidate] (8.196 ms) : 0, 8196
ProfilingAgent [baseline] (104.116 ms) : 0, 104116
ProfilingAgent [candidate] (105.555 ms) : 0, 105555
Profiling [baseline] (104.141 ms) : 0, 104141
Profiling [candidate] (105.58 ms) : 0, 105580

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.51.0-SNAPSHOT~ae6e3853a9, baseline=1.51.0-SNAPSHOT~bbdc0b7f15

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (995.571 ms) : 0, 995571
Total [baseline] (8.578 s) : 0, 8578224
Agent [candidate] (1.008 s) : 0, 1007700
Total [candidate] (8.637 s) : 0, 8637436
section iast
Agent [baseline] (1.148 s) : 0, 1147786
Total [baseline] (9.327 s) : 0, 9326925
Agent [candidate] (1.141 s) : 0, 1141141
Total [candidate] (9.335 s) : 0, 9334851

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	995.571 ms	-
Agent	iast	1.148 s	152.215 ms (15.3%)
Total	tracing	8.578 s	-
Total	iast	9.327 s	748.701 ms (8.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.008 s	-
Agent	iast	1.141 s	133.441 ms (13.2%)
Total	tracing	8.637 s	-
Total	iast	9.335 s	697.415 ms (8.1%)

gantt
    title insecure-bank - break down per module: candidate=1.51.0-SNAPSHOT~ae6e3853a9, baseline=1.51.0-SNAPSHOT~bbdc0b7f15

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (687.857 ms) : 0, 687857
BytebuddyAgent [candidate] (695.865 ms) : 0, 695865
GlobalTracer [baseline] (241.644 ms) : 0, 241644
GlobalTracer [candidate] (244.983 ms) : 0, 244983
AppSec [baseline] (30.285 ms) : 0, 30285
AppSec [candidate] (30.664 ms) : 0, 30664
Debugger [baseline] (6.081 ms) : 0, 6081
Debugger [candidate] (6.143 ms) : 0, 6143
Remote Config [baseline] (683.251 µs) : 0, 683
Remote Config [candidate] (684.739 µs) : 0, 685
Telemetry [baseline] (8.202 ms) : 0, 8202
Telemetry [candidate] (8.326 ms) : 0, 8326
section iast
BytebuddyAgent [baseline] (818.696 ms) : 0, 818696
BytebuddyAgent [candidate] (811.924 ms) : 0, 811924
GlobalTracer [baseline] (235.369 ms) : 0, 235369
GlobalTracer [candidate] (235.165 ms) : 0, 235165
IAST [baseline] (26.676 ms) : 0, 26676
IAST [candidate] (29.108 ms) : 0, 29108
AppSec [baseline] (31.351 ms) : 0, 31351
AppSec [candidate] (29.176 ms) : 0, 29176
Debugger [baseline] (5.872 ms) : 0, 5872
Debugger [candidate] (6.012 ms) : 0, 6012
Remote Config [baseline] (590.573 µs) : 0, 591
Remote Config [candidate] (617.749 µs) : 0, 618
Telemetry [baseline] (8.141 ms) : 0, 8141
Telemetry [candidate] (8.22 ms) : 0, 8220

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/maven-gradle-smoke-tests-jvm24
git_commit_date	1751873095	1751890505
git_commit_sha	`bbdc0b7`	`ae6e385`
release_version	1.51.0-SNAPSHOT~bbdc0b7f15	1.51.0-SNAPSHOT~ae6e3853a9

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1751892008	1751892008
ci_job_id	1015778686	1015778686
ci_pipeline_id	69764364	69764364
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-bwhxiek8 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-bwhxiek8 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load	worse [+468.686µs; +870.449µs] or [+4.527%; +8.407%]	unstable [-84.336op/s; +30.523op/s] or [-18.796%; +6.803%]	11.024ms	421.781op/s	10.354ms	448.688op/s
scenario:load:petclinic:profiling:high_load	better [-2.414ms; -1.443ms] or [-4.810%; -2.876%]	unstable [-3.391op/s; +10.816op/s] or [-3.636%; +11.599%]	48.265ms	96.963op/s	50.194ms	93.250op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~ae6e3853a9, baseline=1.51.0-SNAPSHOT~bbdc0b7f15
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.424 ms) : 4374, 4474
.   : milestone, 4424,
iast (9.256 ms) : 9106, 9406
.   : milestone, 9256,
iast_FULL (13.848 ms) : 13574, 14122
.   : milestone, 13848,
iast_GLOBAL (10.354 ms) : 10175, 10533
.   : milestone, 10354,
profiling (8.895 ms) : 8746, 9044
.   : milestone, 8895,
tracing (7.681 ms) : 7573, 7789
.   : milestone, 7681,
section candidate
no_agent (4.403 ms) : 4346, 4460
.   : milestone, 4403,
iast (9.455 ms) : 9293, 9616
.   : milestone, 9455,
iast_FULL (14.082 ms) : 13792, 14372
.   : milestone, 14082,
iast_GLOBAL (11.024 ms) : 10829, 11218
.   : milestone, 11024,
profiling (8.731 ms) : 8599, 8864
.   : milestone, 8731,
tracing (7.792 ms) : 7673, 7911
.   : milestone, 7792,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.424 ms [4.374 ms, 4.474 ms]	-
iast	9.256 ms [9.106 ms, 9.406 ms]	4.832 ms (109.2%)
iast_FULL	13.848 ms [13.574 ms, 14.122 ms]	9.424 ms (213.0%)
iast_GLOBAL	10.354 ms [10.175 ms, 10.533 ms]	5.93 ms (134.0%)
profiling	8.895 ms [8.746 ms, 9.044 ms]	4.471 ms (101.1%)
tracing	7.681 ms [7.573 ms, 7.789 ms]	3.257 ms (73.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.403 ms [4.346 ms, 4.46 ms]	-
iast	9.455 ms [9.293 ms, 9.616 ms]	5.051 ms (114.7%)
iast_FULL	14.082 ms [13.792 ms, 14.372 ms]	9.679 ms (219.8%)
iast_GLOBAL	11.024 ms [10.829 ms, 11.218 ms]	6.62 ms (150.4%)
profiling	8.731 ms [8.599 ms, 8.864 ms]	4.328 ms (98.3%)
tracing	7.792 ms [7.673 ms, 7.911 ms]	3.388 ms (77.0%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~ae6e3853a9, baseline=1.51.0-SNAPSHOT~bbdc0b7f15
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.708 ms) : 37405, 38010
.   : milestone, 37708,
appsec (48.279 ms) : 47857, 48700
.   : milestone, 48279,
code_origins (45.999 ms) : 45605, 46392
.   : milestone, 45999,
iast (43.614 ms) : 43251, 43978
.   : milestone, 43614,
profiling (50.194 ms) : 49716, 50672
.   : milestone, 50194,
tracing (42.862 ms) : 42500, 43224
.   : milestone, 42862,
section candidate
no_agent (38.526 ms) : 38219, 38833
.   : milestone, 38526,
appsec (48.637 ms) : 48205, 49070
.   : milestone, 48637,
code_origins (46.003 ms) : 45601, 46406
.   : milestone, 46003,
iast (43.584 ms) : 43207, 43961
.   : milestone, 43584,
profiling (48.265 ms) : 47843, 48688
.   : milestone, 48265,
tracing (43.321 ms) : 42969, 43674
.   : milestone, 43321,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.708 ms [37.405 ms, 38.01 ms]	-
appsec	48.279 ms [47.857 ms, 48.7 ms]	10.571 ms (28.0%)
code_origins	45.999 ms [45.605 ms, 46.392 ms]	8.291 ms (22.0%)
iast	43.614 ms [43.251 ms, 43.978 ms]	5.907 ms (15.7%)
profiling	50.194 ms [49.716 ms, 50.672 ms]	12.487 ms (33.1%)
tracing	42.862 ms [42.5 ms, 43.224 ms]	5.155 ms (13.7%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	38.526 ms [38.219 ms, 38.833 ms]	-
appsec	48.637 ms [48.205 ms, 49.07 ms]	10.112 ms (26.2%)
code_origins	46.003 ms [45.601 ms, 46.406 ms]	7.478 ms (19.4%)
iast	43.584 ms [43.207 ms, 43.961 ms]	5.058 ms (13.1%)
profiling	48.265 ms [47.843 ms, 48.688 ms]	9.74 ms (25.3%)
tracing	43.321 ms [42.969 ms, 43.674 ms]	4.796 ms (12.4%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/maven-gradle-smoke-tests-jvm24
git_commit_date	1751873095	1751890505
git_commit_sha	`bbdc0b7`	`ae6e385`
release_version	1.51.0-SNAPSHOT~bbdc0b7f15	1.51.0-SNAPSHOT~ae6e3853a9

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1751892496	1751892496
ci_job_id	1015778687	1015778687
ci_pipeline_id	69764364	69764364
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-qzsuiq2t 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-qzsuiq2t 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~ae6e3853a9, baseline=1.51.0-SNAPSHOT~bbdc0b7f15
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.48 ms) : 1469, 1492
.   : milestone, 1480,
appsec (2.421 ms) : 2372, 2471
.   : milestone, 2421,
iast (2.207 ms) : 2145, 2270
.   : milestone, 2207,
iast_GLOBAL (2.24 ms) : 2178, 2302
.   : milestone, 2240,
profiling (2.037 ms) : 1988, 2087
.   : milestone, 2037,
tracing (2.02 ms) : 1972, 2068
.   : milestone, 2020,
section candidate
no_agent (1.477 ms) : 1466, 1489
.   : milestone, 1477,
appsec (2.41 ms) : 2361, 2459
.   : milestone, 2410,
iast (2.198 ms) : 2137, 2260
.   : milestone, 2198,
iast_GLOBAL (2.251 ms) : 2188, 2313
.   : milestone, 2251,
profiling (2.041 ms) : 1992, 2091
.   : milestone, 2041,
tracing (2.036 ms) : 1988, 2085
.   : milestone, 2036,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.48 ms [1.469 ms, 1.492 ms]	-
appsec	2.421 ms [2.372 ms, 2.471 ms]	940.815 µs (63.6%)
iast	2.207 ms [2.145 ms, 2.27 ms]	726.847 µs (49.1%)
iast_GLOBAL	2.24 ms [2.178 ms, 2.302 ms]	759.89 µs (51.3%)
profiling	2.037 ms [1.988 ms, 2.087 ms]	556.746 µs (37.6%)
tracing	2.02 ms [1.972 ms, 2.068 ms]	539.438 µs (36.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.477 ms [1.466 ms, 1.489 ms]	-
appsec	2.41 ms [2.361 ms, 2.459 ms]	932.449 µs (63.1%)
iast	2.198 ms [2.137 ms, 2.26 ms]	720.885 µs (48.8%)
iast_GLOBAL	2.251 ms [2.188 ms, 2.313 ms]	773.404 µs (52.3%)
profiling	2.041 ms [1.992 ms, 2.091 ms]	563.693 µs (38.2%)
tracing	2.036 ms [1.988 ms, 2.085 ms]	558.968 µs (37.8%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~ae6e3853a9, baseline=1.51.0-SNAPSHOT~bbdc0b7f15
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.982 s) : 14982000, 14982000
.   : milestone, 14982000,
appsec (14.776 s) : 14776000, 14776000
.   : milestone, 14776000,
iast (18.484 s) : 18484000, 18484000
.   : milestone, 18484000,
iast_GLOBAL (18.078 s) : 18078000, 18078000
.   : milestone, 18078000,
profiling (15.149 s) : 15149000, 15149000
.   : milestone, 15149000,
tracing (14.951 s) : 14951000, 14951000
.   : milestone, 14951000,
section candidate
no_agent (15.243 s) : 15243000, 15243000
.   : milestone, 15243000,
appsec (14.98 s) : 14980000, 14980000
.   : milestone, 14980000,
iast (18.526 s) : 18526000, 18526000
.   : milestone, 18526000,
iast_GLOBAL (18.004 s) : 18004000, 18004000
.   : milestone, 18004000,
profiling (15.066 s) : 15066000, 15066000
.   : milestone, 15066000,
tracing (14.715 s) : 14715000, 14715000
.   : milestone, 14715000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.982 s [14.982 s, 14.982 s]	-
appsec	14.776 s [14.776 s, 14.776 s]	-206.0 ms (-1.4%)
iast	18.484 s [18.484 s, 18.484 s]	3.502 s (23.4%)
iast_GLOBAL	18.078 s [18.078 s, 18.078 s]	3.096 s (20.7%)
profiling	15.149 s [15.149 s, 15.149 s]	167.0 ms (1.1%)
tracing	14.951 s [14.951 s, 14.951 s]	-31.0 ms (-0.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.243 s [15.243 s, 15.243 s]	-
appsec	14.98 s [14.98 s, 14.98 s]	-263.0 ms (-1.7%)
iast	18.526 s [18.526 s, 18.526 s]	3.283 s (21.5%)
iast_GLOBAL	18.004 s [18.004 s, 18.004 s]	2.761 s (18.1%)
profiling	15.066 s [15.066 s, 15.066 s]	-177.0 ms (-1.2%)
tracing	14.715 s [14.715 s, 14.715 s]	-528.0 ms (-3.5%)

github-actions · 2025-07-07T12:58:13Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

| Package | Type | Package file | Manager | Update | Change | |---|---|---|---|---|---| | [com.google.errorprone:error_prone_annotations](https://errorprone.info) ([source](https://github.com/google/error-prone)) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `2.39.0` -> `2.40.0` | | [org.apache.commons:commons-lang3](https://commons.apache.org/proper/commons-lang/) ([source](https://gitbox.apache.org/repos/asf/commons-lang.git)) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `3.17.0` -> `3.18.0` | | [org.jetbrains.kotlinx.binary-compatibility-validator](https://github.com/Kotlin/binary-compatibility-validator) | plugin | misk/gradle/libs.versions.toml | gradle | patch | `0.18.0` -> `0.18.1` | | [com.datadoghq:dd-trace-api](https://github.com/datadog/dd-trace-java) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `1.50.1` -> `1.51.0` | | [software.amazon.awssdk:sdk-core](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.77` -> `2.31.78` | | [software.amazon.awssdk:sqs](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.77` -> `2.31.78` | | [software.amazon.awssdk:dynamodb-enhanced](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.77` -> `2.31.78` | | [software.amazon.awssdk:dynamodb](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.77` -> `2.31.78` | | [software.amazon.awssdk:aws-core](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.77` -> `2.31.78` | | [software.amazon.awssdk:bom](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.77` -> `2.31.78` | | [software.amazon.awssdk:auth](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.77` -> `2.31.78` | --- ### Release Notes <details> <summary>google/error-prone (com.google.errorprone:error_prone_annotations)</summary> ### [`v2.40.0`](https://github.com/google/error-prone/releases/tag/v2.40.0): Error Prone 2.40.0 Changes: - Bug fixes and improvements - Releases (including snapshots) have migrated from [OSSRH to the Central Publisher Portal](https://central.sonatype.org/pages/ossrh-eol/#process-to-migrate) Full changelog: google/error-prone@v2.39.0...v2.40.0 </details> <details> <summary>Kotlin/binary-compatibility-validator (org.jetbrains.kotlinx.binary-compatibility-validator)</summary> ### [`v0.18.1`](https://github.com/Kotlin/binary-compatibility-validator/releases/tag/0.18.1) [Compare Source](Kotlin/binary-compatibility-validator@0.18.0...0.18.1) #### What's Changed - Fixed a bug preventing use of cross-compilation support during KLIB dump validation \[[#304](https://github.com/Kotlin/binary-compatibility-validator/issues/304)]\[[#306](https://github.com/Kotlin/binary-compatibility-validator/issues/306)] </details> <details> <summary>datadog/dd-trace-java (com.datadoghq:dd-trace-api)</summary> ### [`v1.51.0`](https://github.com/DataDog/dd-trace-java/releases/tag/v1.51.0): 1.51.0 ### Components #### Application Security Management (IAST) - 🐛 Fix verify error when ctor params are used after a call site ([#9083](DataDog/dd-trace-java#9083) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - 🐛 Limit the maximum size of the location path in IAST vulnerabilities ([#9028](DataDog/dd-trace-java#9028) - [@jandro996](https://github.com/jandro996)) - 🐛 Fix IAST gRPC handler with null superclass ([#8984](DataDog/dd-trace-java#8984) - [@smola](https://github.com/smola)) - ✨ Optimize IAST Vulnerability Detection ([#8885](DataDog/dd-trace-java#8885) - [@jandro996](https://github.com/jandro996)) #### Application Security Management (WAF) - ✨ Upgrade libddwaf-java to 15.0.0 ([#9022](DataDog/dd-trace-java#9022) - [@sezen-datadog](https://github.com/sezen-datadog)) - ✨ Extract RestEasy json body response schemas ([#9015](DataDog/dd-trace-java#9015) - [@jandro996](https://github.com/jandro996)) - ✨ Extract Jersey json body response schemas ([#9014](DataDog/dd-trace-java#9014) - [@jandro996](https://github.com/jandro996)) - ✨ Extract Ratpack json body response schemas ([#9013](DataDog/dd-trace-java#9013) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - ✨ Enable API Security by default and make it lazy loading ([#9009](DataDog/dd-trace-java#9009) - [@smola](https://github.com/smola)) - ✨ Extract Vert.x json body response schemas ([#9001](DataDog/dd-trace-java#9001) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - ✨ Extract Play json body response schemas ([#8995](DataDog/dd-trace-java#8995) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - 🐛 Fix Jackson nodes introspection for request/response schema extraction ([#8980](DataDog/dd-trace-java#8980) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - ✨ Extract Spring json body response schemas ([#8938](DataDog/dd-trace-java#8938) - [@sezen-datadog](https://github.com/sezen-datadog)) - ✨ Default obfuscation regexp update ([#8937](DataDog/dd-trace-java#8937) - [@sezen-datadog](https://github.com/sezen-datadog)) #### Build & Tooling - ✨ Cancel GitLab running pipeline on new PR push ([#9023](DataDog/dd-trace-java#9023) - [@PerfectSlayer](https://github.com/PerfectSlayer)) - ✨ Migrate publishing to Maven Central Portal ([#8807](DataDog/dd-trace-java#8807) - [@sarahchen6](https://github.com/sarahchen6)) #### Continuous Integration Visibility - 🐛 Fix Test Optimization to work with JDK 24 ([#9114](DataDog/dd-trace-java#9114) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - ✨ Add repo root as safe directory on git client creation ([#9033](DataDog/dd-trace-java#9033) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Add PR number tag and improve PR information building ([#8990](DataDog/dd-trace-java#8990) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Update impacted tests logic ([#8923](DataDog/dd-trace-java#8923) - [@daniel-mohedano](https://github.com/daniel-mohedano)) #### Data Streams Monitoring - 🧹 Clean up DSM context injection ([#8776](DataDog/dd-trace-java#8776) - [@PerfectSlayer](https://github.com/PerfectSlayer)) #### Database Monitoring - 🐛 Set trace\_injected in try block ([#9025](DataDog/dd-trace-java#9025) - [@natashadada](https://github.com/natashadada)) #### Dynamic Instrumentation - 🐛 Add source file tracking enable option ([#9115](DataDog/dd-trace-java#9115) - [@jpbempel](https://github.com/jpbempel)) - ✨ Add java.util.Date support ([#9111](DataDog/dd-trace-java#9111) - [@jpbempel](https://github.com/jpbempel)) - ✨ Update file probe format ([#9047](DataDog/dd-trace-java#9047) - [@jpbempel](https://github.com/jpbempel)) - ✨ add safe local var hoisting ([#9034](DataDog/dd-trace-java#9034) - [@jpbempel](https://github.com/jpbempel)) - 🧹 Add new config for debugger upload interval ([#8959](DataDog/dd-trace-java#8959) - [@jpbempel](https://github.com/jpbempel)) - ✨ Enable Code Origin with Dynamic instrumentation ([#8940](DataDog/dd-trace-java#8940) - [@jpbempel](https://github.com/jpbempel)) #### ML Observability (LLMObs) - 💡 LLM Observability SDK ([#8781](DataDog/dd-trace-java#8781) - [@gary-huang](https://github.com/gary-huang), [@nayeem-kamal](https://github.com/nayeem-kamal)) #### Metrics - 🐛 Ensure client stat reporter is started when the agent is not available at bootstrap ([#9082](DataDog/dd-trace-java#9082) - [@amarziali](https://github.com/amarziali)) - ✨ Create metric: appsec.waf.config\_errors ([#8394](DataDog/dd-trace-java#8394) - [@sezen-datadog](https://github.com/sezen-datadog)) #### Platform components - ✨ Introduce environment component ([#9071](DataDog/dd-trace-java#9071) - [@PerfectSlayer](https://github.com/PerfectSlayer)) #### Profiling - 🐛 Remove annoying warning for smap event parsing ([#9119](DataDog/dd-trace-java#9119) - [@jbachorik](https://github.com/jbachorik)) - 🐛 Fix ByteCountingInputStream when reading past EOF ([#8988](DataDog/dd-trace-java#8988) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) #### Realtime User Monitoring - ✨ Add RUM SDK injection for servlet based web servers ([#9110](DataDog/dd-trace-java#9110) - [@PerfectSlayer](https://github.com/PerfectSlayer) [@amarziali](https://github.com/amarziali)) #### Telemetry - ✨ Update the config origin metric to match what it's mapping ([#9045](DataDog/dd-trace-java#9045) - [@sezen-datadog](https://github.com/sezen-datadog)) #### Testing - ✨ Add testing for latest stable version (JDK 24) ([#8875](DataDog/dd-trace-java#8875) - [@sarahchen6](https://github.com/sarahchen6)) #### Trace context propagation - 🐛 Fix bug with dropping baggage when `TracePropagationBehaviorExtract=IGNORE` ([#9037](DataDog/dd-trace-java#9037) - [@mhlidd](https://github.com/mhlidd)) - 🐛 Fix ArrayIndexOutOfBoundsException in PercentEscaper ([#9032](DataDog/dd-trace-java#9032) - [@mhlidd](https://github.com/mhlidd)) #### Tracer core - 🐛 Fix `Error` handling for trace interceptors ([#9097](DataDog/dd-trace-java#9097) - [@AlexeyKuznetsov-DD](https://github.com/AlexeyKuznetsov-DD)) - 💡 Add wildcard feature for `DD_TRACE_HEADER_TAGS` and enabling for Http Response headers ([#9067](DataDog/dd-trace-java#9067) - [@mhlidd](https://github.com/mhlidd)) #### Tracer public API - 💡 Add LLM Observability SDK ([#8781](DataDog/dd-trace-java#8781) - [@gary-huang](https://github.com/gary-huang)) ### Instrumentations #### Akka instrumentation - 🐛 Fix NPE in akka-http and pekko-http integrations ([#9019](DataDog/dd-trace-java#9019) - [@mcculls](https://github.com/mcculls)) #### Eclipse Vert.x instrumentation - ✨ Extract Vert.x json body response schemas ([#9001](DataDog/dd-trace-java#9001) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - ✨ Write http.route tag as soon as possible in vert.x ([#8952](DataDog/dd-trace-java#8952) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) #### JAX-WS instrumentation - 💡⚠️ Enable jax-ws integration by default ([#9030](DataDog/dd-trace-java#9030) - [@bm1549](https://github.com/bm1549)) - ✨ Extract Jersey json body response schemas ([#9014](DataDog/dd-trace-java#9014) - [@jandro996](https://github.com/jandro996)) #### Mule instrumentation - 🐛 Propagate grizzly http span in filters if nothing is active ([#9016](DataDog/dd-trace-java#9016) - [@amarziali](https://github.com/amarziali)) #### Play Framework instrumentation - ✨ Extract Play json body response schemas ([#8995](DataDog/dd-trace-java#8995) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) #### Ratpack instrumentation - ✨ Extract Ratpack json body response schemas ([#9013](DataDog/dd-trace-java#9013) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) #### Spring instrumentation - ✨ Extract Spring json body response schemas ([#8938](DataDog/dd-trace-java#8938) - [@sezen-datadog](https://github.com/sezen-datadog)) </details> --- ### Configuration 📅 **Schedule**: Branch creation - "after 6pm every weekday,before 2am every weekday" in timezone Australia/Melbourne, Automerge - At any time (no schedule defined). 🚦 **Automerge**: Enabled. ♻ **Rebasing**: Never, or you tick the rebase/retry checkbox. 👻 **Immortal**: This PR will be recreated if closed unmerged. Get [config help](https://github.com/renovatebot/renovate/discussions) if that's undesired. --- - [ ] If you want to rebase/retry this PR, check this box --- This PR has been generated by [Renovate Bot](https://github.com/renovatebot/renovate). GitOrigin-RevId: 649b690d4c9d7dcb572c457f0802b42b8e3e682e

Fix Test Optimization to work with JDK 24

ae6e385

nikita-tkachenko-datadog added the comp: ci visibility Continuous Integration Visibility label Jul 7, 2025

nikita-tkachenko-datadog marked this pull request as ready for review July 7, 2025 12:57

nikita-tkachenko-datadog requested review from a team as code owners July 7, 2025 12:57

nikita-tkachenko-datadog requested review from daniel-mohedano and smola July 7, 2025 12:57

nikita-tkachenko-datadog added the type: task label Jul 7, 2025

daniel-mohedano approved these changes Jul 7, 2025

View reviewed changes

nikita-tkachenko-datadog merged commit 6cca46e into master Jul 7, 2025
511 of 513 checks passed

nikita-tkachenko-datadog deleted the nikita-tkachenko/maven-gradle-smoke-tests-jvm24 branch July 7, 2025 13:46

github-actions bot added this to the 1.51.0 milestone Jul 7, 2025

PerfectSlayer added the type: enhancement Enhancements and improvements label Jul 10, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Fix Test Optimization to work with JDK 24 #9114

Fix Test Optimization to work with JDK 24 #9114

Uh oh!

nikita-tkachenko-datadog commented Jul 7, 2025

Uh oh!

pr-commenter bot commented Jul 7, 2025

Uh oh!

github-actions bot commented Jul 7, 2025

Uh oh!

Uh oh!

Uh oh!

Fix Test Optimization to work with JDK 24 #9114

Fix Test Optimization to work with JDK 24 #9114

Uh oh!

Conversation

nikita-tkachenko-datadog commented Jul 7, 2025

What Does This Do

Additional Note

Contributor Checklist

Uh oh!

pr-commenter bot commented Jul 7, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

github-actions bot commented Jul 7, 2025

Uh oh!

Uh oh!

Uh oh!