Add GraalVM 25 image to CI #9562

sarahchen6 · 2025-09-18T14:38:57Z

What Does This Do

Add GraalVM 25 image to CI

Motivation

Additional Notes

GraalVM 25 fails with JFR initialization. Adding the -XX:StartFlightRecording=filename=${testJfrDir}/recording.jfr flag to the createProcessBuilder() method in the dd-smoke-tests/spring-boot-3.0-native/src/test/groovy/SpringBootNativeInstrumentationTest.groovy file resolves the issue, but this flag should not be necessary because we're using the Java API to start the recording. Instead of blocking adding the image to CI on this profiling feature, I added a TODO comment that includes the related Jira ticket: https://datadoghq.atlassian.net/browse/PROF-12742.

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: https://datadoghq.atlassian.net/browse/LANGPLAT-83

datadog-official · 2025-09-18T15:00:31Z

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.77% (-0.05%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 933519d | Docs | Was this helpful? Give us feedback!}

pr-commenter · 2025-09-18T15:14:26Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/test-graalvm25
git_commit_date	1760545829	1760555043
git_commit_sha	`425276d`	`933519d`
release_version	1.55.0-SNAPSHOT~425276dceb	1.54.0-SNAPSHOT~933519d61c

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1760556886	1760556886
ci_job_id	1181373362	1181373362
ci_pipeline_id	79420171	79420171
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-hdcz6i0u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-hdcz6i0u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 3 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~933519d61c, baseline=1.55.0-SNAPSHOT~425276dceb

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.022 s) : 0, 1021865
Total [baseline] (8.656 s) : 0, 8656449
Agent [candidate] (1.015 s) : 0, 1014889
Total [candidate] (8.627 s) : 0, 8627481
section iast
Agent [baseline] (1.15 s) : 0, 1150181
Total [baseline] (9.277 s) : 0, 9277433
Agent [candidate] (1.159 s) : 0, 1159488
Total [candidate] (9.285 s) : 0, 9284801

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.022 s	-
Agent	iast	1.15 s	128.317 ms (12.6%)
Total	tracing	8.656 s	-
Total	iast	9.277 s	620.984 ms (7.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.015 s	-
Agent	iast	1.159 s	144.599 ms (14.2%)
Total	tracing	8.627 s	-
Total	iast	9.285 s	657.32 ms (7.6%)

gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~933519d61c, baseline=1.55.0-SNAPSHOT~425276dceb

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.475 ms) : 0, 1475
crashtracking [candidate] (1.471 ms) : 0, 1471
BytebuddyAgent [baseline] (695.905 ms) : 0, 695905
BytebuddyAgent [candidate] (691.108 ms) : 0, 691108
GlobalTracer [baseline] (243.445 ms) : 0, 243445
GlobalTracer [candidate] (241.521 ms) : 0, 241521
AppSec [baseline] (32.88 ms) : 0, 32880
AppSec [candidate] (32.333 ms) : 0, 32333
Debugger [baseline] (6.53 ms) : 0, 6530
Debugger [candidate] (6.419 ms) : 0, 6419
Remote Config [baseline] (694.609 µs) : 0, 695
Remote Config [candidate] (691.275 µs) : 0, 691
Telemetry [baseline] (9.361 ms) : 0, 9361
Telemetry [candidate] (9.31 ms) : 0, 9310
Flare Poller [baseline] (10.381 ms) : 0, 10381
Flare Poller [candidate] (10.971 ms) : 0, 10971
section iast
crashtracking [baseline] (1.51 ms) : 0, 1510
crashtracking [candidate] (1.481 ms) : 0, 1481
BytebuddyAgent [baseline] (814.868 ms) : 0, 814868
BytebuddyAgent [candidate] (821.518 ms) : 0, 821518
GlobalTracer [baseline] (231.045 ms) : 0, 231045
GlobalTracer [candidate] (232.92 ms) : 0, 232920
IAST [baseline] (26.422 ms) : 0, 26422
IAST [candidate] (26.808 ms) : 0, 26808
AppSec [baseline] (35.186 ms) : 0, 35186
AppSec [candidate] (35.277 ms) : 0, 35277
Debugger [baseline] (6.113 ms) : 0, 6113
Debugger [candidate] (6.264 ms) : 0, 6264
Remote Config [baseline] (601.388 µs) : 0, 601
Remote Config [candidate] (615.63 µs) : 0, 616
Telemetry [baseline] (8.648 ms) : 0, 8648
Telemetry [candidate] (8.825 ms) : 0, 8825
Flare Poller [baseline] (4.284 ms) : 0, 4284
Flare Poller [candidate] (4.182 ms) : 0, 4182

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~933519d61c, baseline=1.55.0-SNAPSHOT~425276dceb

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.032 s) : 0, 1031988
Total [baseline] (10.736 s) : 0, 10735533
Agent [candidate] (1.015 s) : 0, 1014722
Total [candidate] (10.642 s) : 0, 10641622
section appsec
Agent [baseline] (1.195 s) : 0, 1194654
Total [baseline] (11.033 s) : 0, 11033465
Agent [candidate] (1.205 s) : 0, 1205264
Total [candidate] (11.044 s) : 0, 11044323
section iast
Agent [baseline] (1.151 s) : 0, 1151343
Total [baseline] (10.979 s) : 0, 10978829
Agent [candidate] (1.153 s) : 0, 1152584
Total [candidate] (10.945 s) : 0, 10945438
section profiling
Agent [baseline] (1.162 s) : 0, 1162308
Total [baseline] (11.065 s) : 0, 11064578
Agent [candidate] (1.161 s) : 0, 1160989
Total [candidate] (10.963 s) : 0, 10963046

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.032 s	-
Agent	appsec	1.195 s	162.666 ms (15.8%)
Agent	iast	1.151 s	119.355 ms (11.6%)
Agent	profiling	1.162 s	130.32 ms (12.6%)
Total	tracing	10.736 s	-
Total	appsec	11.033 s	297.932 ms (2.8%)
Total	iast	10.979 s	243.295 ms (2.3%)
Total	profiling	11.065 s	329.045 ms (3.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.015 s	-
Agent	appsec	1.205 s	190.542 ms (18.8%)
Agent	iast	1.153 s	137.862 ms (13.6%)
Agent	profiling	1.161 s	146.267 ms (14.4%)
Total	tracing	10.642 s	-
Total	appsec	11.044 s	402.702 ms (3.8%)
Total	iast	10.945 s	303.817 ms (2.9%)
Total	profiling	10.963 s	321.425 ms (3.0%)

gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~933519d61c, baseline=1.55.0-SNAPSHOT~425276dceb

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.472 ms) : 0, 1472
crashtracking [candidate] (1.463 ms) : 0, 1463
BytebuddyAgent [baseline] (703.24 ms) : 0, 703240
BytebuddyAgent [candidate] (692.161 ms) : 0, 692161
GlobalTracer [baseline] (245.091 ms) : 0, 245091
GlobalTracer [candidate] (241.62 ms) : 0, 241620
AppSec [baseline] (33.078 ms) : 0, 33078
AppSec [candidate] (32.447 ms) : 0, 32447
Debugger [baseline] (6.6 ms) : 0, 6600
Debugger [candidate] (6.409 ms) : 0, 6409
Remote Config [baseline] (715.713 µs) : 0, 716
Remote Config [candidate] (706.452 µs) : 0, 706
Telemetry [baseline] (9.503 ms) : 0, 9503
Telemetry [candidate] (9.259 ms) : 0, 9259
Flare Poller [baseline] (11.027 ms) : 0, 11027
Flare Poller [candidate] (9.511 ms) : 0, 9511
section appsec
crashtracking [baseline] (1.465 ms) : 0, 1465
crashtracking [candidate] (1.495 ms) : 0, 1495
BytebuddyAgent [baseline] (717.233 ms) : 0, 717233
BytebuddyAgent [candidate] (725.213 ms) : 0, 725213
GlobalTracer [baseline] (234.901 ms) : 0, 234901
GlobalTracer [candidate] (235.82 ms) : 0, 235820
AppSec [baseline] (175.961 ms) : 0, 175961
AppSec [candidate] (176.425 ms) : 0, 176425
Debugger [baseline] (6.125 ms) : 0, 6125
Debugger [candidate] (6.274 ms) : 0, 6274
Remote Config [baseline] (631.57 µs) : 0, 632
Remote Config [candidate] (634.838 µs) : 0, 635
Telemetry [baseline] (8.548 ms) : 0, 8548
Telemetry [candidate] (8.795 ms) : 0, 8795
Flare Poller [baseline] (3.933 ms) : 0, 3933
Flare Poller [candidate] (4.013 ms) : 0, 4013
IAST [baseline] (24.801 ms) : 0, 24801
IAST [candidate] (25.362 ms) : 0, 25362
section iast
crashtracking [baseline] (1.491 ms) : 0, 1491
crashtracking [candidate] (1.455 ms) : 0, 1455
BytebuddyAgent [baseline] (815.134 ms) : 0, 815134
BytebuddyAgent [candidate] (816.524 ms) : 0, 816524
GlobalTracer [baseline] (231.756 ms) : 0, 231756
GlobalTracer [candidate] (231.877 ms) : 0, 231877
AppSec [baseline] (35.172 ms) : 0, 35172
AppSec [candidate] (34.094 ms) : 0, 34094
Debugger [baseline] (6.126 ms) : 0, 6126
Debugger [candidate] (6.172 ms) : 0, 6172
Remote Config [baseline] (606.171 µs) : 0, 606
Remote Config [candidate] (606.943 µs) : 0, 607
Telemetry [baseline] (8.668 ms) : 0, 8668
Telemetry [candidate] (8.733 ms) : 0, 8733
Flare Poller [baseline] (4.246 ms) : 0, 4246
Flare Poller [candidate] (4.257 ms) : 0, 4257
IAST [baseline] (26.599 ms) : 0, 26599
IAST [candidate] (26.562 ms) : 0, 26562
section profiling
ProfilingAgent [baseline] (107.559 ms) : 0, 107559
ProfilingAgent [candidate] (107.579 ms) : 0, 107579
crashtracking [baseline] (1.435 ms) : 0, 1435
crashtracking [candidate] (1.427 ms) : 0, 1427
BytebuddyAgent [baseline] (722.22 ms) : 0, 722220
BytebuddyAgent [candidate] (720.941 ms) : 0, 720941
GlobalTracer [baseline] (217.874 ms) : 0, 217874
GlobalTracer [candidate] (218.185 ms) : 0, 218185
AppSec [baseline] (32.268 ms) : 0, 32268
AppSec [candidate] (32.215 ms) : 0, 32215
Debugger [baseline] (6.497 ms) : 0, 6497
Debugger [candidate] (6.477 ms) : 0, 6477
Remote Config [baseline] (788.883 µs) : 0, 789
Remote Config [candidate] (772.832 µs) : 0, 773
Telemetry [baseline] (16.416 ms) : 0, 16416
Telemetry [candidate] (16.247 ms) : 0, 16247
Flare Poller [baseline] (4.128 ms) : 0, 4128
Flare Poller [candidate] (4.124 ms) : 0, 4124
Profiling [baseline] (108.55 ms) : 0, 108550
Profiling [candidate] (108.578 ms) : 0, 108578

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/test-graalvm25
git_commit_date	1760545829	1760555043
git_commit_sha	`425276d`	`933519d`
release_version	1.55.0-SNAPSHOT~425276dceb	1.54.0-SNAPSHOT~933519d61c

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1760622112	1760622112
ci_job_id	1182707796	1182707796
ci_pipeline_id	79420171	79420171
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-bh6y3vnr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-bh6y3vnr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 2 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:profiling:high_load	worse [+473.266µs; +800.322µs] or [+5.370%; +9.081%]	unstable [-100.177op/s; +30.427op/s] or [-19.037%; +5.782%]	9.450ms	491.344op/s	8.813ms	526.219op/s
scenario:load:insecure-bank:tracing:high_load	worse [+239.189µs; +476.437µs] or [+3.171%; +6.315%]	unstable [-104.272op/s; +49.710op/s] or [-16.994%; +8.101%]	7.902ms	586.312op/s	7.544ms	613.594op/s
scenario:load:insecure-bank:iast:high_load	better [-618.235µs; -241.630µs] or [-5.986%; -2.340%]	unstable [-34.333op/s; +73.145op/s] or [-7.633%; +16.261%]	9.898ms	469.219op/s	10.328ms	449.812op/s
scenario:load:petclinic:appsec:high_load	better [-2.510ms; -1.541ms] or [-4.863%; -2.984%]	unstable [-2.847op/s; +10.272op/s] or [-3.139%; +11.326%]	49.595ms	94.400op/s	51.620ms	90.688op/s
scenario:load:petclinic:profiling:high_load	better [-2.565ms; -1.689ms] or [-5.390%; -3.548%]	unstable [-2.465op/s; +11.640op/s] or [-2.506%; +11.835%]	45.460ms	102.938op/s	47.587ms	98.350op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~933519d61c, baseline=1.55.0-SNAPSHOT~425276dceb
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.316 ms) : 37013, 37619
.   : milestone, 37316,
appsec (51.62 ms) : 51161, 52080
.   : milestone, 51620,
code_origins (44.547 ms) : 44146, 44949
.   : milestone, 44547,
iast (45.642 ms) : 45249, 46035
.   : milestone, 45642,
profiling (47.587 ms) : 47175, 47998
.   : milestone, 47587,
tracing (46.114 ms) : 45712, 46515
.   : milestone, 46114,
section candidate
no_agent (37.76 ms) : 37455, 38065
.   : milestone, 37760,
appsec (49.595 ms) : 49153, 50036
.   : milestone, 49595,
code_origins (44.461 ms) : 44075, 44846
.   : milestone, 44461,
iast (46.424 ms) : 46000, 46848
.   : milestone, 46424,
profiling (45.46 ms) : 45058, 45863
.   : milestone, 45460,
tracing (45.577 ms) : 45185, 45969
.   : milestone, 45577,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.316 ms [37.013 ms, 37.619 ms]	-
appsec	51.62 ms [51.161 ms, 52.08 ms]	14.304 ms (38.3%)
code_origins	44.547 ms [44.146 ms, 44.949 ms]	7.231 ms (19.4%)
iast	45.642 ms [45.249 ms, 46.035 ms]	8.326 ms (22.3%)
profiling	47.587 ms [47.175 ms, 47.998 ms]	10.271 ms (27.5%)
tracing	46.114 ms [45.712 ms, 46.515 ms]	8.798 ms (23.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.76 ms [37.455 ms, 38.065 ms]	-
appsec	49.595 ms [49.153 ms, 50.036 ms]	11.835 ms (31.3%)
code_origins	44.461 ms [44.075 ms, 44.846 ms]	6.701 ms (17.7%)
iast	46.424 ms [46.0 ms, 46.848 ms]	8.664 ms (22.9%)
profiling	45.46 ms [45.058 ms, 45.863 ms]	7.701 ms (20.4%)
tracing	45.577 ms [45.185 ms, 45.969 ms]	7.818 ms (20.7%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~933519d61c, baseline=1.55.0-SNAPSHOT~425276dceb
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.303 ms) : 4254, 4351
.   : milestone, 4303,
iast (10.328 ms) : 10152, 10504
.   : milestone, 10328,
iast_FULL (14.193 ms) : 13907, 14479
.   : milestone, 14193,
iast_GLOBAL (10.436 ms) : 10251, 10621
.   : milestone, 10436,
profiling (8.813 ms) : 8675, 8951
.   : milestone, 8813,
tracing (7.544 ms) : 7438, 7650
.   : milestone, 7544,
section candidate
no_agent (4.442 ms) : 4391, 4492
.   : milestone, 4442,
iast (9.898 ms) : 9724, 10072
.   : milestone, 9898,
iast_FULL (14.544 ms) : 14260, 14827
.   : milestone, 14544,
iast_GLOBAL (10.204 ms) : 10024, 10384
.   : milestone, 10204,
profiling (9.45 ms) : 9285, 9614
.   : milestone, 9450,
tracing (7.902 ms) : 7787, 8016
.   : milestone, 7902,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.303 ms [4.254 ms, 4.351 ms]	-
iast	10.328 ms [10.152 ms, 10.504 ms]	6.026 ms (140.0%)
iast_FULL	14.193 ms [13.907 ms, 14.479 ms]	9.891 ms (229.9%)
iast_GLOBAL	10.436 ms [10.251 ms, 10.621 ms]	6.133 ms (142.5%)
profiling	8.813 ms [8.675 ms, 8.951 ms]	4.51 ms (104.8%)
tracing	7.544 ms [7.438 ms, 7.65 ms]	3.241 ms (75.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.442 ms [4.391 ms, 4.492 ms]	-
iast	9.898 ms [9.724 ms, 10.072 ms]	5.457 ms (122.8%)
iast_FULL	14.544 ms [14.26 ms, 14.827 ms]	10.102 ms (227.4%)
iast_GLOBAL	10.204 ms [10.024 ms, 10.384 ms]	5.762 ms (129.7%)
profiling	9.45 ms [9.285 ms, 9.614 ms]	5.008 ms (112.7%)
tracing	7.902 ms [7.787 ms, 8.016 ms]	3.46 ms (77.9%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/test-graalvm25
git_commit_date	1760545829	1760555043
git_commit_sha	`425276d`	`933519d`
release_version	1.55.0-SNAPSHOT~425276dceb	1.54.0-SNAPSHOT~933519d61c

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1760557154	1760557154
ci_job_id	1181373364	1181373364
ci_pipeline_id	79420171	79420171
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-jv372b8h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-jv372b8h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~933519d61c, baseline=1.55.0-SNAPSHOT~425276dceb
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1462, 1486
.   : milestone, 1474,
appsec (2.502 ms) : 2448, 2556
.   : milestone, 2502,
iast (2.201 ms) : 2138, 2264
.   : milestone, 2201,
iast_GLOBAL (2.24 ms) : 2177, 2304
.   : milestone, 2240,
profiling (2.046 ms) : 1996, 2097
.   : milestone, 2046,
tracing (2.027 ms) : 1977, 2077
.   : milestone, 2027,
section candidate
no_agent (1.467 ms) : 1456, 1478
.   : milestone, 1467,
appsec (3.675 ms) : 3461, 3890
.   : milestone, 3675,
iast (2.202 ms) : 2138, 2265
.   : milestone, 2202,
iast_GLOBAL (2.247 ms) : 2184, 2311
.   : milestone, 2247,
profiling (2.031 ms) : 1980, 2082
.   : milestone, 2031,
tracing (2.02 ms) : 1970, 2069
.   : milestone, 2020,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.474 ms [1.462 ms, 1.486 ms]	-
appsec	2.502 ms [2.448 ms, 2.556 ms]	1.028 ms (69.7%)
iast	2.201 ms [2.138 ms, 2.264 ms]	727.225 µs (49.3%)
iast_GLOBAL	2.24 ms [2.177 ms, 2.304 ms]	766.154 µs (52.0%)
profiling	2.046 ms [1.996 ms, 2.097 ms]	572.5 µs (38.8%)
tracing	2.027 ms [1.977 ms, 2.077 ms]	552.956 µs (37.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.467 ms [1.456 ms, 1.478 ms]	-
appsec	3.675 ms [3.461 ms, 3.89 ms]	2.208 ms (150.5%)
iast	2.202 ms [2.138 ms, 2.265 ms]	734.695 µs (50.1%)
iast_GLOBAL	2.247 ms [2.184 ms, 2.311 ms]	780.21 µs (53.2%)
profiling	2.031 ms [1.98 ms, 2.082 ms]	563.987 µs (38.4%)
tracing	2.02 ms [1.97 ms, 2.069 ms]	552.582 µs (37.7%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~933519d61c, baseline=1.55.0-SNAPSHOT~425276dceb
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.843 s) : 14843000, 14843000
.   : milestone, 14843000,
appsec (15.078 s) : 15078000, 15078000
.   : milestone, 15078000,
iast (18.51 s) : 18510000, 18510000
.   : milestone, 18510000,
iast_GLOBAL (18.005 s) : 18005000, 18005000
.   : milestone, 18005000,
profiling (15.317 s) : 15317000, 15317000
.   : milestone, 15317000,
tracing (14.938 s) : 14938000, 14938000
.   : milestone, 14938000,
section candidate
no_agent (15.025 s) : 15025000, 15025000
.   : milestone, 15025000,
appsec (15.215 s) : 15215000, 15215000
.   : milestone, 15215000,
iast (18.619 s) : 18619000, 18619000
.   : milestone, 18619000,
iast_GLOBAL (18.039 s) : 18039000, 18039000
.   : milestone, 18039000,
profiling (15.993 s) : 15993000, 15993000
.   : milestone, 15993000,
tracing (15.134 s) : 15134000, 15134000
.   : milestone, 15134000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.843 s [14.843 s, 14.843 s]	-
appsec	15.078 s [15.078 s, 15.078 s]	235.0 ms (1.6%)
iast	18.51 s [18.51 s, 18.51 s]	3.667 s (24.7%)
iast_GLOBAL	18.005 s [18.005 s, 18.005 s]	3.162 s (21.3%)
profiling	15.317 s [15.317 s, 15.317 s]	474.0 ms (3.2%)
tracing	14.938 s [14.938 s, 14.938 s]	95.0 ms (0.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.025 s [15.025 s, 15.025 s]	-
appsec	15.215 s [15.215 s, 15.215 s]	190.0 ms (1.3%)
iast	18.619 s [18.619 s, 18.619 s]	3.594 s (23.9%)
iast_GLOBAL	18.039 s [18.039 s, 18.039 s]	3.014 s (20.1%)
profiling	15.993 s [15.993 s, 15.993 s]	968.0 ms (6.4%)
tracing	15.134 s [15.134 s, 15.134 s]	109.0 ms (0.7%)

PerfectSlayer · 2025-09-22T13:17:41Z

dd-smoke-tests/spring-boot-3.0-native/application/build.gradle

        // quick build mode, enough for smoke test
        buildArgs.add("-Ob")
        buildArgs.add("-J-javaagent:$agentPath")
+        buildArgs.add("-J-Dnet.bytebuddy.safe=false")


Is this still needed after #9569

Yes. I believe the net.bytebuddy.nexus.disabled flag from #9569 relates to the Nexus mechanism specifically (that uses Unsafe), while this PR's flag is the one that resolves the Cannot get defined package using reflection: Use of Unsafe was disabled by system property error.

PerfectSlayer

🎯 suggestion: ‏If you have a card for, feel free to add it to the TODO so we won't forget the related context :)

sarahchen6 mentioned this pull request Sep 18, 2025

Add graalvm25 image DataDog/dd-trace-java-docker-build#119

Merged

sarahchen6 added type: enhancement Enhancements and improvements comp: testing Testing tag: no release notes Changes to exclude from release notes labels Sep 18, 2025

sarahchen6 force-pushed the sarahchen6/test-graalvm25 branch 2 times, most recently from 506ec84 to b191c6f Compare September 18, 2025 20:57

PerfectSlayer reviewed Sep 22, 2025

View reviewed changes

sarahchen6 added 6 commits September 22, 2025 14:11

Add graalvm25 image to testing

c563680

Add flag to allow use of unsafe

c550712

Add Graalvm 25 specification to profiling

d647f26

Change arg for Graalvm 25

af76058

Add flag to start jfr recording

be16336

Try removing extra flags

6f9f05d

sarahchen6 force-pushed the sarahchen6/test-graalvm25 branch from 76c6260 to 6f9f05d Compare September 22, 2025 18:12

sarahchen6 added 4 commits September 22, 2025 15:30

Remove flag

bd4ef89

Merge branch 'master' into sarahchen6/test-graalvm25

ca67bab

Add JFR flag and comment

08ebf87

Merge master

7ece52b

sarahchen6 changed the title ~~Add graalvm25 image to testing~~ Add GraalVM 25 image to CI Oct 15, 2025

sarahchen6 marked this pull request as ready for review October 15, 2025 17:53

sarahchen6 requested review from a team as code owners October 15, 2025 17:53

sarahchen6 requested review from dougqh and pawelchcki and removed request for a team October 15, 2025 17:53

PerfectSlayer approved these changes Oct 15, 2025

View reviewed changes

Fix comment

933519d

bric3 approved these changes Oct 16, 2025

View reviewed changes

mcculls approved these changes Oct 16, 2025

View reviewed changes

sarahchen6 enabled auto-merge (squash) October 16, 2025 13:47

sarahchen6 merged commit e29d658 into master Oct 16, 2025
531 checks passed

sarahchen6 deleted the sarahchen6/test-graalvm25 branch October 16, 2025 13:49

github-actions bot added this to the 1.55.0 milestone Oct 16, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add GraalVM 25 image to CI #9562

Add GraalVM 25 image to CI #9562

sarahchen6 commented Sep 18, 2025 •

edited

Loading

Uh oh!

datadog-official bot commented Sep 18, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Sep 18, 2025 •

edited

Loading

Uh oh!

PerfectSlayer Sep 22, 2025

Uh oh!

sarahchen6 Sep 22, 2025

Uh oh!

PerfectSlayer left a comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Add GraalVM 25 image to CI #9562

Add GraalVM 25 image to CI #9562

Conversation

sarahchen6 commented Sep 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

datadog-official bot commented Sep 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter bot commented Sep 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

PerfectSlayer Sep 22, 2025

Choose a reason for hiding this comment

Uh oh!

sarahchen6 Sep 22, 2025

Choose a reason for hiding this comment

Uh oh!

PerfectSlayer left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

sarahchen6 commented Sep 18, 2025 •

edited

Loading

datadog-official bot commented Sep 18, 2025 •

edited

Loading

pr-commenter bot commented Sep 18, 2025 •

edited

Loading