🍒 9952 - exclude check-big-regression when merging backport PRs #9966

amarziali · 2025-11-14T09:29:37Z

Backport #9952 to release/v1.55.x

(cherry picked from commit d2eddc0)

datadog-datadog-prod-us1 · 2025-11-14T09:51:45Z

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.70% (-0.02%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 293e728 | Docs | Datadog PR Page | Was this helpful? Give us feedback!}

pr-commenter · 2025-11-14T11:23:55Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	andrea.marziali/backport-pr-9952
git_commit_date	1763111453	1763112572
git_commit_sha	`8ceb94d`	`293e728`
release_version	1.56.0-SNAPSHOT~8ceb94de51	1.56.0-SNAPSHOT~293e728451

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1763114449	1763114449
ci_job_id	1234717051	1234717051
ci_pipeline_id	82382884	82382884
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-2-hd7dql3p 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-2-hd7dql3p 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 12 performance improvements and 11 performance regressions! Performance is the same for 31 metrics, 11 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent.start	better [-87.547ms; -49.683ms] or [-7.073%; -4.014%]	1.169s	1.238s
scenario:startup:insecure-bank:iast:Debugger	better [-54.252ms; -53.296ms] or [-90.496%; -88.901%]	6.176ms	59.950ms
scenario:startup:insecure-bank:iast:Telemetry	worse [+0.709ms; +1.295ms] or [+9.313%; +16.998%]	8.619ms	7.617ms
scenario:startup:insecure-bank:iast:Flare Poller	worse [+662.483µs; +880.058µs] or [+19.241%; +25.560%]	4.214ms	3.443ms
scenario:startup:insecure-bank:tracing:Agent.start	better [-85.228ms; -50.940ms] or [-7.719%; -4.613%]	1.036s	1.104s
scenario:startup:insecure-bank:tracing:Debugger	better [-57.806ms; -56.670ms] or [-90.762%; -88.978%]	6.452ms	63.690ms
scenario:startup:insecure-bank:tracing:Remote Config	worse [+29.671µs; +77.730µs] or [+4.703%; +12.322%]	684.539µs	630.838µs
scenario:startup:petclinic:appsec:Agent.start	better [-85.737ms; -74.840ms] or [-6.696%; -5.845%]	1.200s	1.280s
scenario:startup:petclinic:appsec:Debugger	better [-56.565ms; -54.614ms] or [-92.007%; -88.834%]	5.889ms	61.479ms
scenario:startup:petclinic:iast:Agent.start	better [-80.098ms; -70.462ms] or [-6.470%; -5.691%]	1.163s	1.238s
scenario:startup:petclinic:iast:Debugger	better [-54.979ms; -54.205ms] or [-90.531%; -89.256%]	6.138ms	60.730ms
scenario:startup:petclinic:iast:Remote Config	worse [+35.956µs; +63.096µs] or [+6.541%; +11.478%]	599.257µs	549.732µs
scenario:startup:petclinic:iast:Telemetry	worse [+587.340µs; +854.484µs] or [+7.729%; +11.244%]	8.320ms	7.599ms
scenario:startup:petclinic:iast:Flare Poller	worse [+744.339µs; +879.107µs] or [+21.589%; +25.497%]	4.260ms	3.448ms
scenario:startup:petclinic:profiling:Agent.start	better [-66.707ms; -25.355ms] or [-5.422%; -2.061%]	1.184s	1.230s
scenario:startup:petclinic:profiling:ProfilingAgent	worse [+12.457ms; +16.115ms] or [+12.913%; +16.705%]	110.750ms	96.464ms
scenario:startup:petclinic:profiling:Debugger	better [-51.583ms; -47.367ms] or [-82.575%; -75.826%]	12.993ms	62.468ms
scenario:startup:petclinic:profiling:Remote Config	worse [+28.944µs; +67.632µs] or [+4.528%; +10.581%]	687.498µs	639.210µs
scenario:startup:petclinic:profiling:Flare Poller	worse [+406.094µs; +644.987µs] or [+10.955%; +17.399%]	4.233ms	3.707ms
scenario:startup:petclinic:profiling:Profiling	worse [+12.558ms; +16.192ms] or [+12.940%; +16.685%]	111.422ms	97.047ms
scenario:startup:petclinic:tracing:Agent.start	better [-70.261ms; -61.848ms] or [-6.396%; -5.631%]	1.032s	1.098s
scenario:startup:petclinic:tracing:Debugger	better [-58.153ms; -57.216ms] or [-90.660%; -89.200%]	6.459ms	64.143ms
scenario:startup:petclinic:tracing:Remote Config	worse [+20.197µs; +61.395µs] or [+3.165%; +9.622%]	678.873µs	638.077µs

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~293e728451, baseline=1.56.0-SNAPSHOT~8ceb94de51

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.104 s) : 0, 1104162
Total [baseline] (8.83 s) : 0, 8829616
Agent [candidate] (1.036 s) : 0, 1036078
Total [candidate] (8.661 s) : 0, 8661265
section iast
Agent [baseline] (1.238 s) : 0, 1237783
Total [baseline] (9.553 s) : 0, 9552990
Agent [candidate] (1.169 s) : 0, 1169168
Total [candidate] (9.372 s) : 0, 9372430

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.104 s	-
Agent	iast	1.238 s	133.621 ms (12.1%)
Total	tracing	8.83 s	-
Total	iast	9.553 s	723.374 ms (8.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.036 s	-
Agent	iast	1.169 s	133.091 ms (12.8%)
Total	tracing	8.661 s	-
Total	iast	9.372 s	711.165 ms (8.2%)

gantt
    title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~293e728451, baseline=1.56.0-SNAPSHOT~8ceb94de51

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.467 ms) : 0, 1467
crashtracking [candidate] (1.48 ms) : 0, 1480
BytebuddyAgent [baseline] (710.843 ms) : 0, 710843
BytebuddyAgent [candidate] (706.882 ms) : 0, 706882
GlobalTracer [baseline] (248.604 ms) : 0, 248604
GlobalTracer [candidate] (246.407 ms) : 0, 246407
AppSec [baseline] (32.355 ms) : 0, 32355
AppSec [candidate] (32.498 ms) : 0, 32498
Debugger [baseline] (63.69 ms) : 0, 63690
Debugger [candidate] (6.452 ms) : 0, 6452
Remote Config [baseline] (630.838 µs) : 0, 631
Remote Config [candidate] (684.539 µs) : 0, 685
Telemetry [baseline] (8.098 ms) : 0, 8098
Telemetry [candidate] (13.689 ms) : 0, 13689
Flare Poller [baseline] (3.648 ms) : 0, 3648
Flare Poller [candidate] (6.716 ms) : 0, 6716
section iast
crashtracking [baseline] (1.48 ms) : 0, 1480
crashtracking [candidate] (1.467 ms) : 0, 1467
BytebuddyAgent [baseline] (829.862 ms) : 0, 829862
BytebuddyAgent [candidate] (829.704 ms) : 0, 829704
GlobalTracer [baseline] (238.139 ms) : 0, 238139
GlobalTracer [candidate] (234.807 ms) : 0, 234807
IAST [baseline] (27.559 ms) : 0, 27559
IAST [candidate] (31.248 ms) : 0, 31248
AppSec [baseline] (34.394 ms) : 0, 34394
AppSec [candidate] (30.904 ms) : 0, 30904
Debugger [baseline] (59.95 ms) : 0, 59950
Debugger [candidate] (6.176 ms) : 0, 6176
Remote Config [baseline] (562.982 µs) : 0, 563
Remote Config [candidate] (602.769 µs) : 0, 603
Telemetry [baseline] (7.617 ms) : 0, 7617
Telemetry [candidate] (8.619 ms) : 0, 8619
Flare Poller [baseline] (3.443 ms) : 0, 3443
Flare Poller [candidate] (4.214 ms) : 0, 4214

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~293e728451, baseline=1.56.0-SNAPSHOT~8ceb94de51

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.098 s) : 0, 1098434
Total [baseline] (10.813 s) : 0, 10812558
Agent [candidate] (1.032 s) : 0, 1032380
Total [candidate] (10.846 s) : 0, 10845546
section appsec
Agent [baseline] (1.28 s) : 0, 1280333
Total [baseline] (11.153 s) : 0, 11153481
Agent [candidate] (1.2 s) : 0, 1200044
Total [candidate] (10.865 s) : 0, 10865157
section iast
Agent [baseline] (1.238 s) : 0, 1238059
Total [baseline] (11.241 s) : 0, 11241176
Agent [candidate] (1.163 s) : 0, 1162779
Total [candidate] (11.087 s) : 0, 11086697
section profiling
Agent [baseline] (1.23 s) : 0, 1230303
Total [baseline] (11.083 s) : 0, 11082987
Agent [candidate] (1.184 s) : 0, 1184272
Total [candidate] (10.956 s) : 0, 10955622

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.098 s	-
Agent	appsec	1.28 s	181.898 ms (16.6%)
Agent	iast	1.238 s	139.625 ms (12.7%)
Agent	profiling	1.23 s	131.869 ms (12.0%)
Total	tracing	10.813 s	-
Total	appsec	11.153 s	340.923 ms (3.2%)
Total	iast	11.241 s	428.618 ms (4.0%)
Total	profiling	11.083 s	270.429 ms (2.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.032 s	-
Agent	appsec	1.2 s	167.664 ms (16.2%)
Agent	iast	1.163 s	130.399 ms (12.6%)
Agent	profiling	1.184 s	151.892 ms (14.7%)
Total	tracing	10.846 s	-
Total	appsec	10.865 s	19.611 ms (0.2%)
Total	iast	11.087 s	241.151 ms (2.2%)
Total	profiling	10.956 s	110.076 ms (1.0%)

gantt
    title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~293e728451, baseline=1.56.0-SNAPSHOT~8ceb94de51

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.45 ms) : 0, 1450
crashtracking [candidate] (1.471 ms) : 0, 1471
BytebuddyAgent [baseline] (705.427 ms) : 0, 705427
BytebuddyAgent [candidate] (704.255 ms) : 0, 704255
GlobalTracer [baseline] (248.115 ms) : 0, 248115
GlobalTracer [candidate] (245.023 ms) : 0, 245023
AppSec [baseline] (32.136 ms) : 0, 32136
AppSec [candidate] (32.441 ms) : 0, 32441
Debugger [baseline] (64.143 ms) : 0, 64143
Debugger [candidate] (6.459 ms) : 0, 6459
Remote Config [baseline] (638.077 µs) : 0, 638
Remote Config [candidate] (678.873 µs) : 0, 679
Telemetry [baseline] (8.088 ms) : 0, 8088
Telemetry [candidate] (14.409 ms) : 0, 14409
Flare Poller [baseline] (3.616 ms) : 0, 3616
Flare Poller [candidate] (6.426 ms) : 0, 6426
section appsec
crashtracking [baseline] (1.452 ms) : 0, 1452
crashtracking [candidate] (1.468 ms) : 0, 1468
BytebuddyAgent [baseline] (729.372 ms) : 0, 729372
BytebuddyAgent [candidate] (723.989 ms) : 0, 723989
GlobalTracer [baseline] (241.063 ms) : 0, 241063
GlobalTracer [candidate] (235.617 ms) : 0, 235617
IAST [baseline] (25.179 ms) : 0, 25179
IAST [candidate] (25.045 ms) : 0, 25045
AppSec [baseline] (174.115 ms) : 0, 174115
AppSec [candidate] (174.059 ms) : 0, 174059
Debugger [baseline] (61.479 ms) : 0, 61479
Debugger [candidate] (5.889 ms) : 0, 5889
Remote Config [baseline] (682.981 µs) : 0, 683
Remote Config [candidate] (634.619 µs) : 0, 635
Telemetry [baseline] (8.294 ms) : 0, 8294
Telemetry [candidate] (8.38 ms) : 0, 8380
Flare Poller [baseline] (3.929 ms) : 0, 3929
Flare Poller [candidate] (3.868 ms) : 0, 3868
section iast
crashtracking [baseline] (1.451 ms) : 0, 1451
crashtracking [candidate] (1.478 ms) : 0, 1478
BytebuddyAgent [baseline] (829.528 ms) : 0, 829528
BytebuddyAgent [candidate] (824.605 ms) : 0, 824605
GlobalTracer [baseline] (238.356 ms) : 0, 238356
GlobalTracer [candidate] (234.252 ms) : 0, 234252
IAST [baseline] (30.123 ms) : 0, 30123
IAST [candidate] (32.773 ms) : 0, 32773
AppSec [baseline] (31.52 ms) : 0, 31520
AppSec [candidate] (29.042 ms) : 0, 29042
Debugger [baseline] (60.73 ms) : 0, 60730
Debugger [candidate] (6.138 ms) : 0, 6138
Remote Config [baseline] (549.732 µs) : 0, 550
Remote Config [candidate] (599.257 µs) : 0, 599
Telemetry [baseline] (7.599 ms) : 0, 7599
Telemetry [candidate] (8.32 ms) : 0, 8320
Flare Poller [baseline] (3.448 ms) : 0, 3448
Flare Poller [candidate] (4.26 ms) : 0, 4260
section profiling
crashtracking [baseline] (1.447 ms) : 0, 1447
crashtracking [candidate] (1.492 ms) : 0, 1492
BytebuddyAgent [baseline] (733.196 ms) : 0, 733196
BytebuddyAgent [candidate] (733.652 ms) : 0, 733652
GlobalTracer [baseline] (222.369 ms) : 0, 222369
GlobalTracer [candidate] (222.123 ms) : 0, 222123
AppSec [baseline] (32.184 ms) : 0, 32184
AppSec [candidate] (32.655 ms) : 0, 32655
Debugger [baseline] (62.468 ms) : 0, 62468
Debugger [candidate] (12.993 ms) : 0, 12993
Remote Config [baseline] (639.21 µs) : 0, 639
Remote Config [candidate] (687.498 µs) : 0, 687
Telemetry [baseline] (7.944 ms) : 0, 7944
Telemetry [candidate] (9.734 ms) : 0, 9734
Flare Poller [baseline] (3.707 ms) : 0, 3707
Flare Poller [candidate] (4.233 ms) : 0, 4233
ProfilingAgent [baseline] (96.464 ms) : 0, 96464
ProfilingAgent [candidate] (110.75 ms) : 0, 110750
Profiling [baseline] (97.047 ms) : 0, 97047
Profiling [candidate] (111.422 ms) : 0, 111422

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	andrea.marziali/backport-pr-9952
git_commit_date	1763111453	1763112572
git_commit_sha	`8ceb94d`	`293e728`
release_version	1.56.0-SNAPSHOT~8ceb94de51	1.56.0-SNAPSHOT~293e728451

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1763118861	1763118861
ci_job_id	1234893745	1234893745
ci_pipeline_id	82382884	82382884
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-qgeqi9cj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-qgeqi9cj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 6 performance regressions! Performance is the same for 10 metrics, 19 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:petclinic:code_origins:high_load	worse [+1.316ms; +1.808ms] or [+7.535%; +10.349%]	worse [+0.916ms; +2.050ms] or [+3.149%; +7.044%]	unstable [-43.737op/s; +7.549op/s] or [-16.818%; +2.903%]	19.030ms	30.580ms	241.969op/s	17.468ms	29.097ms	260.062op/s
scenario:load:petclinic:iast:high_load	worse [+425.663µs; +1199.478µs] or [+2.436%; +6.864%]	same [-39.343µs; +1383.035µs] or [-0.137%; +4.813%]	unstable [-36.833op/s; +16.708op/s] or [-14.069%; +6.382%]	18.287ms	29.404ms	251.750op/s	17.474ms	28.733ms	261.812op/s
scenario:load:petclinic:appsec:high_load	worse [+0.560ms; +1.810ms] or [+3.061%; +9.901%]	unsure [+0.381ms; +2.167ms] or [+1.284%; +7.296%]	unstable [-36.852op/s; +13.477op/s] or [-14.713%; +5.381%]	19.469ms	30.972ms	238.781op/s	18.284ms	29.698ms	250.469op/s
scenario:load:petclinic:profiling:high_load	worse [+0.523ms; +1.600ms] or [+2.897%; +8.854%]	same [-511.215µs; +1296.418µs] or [-1.726%; +4.376%]	unstable [-36.908op/s; +15.595op/s] or [-14.561%; +6.153%]	19.129ms	30.018ms	242.812op/s	18.067ms	29.625ms	253.469op/s
scenario:load:petclinic:no_agent:high_load	worse [+0.667ms; +2.253ms] or [+3.911%; +13.209%]	unstable [-0.333ms; +3.205ms] or [-1.150%; +11.058%]	unstable [-48.424op/s; +7.799op/s] or [-18.233%; +2.937%]	18.520ms	30.419ms	245.281op/s	17.060ms	28.983ms	265.594op/s
scenario:load:petclinic:tracing:high_load	same [-552.228µs; +149.803µs] or [-3.179%; +0.862%]	better [-1.609ms; -0.617ms] or [-5.565%; -2.134%]	unstable [-21.739op/s; +32.614op/s] or [-8.256%; +12.386%]	17.173ms	27.793ms	268.750op/s	17.374ms	28.906ms	263.312op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~293e728451, baseline=1.56.0-SNAPSHOT~8ceb94de51
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.208 ms) : 1197, 1219
.   : milestone, 1208,
iast (3.373 ms) : 3310, 3435
.   : milestone, 3373,
iast_FULL (5.796 ms) : 5739, 5853
.   : milestone, 5796,
iast_GLOBAL (3.634 ms) : 3545, 3722
.   : milestone, 3634,
profiling (2.009 ms) : 1991, 2028
.   : milestone, 2009,
tracing (1.792 ms) : 1777, 1806
.   : milestone, 1792,
section candidate
no_agent (1.268 ms) : 1254, 1281
.   : milestone, 1268,
iast (3.307 ms) : 3261, 3353
.   : milestone, 3307,
iast_FULL (5.862 ms) : 5804, 5920
.   : milestone, 5862,
iast_GLOBAL (3.604 ms) : 3546, 3662
.   : milestone, 3604,
profiling (2.121 ms) : 2102, 2140
.   : milestone, 2121,
tracing (1.787 ms) : 1770, 1805
.   : milestone, 1787,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.208 ms [1.197 ms, 1.219 ms]	-
iast	3.373 ms [3.31 ms, 3.435 ms]	2.165 ms (179.2%)
iast_FULL	5.796 ms [5.739 ms, 5.853 ms]	4.588 ms (379.8%)
iast_GLOBAL	3.634 ms [3.545 ms, 3.722 ms]	2.426 ms (200.8%)
profiling	2.009 ms [1.991 ms, 2.028 ms]	801.46 µs (66.3%)
tracing	1.792 ms [1.777 ms, 1.806 ms]	583.57 µs (48.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.268 ms [1.254 ms, 1.281 ms]	-
iast	3.307 ms [3.261 ms, 3.353 ms]	2.04 ms (160.9%)
iast_FULL	5.862 ms [5.804 ms, 5.92 ms]	4.594 ms (362.4%)
iast_GLOBAL	3.604 ms [3.546 ms, 3.662 ms]	2.336 ms (184.3%)
profiling	2.121 ms [2.102 ms, 2.14 ms]	853.44 µs (67.3%)
tracing	1.787 ms [1.77 ms, 1.805 ms]	519.467 µs (41.0%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~293e728451, baseline=1.56.0-SNAPSHOT~8ceb94de51
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.568 ms) : 17390, 17747
.   : milestone, 17568,
appsec (18.634 ms) : 18446, 18822
.   : milestone, 18634,
code_origins (17.942 ms) : 17761, 18122
.   : milestone, 17942,
iast (17.82 ms) : 17642, 17998
.   : milestone, 17820,
profiling (18.41 ms) : 18225, 18594
.   : milestone, 18410,
tracing (17.722 ms) : 17545, 17899
.   : milestone, 17722,
section candidate
no_agent (19.028 ms) : 18836, 19221
.   : milestone, 19028,
appsec (19.552 ms) : 19348, 19756
.   : milestone, 19552,
code_origins (19.295 ms) : 19101, 19489
.   : milestone, 19295,
iast (18.54 ms) : 18356, 18724
.   : milestone, 18540,
profiling (19.223 ms) : 19030, 19415
.   : milestone, 19223,
tracing (17.361 ms) : 17194, 17528
.   : milestone, 17361,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.568 ms [17.39 ms, 17.747 ms]	-
appsec	18.634 ms [18.446 ms, 18.822 ms]	1.066 ms (6.1%)
code_origins	17.942 ms [17.761 ms, 18.122 ms]	373.164 µs (2.1%)
iast	17.82 ms [17.642 ms, 17.998 ms]	251.432 µs (1.4%)
profiling	18.41 ms [18.225 ms, 18.594 ms]	841.189 µs (4.8%)
tracing	17.722 ms [17.545 ms, 17.899 ms]	153.236 µs (0.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.028 ms [18.836 ms, 19.221 ms]	-
appsec	19.552 ms [19.348 ms, 19.756 ms]	523.867 µs (2.8%)
code_origins	19.295 ms [19.101 ms, 19.489 ms]	266.79 µs (1.4%)
iast	18.54 ms [18.356 ms, 18.724 ms]	-488.093 µs (-2.6%)
profiling	19.223 ms [19.03 ms, 19.415 ms]	194.386 µs (1.0%)
tracing	17.361 ms [17.194 ms, 17.528 ms]	-1.668 ms (-8.8%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	andrea.marziali/backport-pr-9952
git_commit_date	1763111453	1763112572
git_commit_sha	`8ceb94d`	`293e728`
release_version	1.56.0-SNAPSHOT~8ceb94de51	1.56.0-SNAPSHOT~293e728451

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1763114699	1763114699
ci_job_id	1234717053	1234717053
ci_pipeline_id	82382884	82382884
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-ee8vs9zi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-ee8vs9zi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~293e728451, baseline=1.56.0-SNAPSHOT~8ceb94de51
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.814 s) : 14814000, 14814000
.   : milestone, 14814000,
appsec (14.691 s) : 14691000, 14691000
.   : milestone, 14691000,
iast (18.455 s) : 18455000, 18455000
.   : milestone, 18455000,
iast_GLOBAL (17.758 s) : 17758000, 17758000
.   : milestone, 17758000,
profiling (14.847 s) : 14847000, 14847000
.   : milestone, 14847000,
tracing (14.751 s) : 14751000, 14751000
.   : milestone, 14751000,
section candidate
no_agent (15.248 s) : 15248000, 15248000
.   : milestone, 15248000,
appsec (14.94 s) : 14940000, 14940000
.   : milestone, 14940000,
iast (18.746 s) : 18746000, 18746000
.   : milestone, 18746000,
iast_GLOBAL (17.741 s) : 17741000, 17741000
.   : milestone, 17741000,
profiling (15.483 s) : 15483000, 15483000
.   : milestone, 15483000,
tracing (15.245 s) : 15245000, 15245000
.   : milestone, 15245000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.814 s [14.814 s, 14.814 s]	-
appsec	14.691 s [14.691 s, 14.691 s]	-123.0 ms (-0.8%)
iast	18.455 s [18.455 s, 18.455 s]	3.641 s (24.6%)
iast_GLOBAL	17.758 s [17.758 s, 17.758 s]	2.944 s (19.9%)
profiling	14.847 s [14.847 s, 14.847 s]	33.0 ms (0.2%)
tracing	14.751 s [14.751 s, 14.751 s]	-63.0 ms (-0.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.248 s [15.248 s, 15.248 s]	-
appsec	14.94 s [14.94 s, 14.94 s]	-308.0 ms (-2.0%)
iast	18.746 s [18.746 s, 18.746 s]	3.498 s (22.9%)
iast_GLOBAL	17.741 s [17.741 s, 17.741 s]	2.493 s (16.3%)
profiling	15.483 s [15.483 s, 15.483 s]	235.0 ms (1.5%)
tracing	15.245 s [15.245 s, 15.245 s]	-3.0 ms (-0.0%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~293e728451, baseline=1.56.0-SNAPSHOT~8ceb94de51
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.485 ms) : 1474, 1497
.   : milestone, 1485,
appsec (2.47 ms) : 2418, 2522
.   : milestone, 2470,
iast (2.231 ms) : 2167, 2295
.   : milestone, 2231,
iast_GLOBAL (2.269 ms) : 2205, 2333
.   : milestone, 2269,
profiling (2.098 ms) : 2044, 2151
.   : milestone, 2098,
tracing (2.045 ms) : 1995, 2095
.   : milestone, 2045,
section candidate
no_agent (1.481 ms) : 1469, 1493
.   : milestone, 1481,
appsec (2.472 ms) : 2421, 2523
.   : milestone, 2472,
iast (2.224 ms) : 2159, 2288
.   : milestone, 2224,
iast_GLOBAL (2.265 ms) : 2201, 2330
.   : milestone, 2265,
profiling (2.079 ms) : 2026, 2132
.   : milestone, 2079,
tracing (2.038 ms) : 1988, 2088
.   : milestone, 2038,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.485 ms [1.474 ms, 1.497 ms]	-
appsec	2.47 ms [2.418 ms, 2.522 ms]	984.748 µs (66.3%)
iast	2.231 ms [2.167 ms, 2.295 ms]	745.911 µs (50.2%)
iast_GLOBAL	2.269 ms [2.205 ms, 2.333 ms]	783.466 µs (52.7%)
profiling	2.098 ms [2.044 ms, 2.151 ms]	612.546 µs (41.2%)
tracing	2.045 ms [1.995 ms, 2.095 ms]	559.928 µs (37.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.481 ms [1.469 ms, 1.493 ms]	-
appsec	2.472 ms [2.421 ms, 2.523 ms]	990.64 µs (66.9%)
iast	2.224 ms [2.159 ms, 2.288 ms]	742.675 µs (50.1%)
iast_GLOBAL	2.265 ms [2.201 ms, 2.33 ms]	784.351 µs (53.0%)
profiling	2.079 ms [2.026 ms, 2.132 ms]	598.364 µs (40.4%)
tracing	2.038 ms [1.988 ms, 2.088 ms]	556.86 µs (37.6%)

exclude check-big-regeression when not merging to master

293e728

(cherry picked from commit d2eddc0)

amarziali requested a review from a team as a code owner November 14, 2025 09:29

amarziali added type: enhancement Enhancements and improvements comp: testing Testing tag: no release notes Changes to exclude from release notes labels Nov 14, 2025

amarziali requested review from erikayasuda and removed request for a team November 14, 2025 09:29

amarziali enabled auto-merge (squash) November 14, 2025 09:29

PerfectSlayer approved these changes Nov 14, 2025

View reviewed changes

bric3 approved these changes Nov 14, 2025

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

🍒 9952 - exclude check-big-regression when merging backport PRs #9966

🍒 9952 - exclude check-big-regression when merging backport PRs #9966

Uh oh!

amarziali commented Nov 14, 2025

Uh oh!

datadog-datadog-prod-us1 bot commented Nov 14, 2025 •

edited by datadog-official bot

Loading

Uh oh!

pr-commenter bot commented Nov 14, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

🍒 9952 - exclude check-big-regression when merging backport PRs #9966

Are you sure you want to change the base?

🍒 9952 - exclude check-big-regression when merging backport PRs #9966

Uh oh!

Conversation

amarziali commented Nov 14, 2025

Uh oh!

datadog-datadog-prod-us1 bot commented Nov 14, 2025 • edited by datadog-official bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter bot commented Nov 14, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

datadog-datadog-prod-us1 bot commented Nov 14, 2025 •

edited by datadog-official bot

Loading