Skip to content

Fix system tests PR check #9682

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Oct 7, 2025
Merged

Fix system tests PR check #9682

merged 1 commit into from
Oct 7, 2025

Conversation

@PerfectSlayer
Copy link
Contributor

@PerfectSlayer PerfectSlayer commented Oct 7, 2025

What Does This Do

Fix the pull request check that enforce system tests to build and run successfully.

Motivation

If the system tests fails to build or run is skipped for whatever reason, the check job will be skipped and PR won’t be blocked.

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@PerfectSlayer PerfectSlayer requested a review from a team as a code owner October 7, 2025 11:55
@PerfectSlayer PerfectSlayer added the type: bug Bug report and fix label Oct 7, 2025
@PerfectSlayer PerfectSlayer requested review from dougqh and removed request for a team October 7, 2025 11:55
@PerfectSlayer PerfectSlayer added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Oct 7, 2025
@PerfectSlayer PerfectSlayer enabled auto-merge (squash) October 7, 2025 12:06
@datadog-datadog-prod-us1
Copy link
Contributor

datadog-datadog-prod-us1 bot commented Oct 7, 2025 •
edited
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 58.10% (-0.03%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: f114a1f | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Oct 7, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci
git_commit_date 1759823305 1759838007
git_commit_sha 4655032 f114a1f
release_version 1.55.0-SNAPSHOT~465503232d 1.55.0-SNAPSHOT~f114a1f491
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1759839800 1759839800
ci_job_id 1166751502 1166751502
ci_pipeline_id 78580664 78580664
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-b9btowpo 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-b9btowpo 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 6 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:petclinic:profiling:Flare Poller better
[-287.029µs; -100.090µs] or [-6.604%; -2.303%]		 4.153ms 4.346ms
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.55.0-SNAPSHOT~f114a1f491, baseline=1.55.0-SNAPSHOT~465503232d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.026 s) : 0, 1025548
Total [baseline] (8.701 s) : 0, 8700831
Agent [candidate] (1.02 s) : 0, 1020024
Total [candidate] (8.639 s) : 0, 8639160
section iast
Agent [baseline] (1.174 s) : 0, 1174004
Total [baseline] (9.305 s) : 0, 9305293
Agent [candidate] (1.151 s) : 0, 1150914
Total [candidate] (9.243 s) : 0, 9243402
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.026 s -
Agent iast 1.174 s 148.456 ms (14.5%)
Total tracing 8.701 s -
Total iast 9.305 s 604.462 ms (6.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.02 s -
Agent iast 1.151 s 130.89 ms (12.8%)
Total tracing 8.639 s -
Total iast 9.243 s 604.242 ms (7.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.55.0-SNAPSHOT~f114a1f491, baseline=1.55.0-SNAPSHOT~465503232d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.477 ms) : 0, 1477
crashtracking [candidate] (1.478 ms) : 0, 1478
BytebuddyAgent [baseline] (699.795 ms) : 0, 699795
BytebuddyAgent [candidate] (695.186 ms) : 0, 695186
GlobalTracer [baseline] (242.541 ms) : 0, 242541
GlobalTracer [candidate] (242.019 ms) : 0, 242019
AppSec [baseline] (32.784 ms) : 0, 32784
AppSec [candidate] (32.915 ms) : 0, 32915
Debugger [baseline] (6.418 ms) : 0, 6418
Debugger [candidate] (6.42 ms) : 0, 6420
Remote Config [baseline] (685.873 µs) : 0, 686
Remote Config [candidate] (678.389 µs) : 0, 678
Telemetry [baseline] (9.285 ms) : 0, 9285
Telemetry [candidate] (9.281 ms) : 0, 9281
Flare Poller [baseline] (11.448 ms) : 0, 11448
Flare Poller [candidate] (10.933 ms) : 0, 10933
section iast
crashtracking [baseline] (1.493 ms) : 0, 1493
crashtracking [candidate] (1.462 ms) : 0, 1462
BytebuddyAgent [baseline] (832.93 ms) : 0, 832930
BytebuddyAgent [candidate] (815.027 ms) : 0, 815027
GlobalTracer [baseline] (235.569 ms) : 0, 235569
GlobalTracer [candidate] (231.499 ms) : 0, 231499
IAST [baseline] (27.139 ms) : 0, 27139
IAST [candidate] (26.705 ms) : 0, 26705
AppSec [baseline] (35.713 ms) : 0, 35713
AppSec [candidate] (35.362 ms) : 0, 35362
Debugger [baseline] (6.182 ms) : 0, 6182
Debugger [candidate] (6.149 ms) : 0, 6149
Remote Config [baseline] (610.078 µs) : 0, 610
Remote Config [candidate] (590.316 µs) : 0, 590
Telemetry [baseline] (8.686 ms) : 0, 8686
Telemetry [candidate] (8.736 ms) : 0, 8736
Flare Poller [baseline] (4.213 ms) : 0, 4213
Flare Poller [candidate] (4.244 ms) : 0, 4244
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.55.0-SNAPSHOT~f114a1f491, baseline=1.55.0-SNAPSHOT~465503232d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.018 s) : 0, 1017566
Total [baseline] (10.754 s) : 0, 10754129
Agent [candidate] (1.021 s) : 0, 1020677
Total [candidate] (10.766 s) : 0, 10766172
section appsec
Agent [baseline] (1.192 s) : 0, 1192296
Total [baseline] (11.036 s) : 0, 11036146
Agent [candidate] (1.207 s) : 0, 1207333
Total [candidate] (11.011 s) : 0, 11010931
section iast
Agent [baseline] (1.151 s) : 0, 1150532
Total [baseline] (10.886 s) : 0, 10886322
Agent [candidate] (1.151 s) : 0, 1150734
Total [candidate] (10.951 s) : 0, 10950708
section profiling
Agent [baseline] (1.175 s) : 0, 1175250
Total [baseline] (11.136 s) : 0, 11136370
Agent [candidate] (1.16 s) : 0, 1160441
Total [candidate] (10.984 s) : 0, 10984129
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.018 s -
Agent appsec 1.192 s 174.731 ms (17.2%)
Agent iast 1.151 s 132.966 ms (13.1%)
Agent profiling 1.175 s 157.684 ms (15.5%)
Total tracing 10.754 s -
Total appsec 11.036 s 282.017 ms (2.6%)
Total iast 10.886 s 132.192 ms (1.2%)
Total profiling 11.136 s 382.241 ms (3.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.021 s -
Agent appsec 1.207 s 186.655 ms (18.3%)
Agent iast 1.151 s 130.057 ms (12.7%)
Agent profiling 1.16 s 139.763 ms (13.7%)
Total tracing 10.766 s -
Total appsec 11.011 s 244.759 ms (2.3%)
Total iast 10.951 s 184.536 ms (1.7%)
Total profiling 10.984 s 217.957 ms (2.0%) 
gantt
    title petclinic - break down per module: candidate=1.55.0-SNAPSHOT~f114a1f491, baseline=1.55.0-SNAPSHOT~465503232d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.461 ms) : 0, 1461
crashtracking [candidate] (1.459 ms) : 0, 1459
BytebuddyAgent [baseline] (693.561 ms) : 0, 693561
BytebuddyAgent [candidate] (697.021 ms) : 0, 697021
GlobalTracer [baseline] (241.508 ms) : 0, 241508
GlobalTracer [candidate] (242.701 ms) : 0, 242701
AppSec [baseline] (32.648 ms) : 0, 32648
AppSec [candidate] (33.105 ms) : 0, 33105
Debugger [baseline] (6.408 ms) : 0, 6408
Debugger [candidate] (6.48 ms) : 0, 6480
Remote Config [baseline] (695.105 µs) : 0, 695
Remote Config [candidate] (695.957 µs) : 0, 696
Telemetry [baseline] (9.271 ms) : 0, 9271
Telemetry [candidate] (9.404 ms) : 0, 9404
Flare Poller [baseline] (10.867 ms) : 0, 10867
Flare Poller [candidate] (8.633 ms) : 0, 8633
section appsec
crashtracking [baseline] (1.45 ms) : 0, 1450
crashtracking [candidate] (1.466 ms) : 0, 1466
BytebuddyAgent [baseline] (716.903 ms) : 0, 716903
BytebuddyAgent [candidate] (727.983 ms) : 0, 727983
GlobalTracer [baseline] (234.072 ms) : 0, 234072
GlobalTracer [candidate] (237.292 ms) : 0, 237292
IAST [baseline] (24.717 ms) : 0, 24717
IAST [candidate] (24.736 ms) : 0, 24736
AppSec [baseline] (174.914 ms) : 0, 174914
AppSec [candidate] (175.281 ms) : 0, 175281
Debugger [baseline] (6.147 ms) : 0, 6147
Debugger [candidate] (6.136 ms) : 0, 6136
Remote Config [baseline] (649.765 µs) : 0, 650
Remote Config [candidate] (646.684 µs) : 0, 647
Telemetry [baseline] (8.457 ms) : 0, 8457
Telemetry [candidate] (8.479 ms) : 0, 8479
Flare Poller [baseline] (3.934 ms) : 0, 3934
Flare Poller [candidate] (4.003 ms) : 0, 4003
section iast
crashtracking [baseline] (1.453 ms) : 0, 1453
crashtracking [candidate] (1.471 ms) : 0, 1471
BytebuddyAgent [baseline] (814.901 ms) : 0, 814901
BytebuddyAgent [candidate] (814.425 ms) : 0, 814425
GlobalTracer [baseline] (231.606 ms) : 0, 231606
GlobalTracer [candidate] (232.099 ms) : 0, 232099
IAST [baseline] (26.709 ms) : 0, 26709
IAST [candidate] (26.578 ms) : 0, 26578
AppSec [baseline] (35.219 ms) : 0, 35219
AppSec [candidate] (35.465 ms) : 0, 35465
Debugger [baseline] (6.06 ms) : 0, 6060
Debugger [candidate] (6.089 ms) : 0, 6089
Remote Config [baseline] (605.683 µs) : 0, 606
Remote Config [candidate] (596.082 µs) : 0, 596
Telemetry [baseline] (8.604 ms) : 0, 8604
Telemetry [candidate] (8.584 ms) : 0, 8584
Flare Poller [baseline] (4.164 ms) : 0, 4164
Flare Poller [candidate] (4.165 ms) : 0, 4165
section profiling
crashtracking [baseline] (1.436 ms) : 0, 1436
crashtracking [candidate] (1.418 ms) : 0, 1418
BytebuddyAgent [baseline] (727.608 ms) : 0, 727608
BytebuddyAgent [candidate] (720.205 ms) : 0, 720205
GlobalTracer [baseline] (220.277 ms) : 0, 220277
GlobalTracer [candidate] (217.137 ms) : 0, 217137
AppSec [baseline] (33.664 ms) : 0, 33664
AppSec [candidate] (33.193 ms) : 0, 33193
Debugger [baseline] (7.263 ms) : 0, 7263
Debugger [candidate] (6.48 ms) : 0, 6480
Remote Config [baseline] (751.012 µs) : 0, 751
Remote Config [candidate] (689.346 µs) : 0, 689
Telemetry [baseline] (15.869 ms) : 0, 15869
Telemetry [candidate] (16.488 ms) : 0, 16488
Flare Poller [baseline] (4.346 ms) : 0, 4346
Flare Poller [candidate] (4.153 ms) : 0, 4153
ProfilingAgent [baseline] (110.257 ms) : 0, 110257
ProfilingAgent [candidate] (107.864 ms) : 0, 107864
Profiling [baseline] (111.829 ms) : 0, 111829
Profiling [candidate] (108.852 ms) : 0, 108852
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci
git_commit_date 1759823305 1759838007
git_commit_sha 4655032 f114a1f
release_version 1.55.0-SNAPSHOT~465503232d 1.55.0-SNAPSHOT~f114a1f491
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1759839468 1759839468
ci_job_id 1166751504 1166751504
ci_pipeline_id 78580664 78580664
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-eqrp28fq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-eqrp28fq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 1 performance regressions! Performance is the same for 9 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-798.411µs; -370.140µs] or [-7.136%; -3.308%]		 unstable
[-26.780op/s; +72.343op/s] or [-6.444%; +17.407%]		 10.605ms 438.375op/s 11.189ms 415.594op/s
scenario:load:petclinic:appsec:high_load worse
[+2.805ms; +3.706ms] or [+6.008%; +7.938%]		 unstable
[-13.533op/s; +0.533op/s] or [-13.500%; +0.531%]		 49.943ms 93.737op/s 46.687ms 100.237op/s
scenario:load:petclinic:tracing:high_load better
[-3.241ms; -2.408ms] or [-7.000%; -5.202%]		 unstable
[-0.918op/s; +14.193op/s] or [-0.909%; +14.047%]		 43.476ms 107.675op/s 46.301ms 101.037op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~f114a1f491, baseline=1.55.0-SNAPSHOT~465503232d
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.285 ms) : 4235, 4334
.   : milestone, 4285,
iast (9.459 ms) : 9298, 9619
.   : milestone, 9459,
iast_FULL (14.702 ms) : 14406, 14997
.   : milestone, 14702,
iast_GLOBAL (11.189 ms) : 10984, 11394
.   : milestone, 11189,
profiling (8.958 ms) : 8812, 9103
.   : milestone, 8958,
tracing (7.775 ms) : 7659, 7891
.   : milestone, 7775,
section candidate
no_agent (4.289 ms) : 4237, 4342
.   : milestone, 4289,
iast (9.401 ms) : 9238, 9564
.   : milestone, 9401,
iast_FULL (14.121 ms) : 13843, 14398
.   : milestone, 14121,
iast_GLOBAL (10.605 ms) : 10412, 10797
.   : milestone, 10605,
profiling (8.896 ms) : 8756, 9035
.   : milestone, 8896,
tracing (7.633 ms) : 7525, 7742
.   : milestone, 7633,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.285 ms [4.235 ms, 4.334 ms] -
iast 9.459 ms [9.298 ms, 9.619 ms] 5.174 ms (120.7%)
iast_FULL 14.702 ms [14.406 ms, 14.997 ms] 10.417 ms (243.1%)
iast_GLOBAL 11.189 ms [10.984 ms, 11.394 ms] 6.904 ms (161.1%)
profiling 8.958 ms [8.812 ms, 9.103 ms] 4.673 ms (109.0%)
tracing 7.775 ms [7.659 ms, 7.891 ms] 3.49 ms (81.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.289 ms [4.237 ms, 4.342 ms] -
iast 9.401 ms [9.238 ms, 9.564 ms] 5.112 ms (119.2%)
iast_FULL 14.121 ms [13.843 ms, 14.398 ms] 9.832 ms (229.2%)
iast_GLOBAL 10.605 ms [10.412 ms, 10.797 ms] 6.316 ms (147.2%)
profiling 8.896 ms [8.756 ms, 9.035 ms] 4.607 ms (107.4%)
tracing 7.633 ms [7.525 ms, 7.742 ms] 3.344 ms (78.0%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~f114a1f491, baseline=1.55.0-SNAPSHOT~465503232d
    dateFormat X
    axisFormat %s
section baseline
no_agent (38.475 ms) : 38161, 38789
.   : milestone, 38475,
appsec (46.687 ms) : 46293, 47081
.   : milestone, 46687,
code_origins (43.924 ms) : 43544, 44305
.   : milestone, 43924,
iast (45.685 ms) : 45293, 46078
.   : milestone, 45685,
profiling (49.009 ms) : 48561, 49456
.   : milestone, 49009,
tracing (46.301 ms) : 45903, 46699
.   : milestone, 46301,
section candidate
no_agent (37.932 ms) : 37624, 38241
.   : milestone, 37932,
appsec (49.943 ms) : 49500, 50385
.   : milestone, 49943,
code_origins (45.116 ms) : 44741, 45490
.   : milestone, 45116,
iast (44.887 ms) : 44502, 45271
.   : milestone, 44887,
profiling (50.119 ms) : 49639, 50599
.   : milestone, 50119,
tracing (43.476 ms) : 43101, 43851
.   : milestone, 43476,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 38.475 ms [38.161 ms, 38.789 ms] -
appsec 46.687 ms [46.293 ms, 47.081 ms] 8.212 ms (21.3%)
code_origins 43.924 ms [43.544 ms, 44.305 ms] 5.449 ms (14.2%)
iast 45.685 ms [45.293 ms, 46.078 ms] 7.21 ms (18.7%)
profiling 49.009 ms [48.561 ms, 49.456 ms] 10.534 ms (27.4%)
tracing 46.301 ms [45.903 ms, 46.699 ms] 7.826 ms (20.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.932 ms [37.624 ms, 38.241 ms] -
appsec 49.943 ms [49.5 ms, 50.385 ms] 12.01 ms (31.7%)
code_origins 45.116 ms [44.741 ms, 45.49 ms] 7.183 ms (18.9%)
iast 44.887 ms [44.502 ms, 45.271 ms] 6.954 ms (18.3%)
profiling 50.119 ms [49.639 ms, 50.599 ms] 12.187 ms (32.1%)
tracing 43.476 ms [43.101 ms, 43.851 ms] 5.544 ms (14.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci
git_commit_date 1759823305 1759838007
git_commit_sha 4655032 f114a1f
release_version 1.55.0-SNAPSHOT~465503232d 1.55.0-SNAPSHOT~f114a1f491
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1759839967 1759839967
ci_job_id 1166751505 1166751505
ci_pipeline_id 78580664 78580664
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-e3063vk5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-e3063vk5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~f114a1f491, baseline=1.55.0-SNAPSHOT~465503232d
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.375 s) : 15375000, 15375000
.   : milestone, 15375000,
appsec (14.979 s) : 14979000, 14979000
.   : milestone, 14979000,
iast (18.483 s) : 18483000, 18483000
.   : milestone, 18483000,
iast_GLOBAL (17.917 s) : 17917000, 17917000
.   : milestone, 17917000,
profiling (15.217 s) : 15217000, 15217000
.   : milestone, 15217000,
tracing (15.008 s) : 15008000, 15008000
.   : milestone, 15008000,
section candidate
no_agent (15.279 s) : 15279000, 15279000
.   : milestone, 15279000,
appsec (15.046 s) : 15046000, 15046000
.   : milestone, 15046000,
iast (18.598 s) : 18598000, 18598000
.   : milestone, 18598000,
iast_GLOBAL (17.983 s) : 17983000, 17983000
.   : milestone, 17983000,
profiling (15.199 s) : 15199000, 15199000
.   : milestone, 15199000,
tracing (15.023 s) : 15023000, 15023000
.   : milestone, 15023000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.375 s [15.375 s, 15.375 s] -
appsec 14.979 s [14.979 s, 14.979 s] -396.0 ms (-2.6%)
iast 18.483 s [18.483 s, 18.483 s] 3.108 s (20.2%)
iast_GLOBAL 17.917 s [17.917 s, 17.917 s] 2.542 s (16.5%)
profiling 15.217 s [15.217 s, 15.217 s] -158.0 ms (-1.0%)
tracing 15.008 s [15.008 s, 15.008 s] -367.0 ms (-2.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.279 s [15.279 s, 15.279 s] -
appsec 15.046 s [15.046 s, 15.046 s] -233.0 ms (-1.5%)
iast 18.598 s [18.598 s, 18.598 s] 3.319 s (21.7%)
iast_GLOBAL 17.983 s [17.983 s, 17.983 s] 2.704 s (17.7%)
profiling 15.199 s [15.199 s, 15.199 s] -80.0 ms (-0.5%)
tracing 15.023 s [15.023 s, 15.023 s] -256.0 ms (-1.7%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~f114a1f491, baseline=1.55.0-SNAPSHOT~465503232d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (3.629 ms) : 3415, 3843
.   : milestone, 3629,
iast (2.197 ms) : 2133, 2260
.   : milestone, 2197,
iast_GLOBAL (2.239 ms) : 2176, 2303
.   : milestone, 2239,
profiling (2.056 ms) : 2004, 2108
.   : milestone, 2056,
tracing (2.022 ms) : 1972, 2071
.   : milestone, 2022,
section candidate
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (3.716 ms) : 3498, 3934
.   : milestone, 3716,
iast (2.199 ms) : 2136, 2263
.   : milestone, 2199,
iast_GLOBAL (2.241 ms) : 2177, 2305
.   : milestone, 2241,
profiling (2.071 ms) : 2018, 2124
.   : milestone, 2071,
tracing (2.025 ms) : 1975, 2075
.   : milestone, 2025,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.483 ms] -
appsec 3.629 ms [3.415 ms, 3.843 ms] 2.158 ms (146.7%)
iast 2.197 ms [2.133 ms, 2.26 ms] 725.382 µs (49.3%)
iast_GLOBAL 2.239 ms [2.176 ms, 2.303 ms] 767.91 µs (52.2%)
profiling 2.056 ms [2.004 ms, 2.108 ms] 584.584 µs (39.7%)
tracing 2.022 ms [1.972 ms, 2.071 ms] 550.39 µs (37.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.459 ms, 1.482 ms] -
appsec 3.716 ms [3.498 ms, 3.934 ms] 2.245 ms (152.7%)
iast 2.199 ms [2.136 ms, 2.263 ms] 728.39 µs (49.5%)
iast_GLOBAL 2.241 ms [2.177 ms, 2.305 ms] 770.301 µs (52.4%)
profiling 2.071 ms [2.018 ms, 2.124 ms] 600.492 µs (40.8%)
tracing 2.025 ms [1.975 ms, 2.075 ms] 554.394 µs (37.7%)

@PerfectSlayer PerfectSlayer merged commit 6d95fc2 into master Oct 7, 2025
540 checks passed
@PerfectSlayer PerfectSlayer deleted the bbujon/ci branch October 7, 2025 12:48
@github-actions github-actions bot added this to the 1.55.0 milestone Oct 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@bric3 bric3 bric3 approved these changes

@dougqh dougqh Awaiting requested review from dougqh dougqh is a code owner automatically assigned from DataDog/apm-lang-platform-java

Assignees

No one assigned

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: bug Bug report and fix

Projects

None yet

Milestone

1.55.0

Development

Successfully merging this pull request may close these issues.

3 participants

@PerfectSlayer @bric3