Skip to content

Migrate V1 Config Inversion CI Jobs to V2 CI Jobs #9946

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 2 commits into from
Nov 17, 2025
Merged

Migrate V1 Config Inversion CI Jobs to V2 CI Jobs #9946

merged 2 commits into from
Nov 17, 2025

Conversation

@mhlidd
Copy link
Contributor

@mhlidd mhlidd commented Nov 12, 2025 •
edited
Loading

What Does This Do

Currently, dd-trace-java has CI jobs in place to enforce and update the documentation of configurations in the Feature Parity Dashboard. With the introduction of a v2 format for the local metadata/supported-configurations.json file, we need to verify additional fields against the FPD. This is done in new CI jobs in libdatadog-build.

This PR migrates the CI jobs used in dd-trace-java from the v1 versions to v2 versions. Note that the local metadata/supported-configurations.json file does not have to be in v2 format in order to use the v2 CI jobs.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@mhlidd mhlidd added the tag: do not merge Do not merge changes label Nov 12, 2025
@datadog-official
Copy link

datadog-official bot commented Nov 13, 2025 •
edited by datadog-datadog-prod-us1 bot
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.66% (-0.01%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: f9ee58f | Docs | Datadog PR Page | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Nov 13, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/testing_ci
git_commit_date 1763407991 1763410442
git_commit_sha b6d4e4f f9ee58f
release_version 1.56.0-SNAPSHOT~b6d4e4fc4a 1.56.0-SNAPSHOT~f9ee58f5e4
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763412260 1763412260
ci_job_id 1240270373 1240270373
ci_pipeline_id 82795132 82795132
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-exk5j2zj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-exk5j2zj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 6 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~f9ee58f5e4, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.102 s) : 0, 1102028
Total [baseline] (8.842 s) : 0, 8841874
Agent [candidate] (1.109 s) : 0, 1108569
Total [candidate] (8.844 s) : 0, 8843743
section iast
Agent [baseline] (1.245 s) : 0, 1244612
Total [baseline] (9.545 s) : 0, 9544544
Agent [candidate] (1.237 s) : 0, 1237112
Total [candidate] (9.547 s) : 0, 9546907
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.102 s -
Agent iast 1.245 s 142.584 ms (12.9%)
Total tracing 8.842 s -
Total iast 9.545 s 702.67 ms (7.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.109 s -
Agent iast 1.237 s 128.543 ms (11.6%)
Total tracing 8.844 s -
Total iast 9.547 s 703.164 ms (8.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~f9ee58f5e4, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.452 ms) : 0, 1452
crashtracking [candidate] (1.458 ms) : 0, 1458
BytebuddyAgent [baseline] (708.193 ms) : 0, 708193
BytebuddyAgent [candidate] (713.027 ms) : 0, 713027
GlobalTracer [baseline] (249.065 ms) : 0, 249065
GlobalTracer [candidate] (250.295 ms) : 0, 250295
AppSec [baseline] (32.452 ms) : 0, 32452
AppSec [candidate] (32.512 ms) : 0, 32512
Debugger [baseline] (63.408 ms) : 0, 63408
Debugger [candidate] (63.809 ms) : 0, 63809
Remote Config [baseline] (637.419 µs) : 0, 637
Remote Config [candidate] (627.305 µs) : 0, 627
Telemetry [baseline] (8.244 ms) : 0, 8244
Telemetry [candidate] (8.164 ms) : 0, 8164
Flare Poller [baseline] (3.701 ms) : 0, 3701
Flare Poller [candidate] (3.684 ms) : 0, 3684
section iast
crashtracking [baseline] (1.458 ms) : 0, 1458
crashtracking [candidate] (1.458 ms) : 0, 1458
BytebuddyAgent [baseline] (835.316 ms) : 0, 835316
BytebuddyAgent [candidate] (829.432 ms) : 0, 829432
GlobalTracer [baseline] (238.904 ms) : 0, 238904
GlobalTracer [candidate] (237.901 ms) : 0, 237901
IAST [baseline] (27.816 ms) : 0, 27816
IAST [candidate] (28.272 ms) : 0, 28272
AppSec [baseline] (33.967 ms) : 0, 33967
AppSec [candidate] (33.063 ms) : 0, 33063
Debugger [baseline] (60.418 ms) : 0, 60418
Debugger [candidate] (60.314 ms) : 0, 60314
Remote Config [baseline] (541.912 µs) : 0, 542
Remote Config [candidate] (541.888 µs) : 0, 542
Telemetry [baseline] (7.656 ms) : 0, 7656
Telemetry [candidate] (7.647 ms) : 0, 7647
Flare Poller [baseline] (3.45 ms) : 0, 3450
Flare Poller [candidate] (3.483 ms) : 0, 3483
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~f9ee58f5e4, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.101 s) : 0, 1100683
Total [baseline] (10.81 s) : 0, 10810136
Agent [candidate] (1.107 s) : 0, 1106695
Total [candidate] (10.808 s) : 0, 10807806
section appsec
Agent [baseline] (1.278 s) : 0, 1278216
Total [baseline] (11.073 s) : 0, 11072787
Agent [candidate] (1.291 s) : 0, 1290512
Total [candidate] (10.989 s) : 0, 10989424
section iast
Agent [baseline] (1.239 s) : 0, 1239327
Total [baseline] (11.226 s) : 0, 11226459
Agent [candidate] (1.25 s) : 0, 1250172
Total [candidate] (11.283 s) : 0, 11282776
section profiling
Agent [baseline] (1.228 s) : 0, 1227734
Total [baseline] (10.99 s) : 0, 10989581
Agent [candidate] (1.229 s) : 0, 1228581
Total [candidate] (11.092 s) : 0, 11091552
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.101 s -
Agent appsec 1.278 s 177.533 ms (16.1%)
Agent iast 1.239 s 138.644 ms (12.6%)
Agent profiling 1.228 s 127.051 ms (11.5%)
Total tracing 10.81 s -
Total appsec 11.073 s 262.65 ms (2.4%)
Total iast 11.226 s 416.322 ms (3.9%)
Total profiling 10.99 s 179.444 ms (1.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.107 s -
Agent appsec 1.291 s 183.817 ms (16.6%)
Agent iast 1.25 s 143.477 ms (13.0%)
Agent profiling 1.229 s 121.886 ms (11.0%)
Total tracing 10.808 s -
Total appsec 10.989 s 181.619 ms (1.7%)
Total iast 11.283 s 474.971 ms (4.4%)
Total profiling 11.092 s 283.746 ms (2.6%) 
gantt
    title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~f9ee58f5e4, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.451 ms) : 0, 1451
crashtracking [candidate] (1.463 ms) : 0, 1463
BytebuddyAgent [baseline] (705.857 ms) : 0, 705857
BytebuddyAgent [candidate] (711.388 ms) : 0, 711388
GlobalTracer [baseline] (248.842 ms) : 0, 248842
GlobalTracer [candidate] (249.879 ms) : 0, 249879
AppSec [baseline] (32.362 ms) : 0, 32362
AppSec [candidate] (32.425 ms) : 0, 32425
Debugger [baseline] (64.774 ms) : 0, 64774
Debugger [candidate] (64.088 ms) : 0, 64088
Remote Config [baseline] (627.013 µs) : 0, 627
Remote Config [candidate] (634.585 µs) : 0, 635
Telemetry [baseline] (8.219 ms) : 0, 8219
Telemetry [candidate] (8.175 ms) : 0, 8175
Flare Poller [baseline] (3.691 ms) : 0, 3691
Flare Poller [candidate] (3.686 ms) : 0, 3686
section appsec
crashtracking [baseline] (1.463 ms) : 0, 1463
crashtracking [candidate] (1.458 ms) : 0, 1458
BytebuddyAgent [baseline] (729.452 ms) : 0, 729452
BytebuddyAgent [candidate] (735.912 ms) : 0, 735912
GlobalTracer [baseline] (240.069 ms) : 0, 240069
GlobalTracer [candidate] (242.49 ms) : 0, 242490
IAST [baseline] (24.755 ms) : 0, 24755
IAST [candidate] (25.308 ms) : 0, 25308
AppSec [baseline] (173.841 ms) : 0, 173841
AppSec [candidate] (175.794 ms) : 0, 175794
Debugger [baseline] (60.869 ms) : 0, 60869
Debugger [candidate] (61.378 ms) : 0, 61378
Remote Config [baseline] (666.633 µs) : 0, 667
Remote Config [candidate] (675.522 µs) : 0, 676
Telemetry [baseline] (8.358 ms) : 0, 8358
Telemetry [candidate] (8.37 ms) : 0, 8370
Flare Poller [baseline] (3.859 ms) : 0, 3859
Flare Poller [candidate] (3.911 ms) : 0, 3911
section iast
crashtracking [baseline] (1.449 ms) : 0, 1449
crashtracking [candidate] (1.473 ms) : 0, 1473
BytebuddyAgent [baseline] (830.236 ms) : 0, 830236
BytebuddyAgent [candidate] (840.572 ms) : 0, 840572
GlobalTracer [baseline] (238.433 ms) : 0, 238433
GlobalTracer [candidate] (239.059 ms) : 0, 239059
IAST [baseline] (29.978 ms) : 0, 29978
IAST [candidate] (29.806 ms) : 0, 29806
AppSec [baseline] (31.629 ms) : 0, 31629
AppSec [candidate] (31.188 ms) : 0, 31188
Debugger [baseline] (60.936 ms) : 0, 60936
Debugger [candidate] (61.173 ms) : 0, 61173
Remote Config [baseline] (556.896 µs) : 0, 557
Remote Config [candidate] (549.425 µs) : 0, 549
Telemetry [baseline] (7.686 ms) : 0, 7686
Telemetry [candidate] (7.712 ms) : 0, 7712
Flare Poller [baseline] (3.481 ms) : 0, 3481
Flare Poller [candidate] (3.499 ms) : 0, 3499
section profiling
crashtracking [baseline] (1.433 ms) : 0, 1433
crashtracking [candidate] (1.431 ms) : 0, 1431
BytebuddyAgent [baseline] (729.938 ms) : 0, 729938
BytebuddyAgent [candidate] (730.815 ms) : 0, 730815
GlobalTracer [baseline] (222.276 ms) : 0, 222276
GlobalTracer [candidate] (222.582 ms) : 0, 222582
AppSec [baseline] (32.179 ms) : 0, 32179
AppSec [candidate] (31.965 ms) : 0, 31965
Debugger [baseline] (62.665 ms) : 0, 62665
Debugger [candidate] (62.501 ms) : 0, 62501
Remote Config [baseline] (636.297 µs) : 0, 636
Remote Config [candidate] (641.174 µs) : 0, 641
Telemetry [baseline] (7.93 ms) : 0, 7930
Telemetry [candidate] (7.936 ms) : 0, 7936
Flare Poller [baseline] (3.715 ms) : 0, 3715
Flare Poller [candidate] (3.738 ms) : 0, 3738
ProfilingAgent [baseline] (97.186 ms) : 0, 97186
ProfilingAgent [candidate] (97.097 ms) : 0, 97097
Profiling [baseline] (97.784 ms) : 0, 97784
Profiling [candidate] (97.684 ms) : 0, 97684
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/testing_ci
git_commit_date 1763407991 1763410442
git_commit_sha b6d4e4f f9ee58f
release_version 1.56.0-SNAPSHOT~b6d4e4fc4a 1.56.0-SNAPSHOT~f9ee58f5e4
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763412748 1763412748
ci_job_id 1240270374 1240270374
ci_pipeline_id 82795132 82795132
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-kvxxtlst 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-kvxxtlst 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 5 performance improvements and 1 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:tracing:high_load better
[-155.553µs; -66.551µs] or [-9.716%; -4.157%]		 unstable
[-1115.407µs; -343.280µs] or [-24.037%; -7.398%]		 unstable
[+0.330op/s; +528.608op/s] or [+0.015%; +23.335%]		 1.490ms 3.911ms 2529.750op/s 1.601ms 4.640ms 2265.281op/s
scenario:load:insecure-bank:iast_FULL:high_load better
[-474.170µs; -283.696µs] or [-8.871%; -5.307%]		 better
[-1090.613µs; -443.624µs] or [-8.641%; -3.515%]		 unstable
[-30.822op/s; +126.822op/s] or [-3.990%; +16.419%]		 4.966ms 11.854ms 820.406op/s 5.345ms 12.621ms 772.406op/s
scenario:load:petclinic:code_origins:high_load better
[-2.715ms; -2.317ms] or [-13.774%; -11.755%]		 better
[-3.515ms; -2.607ms] or [-11.284%; -8.370%]		 unstable
[+9.776op/s; +55.724op/s] or [+4.193%; +23.900%]		 17.195ms 28.087ms 265.906op/s 19.710ms 31.148ms 233.156op/s
scenario:load:petclinic:profiling:high_load worse
[+0.757ms; +1.641ms] or [+4.117%; +8.925%]		 unsure
[+0.353ms; +1.901ms] or [+1.171%; +6.306%]		 unstable
[-35.868op/s; +9.868op/s] or [-14.427%; +3.969%]		 19.587ms 31.273ms 235.625op/s 18.388ms 30.146ms 248.625op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~f9ee58f5e4, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.185 ms) : 1174, 1197
.   : milestone, 1185,
iast (3.283 ms) : 3241, 3324
.   : milestone, 3283,
iast_FULL (5.988 ms) : 5927, 6048
.   : milestone, 5988,
iast_GLOBAL (3.685 ms) : 3620, 3749
.   : milestone, 3685,
profiling (2.115 ms) : 2095, 2135
.   : milestone, 2115,
tracing (1.991 ms) : 1972, 2011
.   : milestone, 1991,
section candidate
no_agent (1.205 ms) : 1193, 1217
.   : milestone, 1205,
iast (3.258 ms) : 3215, 3302
.   : milestone, 3258,
iast_FULL (5.633 ms) : 5577, 5689
.   : milestone, 5633,
iast_GLOBAL (3.741 ms) : 3685, 3796
.   : milestone, 3741,
profiling (2.064 ms) : 2046, 2082
.   : milestone, 2064,
tracing (1.776 ms) : 1761, 1790
.   : milestone, 1776,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.185 ms [1.174 ms, 1.197 ms] -
iast 3.283 ms [3.241 ms, 3.324 ms] 2.097 ms (176.9%)
iast_FULL 5.988 ms [5.927 ms, 6.048 ms] 4.802 ms (405.2%)
iast_GLOBAL 3.685 ms [3.62 ms, 3.749 ms] 2.499 ms (210.9%)
profiling 2.115 ms [2.095 ms, 2.135 ms] 929.953 µs (78.5%)
tracing 1.991 ms [1.972 ms, 2.011 ms] 806.199 µs (68.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.205 ms [1.193 ms, 1.217 ms] -
iast 3.258 ms [3.215 ms, 3.302 ms] 2.053 ms (170.3%)
iast_FULL 5.633 ms [5.577 ms, 5.689 ms] 4.428 ms (367.3%)
iast_GLOBAL 3.741 ms [3.685 ms, 3.796 ms] 2.535 ms (210.3%)
profiling 2.064 ms [2.046 ms, 2.082 ms] 858.836 µs (71.3%)
tracing 1.776 ms [1.761 ms, 1.79 ms] 570.365 µs (47.3%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~f9ee58f5e4, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.303 ms) : 19103, 19504
.   : milestone, 19303,
appsec (18.608 ms) : 18417, 18798
.   : milestone, 18608,
code_origins (20.026 ms) : 19828, 20225
.   : milestone, 20026,
iast (17.697 ms) : 17517, 17877
.   : milestone, 17697,
profiling (18.77 ms) : 18581, 18959
.   : milestone, 18770,
tracing (17.72 ms) : 17545, 17895
.   : milestone, 17720,
section candidate
no_agent (19.514 ms) : 19317, 19711
.   : milestone, 19514,
appsec (18.748 ms) : 18560, 18936
.   : milestone, 18748,
code_origins (17.547 ms) : 17375, 17719
.   : milestone, 17547,
iast (17.712 ms) : 17534, 17889
.   : milestone, 17712,
profiling (19.811 ms) : 19611, 20010
.   : milestone, 19811,
tracing (17.61 ms) : 17437, 17783
.   : milestone, 17610,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.303 ms [19.103 ms, 19.504 ms] -
appsec 18.608 ms [18.417 ms, 18.798 ms] -695.622 µs (-3.6%)
code_origins 20.026 ms [19.828 ms, 20.225 ms] 722.99 µs (3.7%)
iast 17.697 ms [17.517 ms, 17.877 ms] -1.606 ms (-8.3%)
profiling 18.77 ms [18.581 ms, 18.959 ms] -533.428 µs (-2.8%)
tracing 17.72 ms [17.545 ms, 17.895 ms] -1.583 ms (-8.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.514 ms [19.317 ms, 19.711 ms] -
appsec 18.748 ms [18.56 ms, 18.936 ms] -766.108 µs (-3.9%)
code_origins 17.547 ms [17.375 ms, 17.719 ms] -1.967 ms (-10.1%)
iast 17.712 ms [17.534 ms, 17.889 ms] -1.803 ms (-9.2%)
profiling 19.811 ms [19.611 ms, 20.01 ms] 296.183 µs (1.5%)
tracing 17.61 ms [17.437 ms, 17.783 ms] -1.904 ms (-9.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/testing_ci
git_commit_date 1763407991 1763410442
git_commit_sha b6d4e4f f9ee58f
release_version 1.56.0-SNAPSHOT~b6d4e4fc4a 1.56.0-SNAPSHOT~f9ee58f5e4
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1763412432 1763412432
ci_job_id 1240270375 1240270375
ci_pipeline_id 82795132 82795132
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-xdayizfb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-xdayizfb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~f9ee58f5e4, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.014 s) : 15014000, 15014000
.   : milestone, 15014000,
appsec (14.613 s) : 14613000, 14613000
.   : milestone, 14613000,
iast (18.634 s) : 18634000, 18634000
.   : milestone, 18634000,
iast_GLOBAL (17.997 s) : 17997000, 17997000
.   : milestone, 17997000,
profiling (15.471 s) : 15471000, 15471000
.   : milestone, 15471000,
tracing (14.559 s) : 14559000, 14559000
.   : milestone, 14559000,
section candidate
no_agent (14.949 s) : 14949000, 14949000
.   : milestone, 14949000,
appsec (14.61 s) : 14610000, 14610000
.   : milestone, 14610000,
iast (18.833 s) : 18833000, 18833000
.   : milestone, 18833000,
iast_GLOBAL (17.902 s) : 17902000, 17902000
.   : milestone, 17902000,
profiling (15.582 s) : 15582000, 15582000
.   : milestone, 15582000,
tracing (14.439 s) : 14439000, 14439000
.   : milestone, 14439000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.014 s [15.014 s, 15.014 s] -
appsec 14.613 s [14.613 s, 14.613 s] -401.0 ms (-2.7%)
iast 18.634 s [18.634 s, 18.634 s] 3.62 s (24.1%)
iast_GLOBAL 17.997 s [17.997 s, 17.997 s] 2.983 s (19.9%)
profiling 15.471 s [15.471 s, 15.471 s] 457.0 ms (3.0%)
tracing 14.559 s [14.559 s, 14.559 s] -455.0 ms (-3.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.949 s [14.949 s, 14.949 s] -
appsec 14.61 s [14.61 s, 14.61 s] -339.0 ms (-2.3%)
iast 18.833 s [18.833 s, 18.833 s] 3.884 s (26.0%)
iast_GLOBAL 17.902 s [17.902 s, 17.902 s] 2.953 s (19.8%)
profiling 15.582 s [15.582 s, 15.582 s] 633.0 ms (4.2%)
tracing 14.439 s [14.439 s, 14.439 s] -510.0 ms (-3.4%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~f9ee58f5e4, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (3.714 ms) : 3492, 3937
.   : milestone, 3714,
iast (2.208 ms) : 2143, 2272
.   : milestone, 2208,
iast_GLOBAL (2.255 ms) : 2190, 2320
.   : milestone, 2255,
profiling (2.048 ms) : 1997, 2099
.   : milestone, 2048,
tracing (2.018 ms) : 1968, 2068
.   : milestone, 2018,
section candidate
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (3.629 ms) : 3415, 3843
.   : milestone, 3629,
iast (2.207 ms) : 2143, 2271
.   : milestone, 2207,
iast_GLOBAL (2.248 ms) : 2184, 2312
.   : milestone, 2248,
profiling (2.075 ms) : 2023, 2128
.   : milestone, 2075,
tracing (2.021 ms) : 1972, 2071
.   : milestone, 2021,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 3.714 ms [3.492 ms, 3.937 ms] 2.24 ms (152.0%)
iast 2.208 ms [2.143 ms, 2.272 ms] 733.35 µs (49.7%)
iast_GLOBAL 2.255 ms [2.19 ms, 2.32 ms] 780.913 µs (53.0%)
profiling 2.048 ms [1.997 ms, 2.099 ms] 573.858 µs (38.9%)
tracing 2.018 ms [1.968 ms, 2.068 ms] 543.875 µs (36.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.461 ms, 1.484 ms] -
appsec 3.629 ms [3.415 ms, 3.843 ms] 2.156 ms (146.4%)
iast 2.207 ms [2.143 ms, 2.271 ms] 734.317 µs (49.9%)
iast_GLOBAL 2.248 ms [2.184 ms, 2.312 ms] 775.142 µs (52.6%)
profiling 2.075 ms [2.023 ms, 2.128 ms] 602.607 µs (40.9%)
tracing 2.021 ms [1.972 ms, 2.071 ms] 548.44 µs (37.2%)

@mhlidd mhlidd changed the title migrated and testing same v1 file - should pass Migrate v1 Config Inversion CI Jobs to V2 CI Jobs Nov 17, 2025
@mhlidd mhlidd marked this pull request as ready for review November 17, 2025 20:18
@mhlidd mhlidd requested a review from a team as a code owner November 17, 2025 20:18
@mhlidd mhlidd requested review from randomanderson and removed request for a team November 17, 2025 20:18
@mhlidd mhlidd changed the title Migrate v1 Config Inversion CI Jobs to V2 CI Jobs Migrate V1 Config Inversion CI Jobs to V2 CI Jobs Nov 17, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Nov 17, 2025

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@mhlidd mhlidd added type: enhancement Enhancements and improvements tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling and removed tag: do not merge Do not merge changes labels Nov 17, 2025
sarahchen6
sarahchen6 approved these changes Nov 17, 2025
View reviewed changes
Copy link
Contributor

@sarahchen6 sarahchen6 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for including the relevant links in the description 👍

@mhlidd mhlidd merged commit 314a089 into master Nov 17, 2025
543 of 550 checks passed
@mhlidd mhlidd deleted the mhlidd/testing_ci branch November 17, 2025 21:30
@github-actions github-actions bot added this to the 1.56.0 milestone Nov 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@sarahchen6 sarahchen6 sarahchen6 approved these changes

@randomanderson randomanderson Awaiting requested review from randomanderson randomanderson is a code owner automatically assigned from DataDog/apm-release-platform

Assignees

No one assigned

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.56.0

Development

Successfully merging this pull request may close these issues.

3 participants

@mhlidd @sarahchen6