Skip to content

Disable test environment temporarily #9813

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 3 commits into from
Oct 21, 2025
Merged

Disable test environment temporarily #9813

merged 3 commits into from
Oct 21, 2025

Conversation

@daniel-mohedano
Copy link
Contributor

@daniel-mohedano daniel-mohedano commented Oct 21, 2025 •
edited
Loading

What Does This Do

  • Disable test environment tests

Motivation

  • The optional checks are not behaving as expected, making the tests run unconditionally.

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@daniel-mohedano daniel-mohedano marked this pull request as ready for review October 21, 2025 08:17
@daniel-mohedano daniel-mohedano requested a review from a team as a code owner October 21, 2025 08:17
@daniel-mohedano daniel-mohedano requested review from randomanderson and removed request for a team October 21, 2025 08:17
@daniel-mohedano daniel-mohedano added the tag: no release notes Changes to exclude from release notes label Oct 21, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Oct 21, 2025

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@datadog-official
Copy link

datadog-official bot commented Oct 21, 2025 •
edited
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.69% (-0.03%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: fe7f389 | Docs | Was this helpful? Give us feedback!

@amarziali amarziali added type: bug Bug report and fix comp: ci visibility Continuous Integration Visibility labels Oct 21, 2025
@pr-commenter
Copy link

pr-commenter bot commented Oct 21, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/disable-testenv
git_commit_date 1760967512 1761034905
git_commit_sha fb31324 fe7f389
release_version 1.55.0-SNAPSHOT~fb3132475b 1.55.0-SNAPSHOT~fe7f3899a0
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1761036656 1761036656
ci_job_id 1188402103 1188402103
ci_pipeline_id 79814315 79814315
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-ycgnkgt7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-ycgnkgt7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 6 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.55.0-SNAPSHOT~fe7f3899a0, baseline=1.55.0-SNAPSHOT~fb3132475b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.018 s) : 0, 1017908
Total [baseline] (8.675 s) : 0, 8674811
Agent [candidate] (1.033 s) : 0, 1032832
Total [candidate] (8.735 s) : 0, 8735404
section iast
Agent [baseline] (1.154 s) : 0, 1154247
Total [baseline] (9.302 s) : 0, 9302456
Agent [candidate] (1.154 s) : 0, 1153772
Total [candidate] (9.3 s) : 0, 9300152
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.018 s -
Agent iast 1.154 s 136.339 ms (13.4%)
Total tracing 8.675 s -
Total iast 9.302 s 627.645 ms (7.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.033 s -
Agent iast 1.154 s 120.94 ms (11.7%)
Total tracing 8.735 s -
Total iast 9.3 s 564.748 ms (6.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.55.0-SNAPSHOT~fe7f3899a0, baseline=1.55.0-SNAPSHOT~fb3132475b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.467 ms) : 0, 1467
crashtracking [candidate] (1.48 ms) : 0, 1480
BytebuddyAgent [baseline] (693.75 ms) : 0, 693750
BytebuddyAgent [candidate] (704.554 ms) : 0, 704554
GlobalTracer [baseline] (242.962 ms) : 0, 242962
GlobalTracer [candidate] (246.07 ms) : 0, 246070
AppSec [baseline] (32.113 ms) : 0, 32113
AppSec [candidate] (32.474 ms) : 0, 32474
Debugger [baseline] (6.274 ms) : 0, 6274
Debugger [candidate] (6.332 ms) : 0, 6332
Remote Config [baseline] (677.271 µs) : 0, 677
Remote Config [candidate] (675.674 µs) : 0, 676
Telemetry [baseline] (9.427 ms) : 0, 9427
Telemetry [candidate] (9.392 ms) : 0, 9392
Flare Poller [baseline] (10.083 ms) : 0, 10083
Flare Poller [candidate] (10.402 ms) : 0, 10402
section iast
crashtracking [baseline] (1.496 ms) : 0, 1496
crashtracking [candidate] (1.486 ms) : 0, 1486
BytebuddyAgent [baseline] (817.227 ms) : 0, 817227
BytebuddyAgent [candidate] (817.035 ms) : 0, 817035
GlobalTracer [baseline] (231.84 ms) : 0, 231840
GlobalTracer [candidate] (231.941 ms) : 0, 231941
IAST [baseline] (26.817 ms) : 0, 26817
IAST [candidate] (26.774 ms) : 0, 26774
AppSec [baseline] (35.366 ms) : 0, 35366
AppSec [candidate] (35.342 ms) : 0, 35342
Debugger [baseline] (6.205 ms) : 0, 6205
Debugger [candidate] (6.123 ms) : 0, 6123
Remote Config [baseline] (615.754 µs) : 0, 616
Remote Config [candidate] (601.819 µs) : 0, 602
Telemetry [baseline] (8.859 ms) : 0, 8859
Telemetry [candidate] (8.713 ms) : 0, 8713
Flare Poller [baseline] (4.264 ms) : 0, 4264
Flare Poller [candidate] (4.283 ms) : 0, 4283
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.55.0-SNAPSHOT~fe7f3899a0, baseline=1.55.0-SNAPSHOT~fb3132475b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.019 s) : 0, 1019135
Total [baseline] (10.634 s) : 0, 10634420
Agent [candidate] (1.022 s) : 0, 1021764
Total [candidate] (10.788 s) : 0, 10788264
section appsec
Agent [baseline] (1.202 s) : 0, 1202416
Total [baseline] (10.842 s) : 0, 10842042
Agent [candidate] (1.192 s) : 0, 1191668
Total [candidate] (10.889 s) : 0, 10888827
section iast
Agent [baseline] (1.161 s) : 0, 1161422
Total [baseline] (11.189 s) : 0, 11188883
Agent [candidate] (1.156 s) : 0, 1155611
Total [candidate] (11.211 s) : 0, 11211016
section profiling
Agent [baseline] (1.181 s) : 0, 1181276
Total [baseline] (11.019 s) : 0, 11018688
Agent [candidate] (1.172 s) : 0, 1171709
Total [candidate] (10.849 s) : 0, 10848578
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.019 s -
Agent appsec 1.202 s 183.281 ms (18.0%)
Agent iast 1.161 s 142.287 ms (14.0%)
Agent profiling 1.181 s 162.141 ms (15.9%)
Total tracing 10.634 s -
Total appsec 10.842 s 207.622 ms (2.0%)
Total iast 11.189 s 554.462 ms (5.2%)
Total profiling 11.019 s 384.268 ms (3.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.022 s -
Agent appsec 1.192 s 169.904 ms (16.6%)
Agent iast 1.156 s 133.847 ms (13.1%)
Agent profiling 1.172 s 149.945 ms (14.7%)
Total tracing 10.788 s -
Total appsec 10.889 s 100.564 ms (0.9%)
Total iast 11.211 s 422.752 ms (3.9%)
Total profiling 10.849 s 60.314 ms (0.6%) 
gantt
    title petclinic - break down per module: candidate=1.55.0-SNAPSHOT~fe7f3899a0, baseline=1.55.0-SNAPSHOT~fb3132475b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.476 ms) : 0, 1476
crashtracking [candidate] (1.477 ms) : 0, 1477
BytebuddyAgent [baseline] (695.223 ms) : 0, 695223
BytebuddyAgent [candidate] (695.889 ms) : 0, 695889
GlobalTracer [baseline] (243.305 ms) : 0, 243305
GlobalTracer [candidate] (243.659 ms) : 0, 243659
AppSec [baseline] (32.071 ms) : 0, 32071
AppSec [candidate] (32.606 ms) : 0, 32606
Debugger [baseline] (6.286 ms) : 0, 6286
Debugger [candidate] (6.319 ms) : 0, 6319
Remote Config [baseline] (675.533 µs) : 0, 676
Remote Config [candidate] (681.943 µs) : 0, 682
Telemetry [baseline] (9.273 ms) : 0, 9273
Telemetry [candidate] (9.391 ms) : 0, 9391
Flare Poller [baseline] (9.625 ms) : 0, 9625
Flare Poller [candidate] (10.397 ms) : 0, 10397
section appsec
crashtracking [baseline] (1.472 ms) : 0, 1472
crashtracking [candidate] (1.481 ms) : 0, 1481
BytebuddyAgent [baseline] (724.335 ms) : 0, 724335
BytebuddyAgent [candidate] (715.973 ms) : 0, 715973
GlobalTracer [baseline] (235.774 ms) : 0, 235774
GlobalTracer [candidate] (234.027 ms) : 0, 234027
IAST [baseline] (24.851 ms) : 0, 24851
IAST [candidate] (24.714 ms) : 0, 24714
AppSec [baseline] (175.237 ms) : 0, 175237
AppSec [candidate] (175.101 ms) : 0, 175101
Debugger [baseline] (6.105 ms) : 0, 6105
Debugger [candidate] (6.095 ms) : 0, 6095
Remote Config [baseline] (635.003 µs) : 0, 635
Remote Config [candidate] (637.765 µs) : 0, 638
Telemetry [baseline] (8.681 ms) : 0, 8681
Telemetry [candidate] (8.584 ms) : 0, 8584
Flare Poller [baseline] (3.953 ms) : 0, 3953
Flare Poller [candidate] (3.919 ms) : 0, 3919
section iast
crashtracking [baseline] (1.491 ms) : 0, 1491
crashtracking [candidate] (1.476 ms) : 0, 1476
BytebuddyAgent [baseline] (823.743 ms) : 0, 823743
BytebuddyAgent [candidate] (818.245 ms) : 0, 818245
GlobalTracer [baseline] (232.597 ms) : 0, 232597
GlobalTracer [candidate] (232.496 ms) : 0, 232496
IAST [baseline] (26.74 ms) : 0, 26740
IAST [candidate] (26.868 ms) : 0, 26868
AppSec [baseline] (35.293 ms) : 0, 35293
AppSec [candidate] (35.131 ms) : 0, 35131
Debugger [baseline] (6.227 ms) : 0, 6227
Debugger [candidate] (6.196 ms) : 0, 6196
Remote Config [baseline] (611.694 µs) : 0, 612
Remote Config [candidate] (607.04 µs) : 0, 607
Telemetry [baseline] (8.765 ms) : 0, 8765
Telemetry [candidate] (8.783 ms) : 0, 8783
Flare Poller [baseline] (4.283 ms) : 0, 4283
Flare Poller [candidate] (4.236 ms) : 0, 4236
section profiling
crashtracking [baseline] (1.49 ms) : 0, 1490
crashtracking [candidate] (1.481 ms) : 0, 1481
BytebuddyAgent [baseline] (730.615 ms) : 0, 730615
BytebuddyAgent [candidate] (726.453 ms) : 0, 726453
GlobalTracer [baseline] (221.594 ms) : 0, 221594
GlobalTracer [candidate] (220.336 ms) : 0, 220336
AppSec [baseline] (33.017 ms) : 0, 33017
AppSec [candidate] (32.429 ms) : 0, 32429
Debugger [baseline] (8.319 ms) : 0, 8319
Debugger [candidate] (7.522 ms) : 0, 7522
Remote Config [baseline] (732.2 µs) : 0, 732
Remote Config [candidate] (693.803 µs) : 0, 694
Telemetry [baseline] (14.492 ms) : 0, 14492
Telemetry [candidate] (14.504 ms) : 0, 14504
Flare Poller [baseline] (4.312 ms) : 0, 4312
Flare Poller [candidate] (4.892 ms) : 0, 4892
ProfilingAgent [baseline] (112.141 ms) : 0, 112141
ProfilingAgent [candidate] (109.204 ms) : 0, 109204
Profiling [baseline] (112.784 ms) : 0, 112784
Profiling [candidate] (109.851 ms) : 0, 109851
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/disable-testenv
git_commit_date 1760967512 1761034905
git_commit_sha fb31324 fe7f389
release_version 1.55.0-SNAPSHOT~fb3132475b 1.55.0-SNAPSHOT~fe7f3899a0
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1761036401 1761036401
ci_job_id 1188402104 1188402104
ci_pipeline_id 79814315 79814315
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-2wr6zhyd 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-2wr6zhyd 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:iast:high_load better
[-620.004µs; -261.187µs] or [-6.252%; -2.634%]		 unstable
[-38.911op/s; +82.224op/s] or [-8.308%; +17.555%]		 9.477ms 490.031op/s 9.917ms 468.375op/s
scenario:load:petclinic:iast:high_load worse
[+1.335ms; +2.169ms] or [+3.017%; +4.902%]		 unstable
[-10.861op/s; +2.736op/s] or [-10.264%; +2.585%]		 45.992ms 101.750op/s 44.240ms 105.812op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~fe7f3899a0, baseline=1.55.0-SNAPSHOT~fb3132475b
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.59 ms) : 36300, 36881
.   : milestone, 36590,
appsec (47.269 ms) : 46853, 47686
.   : milestone, 47269,
code_origins (43.331 ms) : 42943, 43719
.   : milestone, 43331,
iast (44.24 ms) : 43878, 44602
.   : milestone, 44240,
profiling (48.873 ms) : 48422, 49324
.   : milestone, 48873,
tracing (44.347 ms) : 43958, 44736
.   : milestone, 44347,
section candidate
no_agent (37.426 ms) : 37132, 37721
.   : milestone, 37426,
appsec (47.33 ms) : 46910, 47750
.   : milestone, 47330,
code_origins (43.766 ms) : 43404, 44129
.   : milestone, 43766,
iast (45.992 ms) : 45581, 46404
.   : milestone, 45992,
profiling (48.527 ms) : 48100, 48955
.   : milestone, 48527,
tracing (43.085 ms) : 42698, 43473
.   : milestone, 43085,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.59 ms [36.3 ms, 36.881 ms] -
appsec 47.269 ms [46.853 ms, 47.686 ms] 10.679 ms (29.2%)
code_origins 43.331 ms [42.943 ms, 43.719 ms] 6.741 ms (18.4%)
iast 44.24 ms [43.878 ms, 44.602 ms] 7.65 ms (20.9%)
profiling 48.873 ms [48.422 ms, 49.324 ms] 12.283 ms (33.6%)
tracing 44.347 ms [43.958 ms, 44.736 ms] 7.757 ms (21.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.426 ms [37.132 ms, 37.721 ms] -
appsec 47.33 ms [46.91 ms, 47.75 ms] 9.903 ms (26.5%)
code_origins 43.766 ms [43.404 ms, 44.129 ms] 6.34 ms (16.9%)
iast 45.992 ms [45.581 ms, 46.404 ms] 8.566 ms (22.9%)
profiling 48.527 ms [48.1 ms, 48.955 ms] 11.101 ms (29.7%)
tracing 43.085 ms [42.698 ms, 43.473 ms] 5.659 ms (15.1%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~fe7f3899a0, baseline=1.55.0-SNAPSHOT~fb3132475b
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.448 ms) : 4398, 4498
.   : milestone, 4448,
iast (9.917 ms) : 9742, 10093
.   : milestone, 9917,
iast_FULL (14.363 ms) : 14071, 14656
.   : milestone, 14363,
iast_GLOBAL (10.875 ms) : 10675, 11075
.   : milestone, 10875,
profiling (8.729 ms) : 8587, 8870
.   : milestone, 8729,
tracing (7.745 ms) : 7628, 7863
.   : milestone, 7745,
section candidate
no_agent (4.337 ms) : 4286, 4388
.   : milestone, 4337,
iast (9.477 ms) : 9320, 9634
.   : milestone, 9477,
iast_FULL (14.033 ms) : 13758, 14308
.   : milestone, 14033,
iast_GLOBAL (10.615 ms) : 10427, 10803
.   : milestone, 10615,
profiling (8.996 ms) : 8855, 9137
.   : milestone, 8996,
tracing (7.751 ms) : 7631, 7871
.   : milestone, 7751,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.448 ms [4.398 ms, 4.498 ms] -
iast 9.917 ms [9.742 ms, 10.093 ms] 5.469 ms (122.9%)
iast_FULL 14.363 ms [14.071 ms, 14.656 ms] 9.915 ms (222.9%)
iast_GLOBAL 10.875 ms [10.675 ms, 11.075 ms] 6.427 ms (144.5%)
profiling 8.729 ms [8.587 ms, 8.87 ms] 4.28 ms (96.2%)
tracing 7.745 ms [7.628 ms, 7.863 ms] 3.297 ms (74.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.337 ms [4.286 ms, 4.388 ms] -
iast 9.477 ms [9.32 ms, 9.634 ms] 5.14 ms (118.5%)
iast_FULL 14.033 ms [13.758 ms, 14.308 ms] 9.696 ms (223.6%)
iast_GLOBAL 10.615 ms [10.427 ms, 10.803 ms] 6.278 ms (144.8%)
profiling 8.996 ms [8.855 ms, 9.137 ms] 4.659 ms (107.4%)
tracing 7.751 ms [7.631 ms, 7.871 ms] 3.414 ms (78.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/disable-testenv
git_commit_date 1760967512 1761034905
git_commit_sha fb31324 fe7f389
release_version 1.55.0-SNAPSHOT~fb3132475b 1.55.0-SNAPSHOT~fe7f3899a0
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1761036795 1761036795
ci_job_id 1188402105 1188402105
ci_pipeline_id 79814315 79814315
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-7iv01ctr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-7iv01ctr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~fe7f3899a0, baseline=1.55.0-SNAPSHOT~fb3132475b
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.253 s) : 15253000, 15253000
.   : milestone, 15253000,
appsec (15.106 s) : 15106000, 15106000
.   : milestone, 15106000,
iast (18.59 s) : 18590000, 18590000
.   : milestone, 18590000,
iast_GLOBAL (17.917 s) : 17917000, 17917000
.   : milestone, 17917000,
profiling (15.577 s) : 15577000, 15577000
.   : milestone, 15577000,
tracing (15.118 s) : 15118000, 15118000
.   : milestone, 15118000,
section candidate
no_agent (15.402 s) : 15402000, 15402000
.   : milestone, 15402000,
appsec (14.829 s) : 14829000, 14829000
.   : milestone, 14829000,
iast (18.679 s) : 18679000, 18679000
.   : milestone, 18679000,
iast_GLOBAL (17.641 s) : 17641000, 17641000
.   : milestone, 17641000,
profiling (15.001 s) : 15001000, 15001000
.   : milestone, 15001000,
tracing (14.894 s) : 14894000, 14894000
.   : milestone, 14894000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.253 s [15.253 s, 15.253 s] -
appsec 15.106 s [15.106 s, 15.106 s] -147.0 ms (-1.0%)
iast 18.59 s [18.59 s, 18.59 s] 3.337 s (21.9%)
iast_GLOBAL 17.917 s [17.917 s, 17.917 s] 2.664 s (17.5%)
profiling 15.577 s [15.577 s, 15.577 s] 324.0 ms (2.1%)
tracing 15.118 s [15.118 s, 15.118 s] -135.0 ms (-0.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.402 s [15.402 s, 15.402 s] -
appsec 14.829 s [14.829 s, 14.829 s] -573.0 ms (-3.7%)
iast 18.679 s [18.679 s, 18.679 s] 3.277 s (21.3%)
iast_GLOBAL 17.641 s [17.641 s, 17.641 s] 2.239 s (14.5%)
profiling 15.001 s [15.001 s, 15.001 s] -401.0 ms (-2.6%)
tracing 14.894 s [14.894 s, 14.894 s] -508.0 ms (-3.3%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~fe7f3899a0, baseline=1.55.0-SNAPSHOT~fb3132475b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1462, 1485
.   : milestone, 1473,
appsec (3.685 ms) : 3467, 3904
.   : milestone, 3685,
iast (2.197 ms) : 2134, 2260
.   : milestone, 2197,
iast_GLOBAL (2.241 ms) : 2178, 2305
.   : milestone, 2241,
profiling (2.04 ms) : 1989, 2090
.   : milestone, 2040,
tracing (2.012 ms) : 1963, 2061
.   : milestone, 2012,
section candidate
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (3.685 ms) : 3466, 3904
.   : milestone, 3685,
iast (2.205 ms) : 2142, 2268
.   : milestone, 2205,
iast_GLOBAL (2.251 ms) : 2187, 2315
.   : milestone, 2251,
profiling (2.491 ms) : 2321, 2660
.   : milestone, 2491,
tracing (2.012 ms) : 1963, 2061
.   : milestone, 2012,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.462 ms, 1.485 ms] -
appsec 3.685 ms [3.467 ms, 3.904 ms] 2.212 ms (150.1%)
iast 2.197 ms [2.134 ms, 2.26 ms] 723.563 µs (49.1%)
iast_GLOBAL 2.241 ms [2.178 ms, 2.305 ms] 767.962 µs (52.1%)
profiling 2.04 ms [1.989 ms, 2.09 ms] 566.535 µs (38.5%)
tracing 2.012 ms [1.963 ms, 2.061 ms] 538.544 µs (36.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.461 ms, 1.484 ms] -
appsec 3.685 ms [3.466 ms, 3.904 ms] 2.213 ms (150.3%)
iast 2.205 ms [2.142 ms, 2.268 ms] 732.66 µs (49.8%)
iast_GLOBAL 2.251 ms [2.187 ms, 2.315 ms] 778.723 µs (52.9%)
profiling 2.491 ms [2.321 ms, 2.66 ms] 1.019 ms (69.2%)
tracing 2.012 ms [1.963 ms, 2.061 ms] 539.748 µs (36.7%)

@daniel-mohedano daniel-mohedano enabled auto-merge (squash) October 21, 2025 09:01
@daniel-mohedano daniel-mohedano merged commit 2e46666 into master Oct 21, 2025
539 of 542 checks passed
@daniel-mohedano daniel-mohedano deleted the daniel.mohedano/disable-testenv branch October 21, 2025 09:51
@github-actions github-actions bot added this to the 1.55.0 milestone Oct 21, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@bric3 bric3 bric3 approved these changes

@amarziali amarziali amarziali approved these changes

@randomanderson randomanderson Awaiting requested review from randomanderson randomanderson is a code owner automatically assigned from DataDog/apm-release-platform

Assignees

No one assigned

Labels

comp: ci visibility Continuous Integration Visibility tag: no release notes Changes to exclude from release notes type: bug Bug report and fix

Projects

None yet

Milestone

1.55.0

Development

Successfully merging this pull request may close these issues.

4 participants

@daniel-mohedano @bric3 @amarziali