Skip to content

exclude check-big-regression when merging backport PRs #9952

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Nov 14, 2025
Merged

exclude check-big-regression when merging backport PRs #9952

merged 1 commit into from
Nov 14, 2025

Conversation

@amarziali
Copy link
Contributor

@amarziali amarziali commented Nov 13, 2025

What Does This Do

Don't check for this when merging into another branch rather than master (i.e. patch releases) since we're backporting already tested commits

Also, that check can fail when comparing an old branch with master baseline

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@amarziali amarziali added the type: enhancement Enhancements and improvements label Nov 13, 2025
@amarziali amarziali requested a review from a team as a code owner November 13, 2025 15:29
@amarziali amarziali added the comp: testing Testing label Nov 13, 2025
@amarziali amarziali removed the request for review from a team November 13, 2025 15:29
@amarziali amarziali added the tag: no release notes Changes to exclude from release notes label Nov 13, 2025
@amarziali amarziali requested a review from pawelchcki November 13, 2025 15:29
@amarziali amarziali changed the title exclude check-big-regeression when not merging to master exclude check-big-regression when not merging to master Nov 13, 2025
@datadog-datadog-prod-us1
Copy link
Contributor

datadog-datadog-prod-us1 bot commented Nov 13, 2025 •
edited by datadog-official bot
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.60% (-0.07%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: d2eddc0 | Docs | Datadog PR Page | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Nov 13, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/shortcut
git_commit_date 1763072899 1763108975
git_commit_sha 7a4d8d0 2eddc04fcb
release_version 1.56.0-SNAPSHOT~7a4d8d030d 1.56.0-SNAPSHOT~d2eddc04fcb
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763110258 1763110258
ci_job_id 1234617130 1234617130
ci_pipeline_id 82377326 82377326
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-f825zhxf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-f825zhxf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 6 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~d2eddc04fcb, baseline=1.56.0-SNAPSHOT~7a4d8d030d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.101 s) : 0, 1101123
Total [baseline] (10.765 s) : 0, 10764788
Agent [candidate] (1.101 s) : 0, 1101335
Total [candidate] (10.79 s) : 0, 10790438
section appsec
Agent [baseline] (1.281 s) : 0, 1280849
Total [baseline] (10.976 s) : 0, 10976084
Agent [candidate] (1.286 s) : 0, 1285703
Total [candidate] (11.095 s) : 0, 11094616
section iast
Agent [baseline] (1.239 s) : 0, 1239356
Total [baseline] (11.256 s) : 0, 11255896
Agent [candidate] (1.237 s) : 0, 1236920
Total [candidate] (11.149 s) : 0, 11148876
section profiling
Agent [baseline] (1.23 s) : 0, 1230088
Total [baseline] (11.143 s) : 0, 11143137
Agent [candidate] (1.234 s) : 0, 1233971
Total [candidate] (11.076 s) : 0, 11076455
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.101 s -
Agent appsec 1.281 s 179.726 ms (16.3%)
Agent iast 1.239 s 138.233 ms (12.6%)
Agent profiling 1.23 s 128.965 ms (11.7%)
Total tracing 10.765 s -
Total appsec 10.976 s 211.295 ms (2.0%)
Total iast 11.256 s 491.108 ms (4.6%)
Total profiling 11.143 s 378.348 ms (3.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.101 s -
Agent appsec 1.286 s 184.368 ms (16.7%)
Agent iast 1.237 s 135.585 ms (12.3%)
Agent profiling 1.234 s 132.636 ms (12.0%)
Total tracing 10.79 s -
Total appsec 11.095 s 304.178 ms (2.8%)
Total iast 11.149 s 358.438 ms (3.3%)
Total profiling 11.076 s 286.017 ms (2.7%) 
gantt
    title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~d2eddc04fcb, baseline=1.56.0-SNAPSHOT~7a4d8d030d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.451 ms) : 0, 1451
crashtracking [candidate] (1.463 ms) : 0, 1463
BytebuddyAgent [baseline] (707.359 ms) : 0, 707359
BytebuddyAgent [candidate] (707.049 ms) : 0, 707049
GlobalTracer [baseline] (248.728 ms) : 0, 248728
GlobalTracer [candidate] (249.031 ms) : 0, 249031
AppSec [baseline] (32.226 ms) : 0, 32226
AppSec [candidate] (32.297 ms) : 0, 32297
Debugger [baseline] (64.176 ms) : 0, 64176
Debugger [candidate] (64.291 ms) : 0, 64291
Remote Config [baseline] (641.108 µs) : 0, 641
Remote Config [candidate] (640.186 µs) : 0, 640
Telemetry [baseline] (8.128 ms) : 0, 8128
Telemetry [candidate] (8.267 ms) : 0, 8267
Flare Poller [baseline] (3.648 ms) : 0, 3648
Flare Poller [candidate] (3.694 ms) : 0, 3694
section appsec
crashtracking [baseline] (1.46 ms) : 0, 1460
crashtracking [candidate] (1.461 ms) : 0, 1461
BytebuddyAgent [baseline] (732.469 ms) : 0, 732469
BytebuddyAgent [candidate] (732.271 ms) : 0, 732271
GlobalTracer [baseline] (240.279 ms) : 0, 240279
GlobalTracer [candidate] (242.916 ms) : 0, 242916
IAST [baseline] (24.79 ms) : 0, 24790
IAST [candidate] (25.099 ms) : 0, 25099
AppSec [baseline] (173.602 ms) : 0, 173602
AppSec [candidate] (174.765 ms) : 0, 174765
Debugger [baseline] (60.682 ms) : 0, 60682
Debugger [candidate] (61.328 ms) : 0, 61328
Remote Config [baseline] (691.964 µs) : 0, 692
Remote Config [candidate] (702.954 µs) : 0, 703
Telemetry [baseline] (8.222 ms) : 0, 8222
Telemetry [candidate] (8.335 ms) : 0, 8335
Flare Poller [baseline] (3.856 ms) : 0, 3856
Flare Poller [candidate] (3.876 ms) : 0, 3876
section iast
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.454 ms) : 0, 1454
BytebuddyAgent [baseline] (829.332 ms) : 0, 829332
BytebuddyAgent [candidate] (827.666 ms) : 0, 827666
GlobalTracer [baseline] (238.427 ms) : 0, 238427
GlobalTracer [candidate] (238.515 ms) : 0, 238515
IAST [baseline] (31.146 ms) : 0, 31146
IAST [candidate] (28.489 ms) : 0, 28489
AppSec [baseline] (31.123 ms) : 0, 31123
AppSec [candidate] (33.221 ms) : 0, 33221
Debugger [baseline] (61.418 ms) : 0, 61418
Debugger [candidate] (61.234 ms) : 0, 61234
Remote Config [baseline] (554.89 µs) : 0, 555
Remote Config [candidate] (545.803 µs) : 0, 546
Telemetry [baseline] (7.766 ms) : 0, 7766
Telemetry [candidate] (7.685 ms) : 0, 7685
Flare Poller [baseline] (3.529 ms) : 0, 3529
Flare Poller [candidate] (3.499 ms) : 0, 3499
section profiling
crashtracking [baseline] (1.435 ms) : 0, 1435
crashtracking [candidate] (1.441 ms) : 0, 1441
BytebuddyAgent [baseline] (731.177 ms) : 0, 731177
BytebuddyAgent [candidate] (734.131 ms) : 0, 734131
GlobalTracer [baseline] (222.38 ms) : 0, 222380
GlobalTracer [candidate] (222.113 ms) : 0, 222113
AppSec [baseline] (32.251 ms) : 0, 32251
AppSec [candidate] (32.488 ms) : 0, 32488
Debugger [baseline] (62.741 ms) : 0, 62741
Debugger [candidate] (63.262 ms) : 0, 63262
Remote Config [baseline] (644.067 µs) : 0, 644
Remote Config [candidate] (647.38 µs) : 0, 647
Telemetry [baseline] (7.971 ms) : 0, 7971
Telemetry [candidate] (7.949 ms) : 0, 7949
Flare Poller [baseline] (3.798 ms) : 0, 3798
Flare Poller [candidate] (3.726 ms) : 0, 3726
ProfilingAgent [baseline] (98.135 ms) : 0, 98135
ProfilingAgent [candidate] (98.207 ms) : 0, 98207
Profiling [baseline] (98.723 ms) : 0, 98723
Profiling [candidate] (98.791 ms) : 0, 98791
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~d2eddc04fcb, baseline=1.56.0-SNAPSHOT~7a4d8d030d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.105 s) : 0, 1104694
Total [baseline] (8.836 s) : 0, 8836190
Agent [candidate] (1.102 s) : 0, 1101947
Total [candidate] (8.837 s) : 0, 8837294
section iast
Agent [baseline] (1.24 s) : 0, 1239596
Total [baseline] (9.571 s) : 0, 9571100
Agent [candidate] (1.243 s) : 0, 1243176
Total [candidate] (9.554 s) : 0, 9554447
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.105 s -
Agent iast 1.24 s 134.902 ms (12.2%)
Total tracing 8.836 s -
Total iast 9.571 s 734.91 ms (8.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.102 s -
Agent iast 1.243 s 141.229 ms (12.8%)
Total tracing 8.837 s -
Total iast 9.554 s 717.153 ms (8.1%) 
gantt
    title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~d2eddc04fcb, baseline=1.56.0-SNAPSHOT~7a4d8d030d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.481 ms) : 0, 1481
crashtracking [candidate] (1.461 ms) : 0, 1461
BytebuddyAgent [baseline] (710.387 ms) : 0, 710387
BytebuddyAgent [candidate] (708.057 ms) : 0, 708057
GlobalTracer [baseline] (249.529 ms) : 0, 249529
GlobalTracer [candidate] (249.073 ms) : 0, 249073
AppSec [baseline] (32.526 ms) : 0, 32526
AppSec [candidate] (32.474 ms) : 0, 32474
Debugger [baseline] (63.467 ms) : 0, 63467
Debugger [candidate] (63.53 ms) : 0, 63530
Remote Config [baseline] (632.201 µs) : 0, 632
Remote Config [candidate] (638.475 µs) : 0, 638
Telemetry [baseline] (8.274 ms) : 0, 8274
Telemetry [candidate] (8.301 ms) : 0, 8301
Flare Poller [baseline] (3.645 ms) : 0, 3645
Flare Poller [candidate] (3.754 ms) : 0, 3754
section iast
crashtracking [baseline] (1.465 ms) : 0, 1465
crashtracking [candidate] (1.476 ms) : 0, 1476
BytebuddyAgent [baseline] (831.663 ms) : 0, 831663
BytebuddyAgent [candidate] (833.352 ms) : 0, 833352
GlobalTracer [baseline] (237.747 ms) : 0, 237747
GlobalTracer [candidate] (238.736 ms) : 0, 238736
IAST [baseline] (28.567 ms) : 0, 28567
IAST [candidate] (27.537 ms) : 0, 27537
AppSec [baseline] (33.172 ms) : 0, 33172
AppSec [candidate] (34.332 ms) : 0, 34332
Debugger [baseline] (60.478 ms) : 0, 60478
Debugger [candidate] (61.065 ms) : 0, 61065
Remote Config [baseline] (615.875 µs) : 0, 616
Remote Config [candidate] (545.629 µs) : 0, 546
Telemetry [baseline] (7.623 ms) : 0, 7623
Telemetry [candidate] (7.728 ms) : 0, 7728
Flare Poller [baseline] (3.517 ms) : 0, 3517
Flare Poller [candidate] (3.515 ms) : 0, 3515
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/shortcut
git_commit_date 1763072899 1763108972
git_commit_sha 7a4d8d0 2eddc04fcb
release_version 1.56.0-SNAPSHOT~7a4d8d030d 1.56.0-SNAPSHOT~d2eddc04fcb
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763110747 1763110747
ci_job_id 1234617131 1234617131
ci_pipeline_id 82377326 82377326
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-jt1os3jb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-jt1os3jb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 3 performance regressions! Performance is the same for 14 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load better
[-452.593µs; -203.418µs] or [-8.506%; -3.823%]		 better
[-989.957µs; -349.801µs] or [-7.783%; -2.750%]		 unstable
[-59.271op/s; +119.083op/s] or [-7.658%; +15.385%]		 4.993ms 12.050ms 803.906op/s 5.321ms 12.720ms 774.000op/s
scenario:load:petclinic:no_agent:high_load worse
[+0.398ms; +1.907ms] or [+2.266%; +10.862%]		 same
[-679.113µs; +2045.843µs] or [-2.275%; +6.853%]		 unstable
[-42.244op/s; +13.869op/s] or [-16.299%; +5.351%]		 18.708ms 30.538ms 245.000op/s 17.556ms 29.854ms 259.188op/s
scenario:load:petclinic:appsec:high_load worse
[+1.013ms; +2.024ms] or [+5.655%; +11.299%]		 worse
[+0.974ms; +2.425ms] or [+3.294%; +8.205%]		 unstable
[-43.817op/s; +7.630op/s] or [-17.173%; +2.990%]		 19.428ms 31.262ms 237.062op/s 17.910ms 29.562ms 255.156op/s
scenario:load:petclinic:profiling:high_load better
[-1.585ms; -0.873ms] or [-8.188%; -4.509%]		 better
[-2.409ms; -0.906ms] or [-7.707%; -2.899%]		 unstable
[-12.816op/s; +37.878op/s] or [-5.376%; +15.888%]		 18.126ms 29.597ms 250.938op/s 19.355ms 31.255ms 238.406op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~d2eddc04fcb, baseline=1.56.0-SNAPSHOT~7a4d8d030d
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.005 ms) : 17819, 18190
.   : milestone, 18005,
appsec (18.29 ms) : 18105, 18475
.   : milestone, 18290,
code_origins (17.591 ms) : 17420, 17762
.   : milestone, 17591,
iast (17.603 ms) : 17424, 17781
.   : milestone, 17603,
profiling (19.582 ms) : 19384, 19780
.   : milestone, 19582,
tracing (17.79 ms) : 17614, 17966
.   : milestone, 17790,
section candidate
no_agent (19.05 ms) : 18857, 19243
.   : milestone, 19050,
appsec (19.695 ms) : 19491, 19898
.   : milestone, 19695,
code_origins (17.667 ms) : 17491, 17843
.   : milestone, 17667,
iast (17.742 ms) : 17564, 17920
.   : milestone, 17742,
profiling (18.598 ms) : 18413, 18784
.   : milestone, 18598,
tracing (17.578 ms) : 17404, 17753
.   : milestone, 17578,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.005 ms [17.819 ms, 18.19 ms] -
appsec 18.29 ms [18.105 ms, 18.475 ms] 285.755 µs (1.6%)
code_origins 17.591 ms [17.42 ms, 17.762 ms] -413.991 µs (-2.3%)
iast 17.603 ms [17.424 ms, 17.781 ms] -401.9 µs (-2.2%)
profiling 19.582 ms [19.384 ms, 19.78 ms] 1.577 ms (8.8%)
tracing 17.79 ms [17.614 ms, 17.966 ms] -214.839 µs (-1.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.05 ms [18.857 ms, 19.243 ms] -
appsec 19.695 ms [19.491 ms, 19.898 ms] 644.739 µs (3.4%)
code_origins 17.667 ms [17.491 ms, 17.843 ms] -1.382 ms (-7.3%)
iast 17.742 ms [17.564 ms, 17.92 ms] -1.308 ms (-6.9%)
profiling 18.598 ms [18.413 ms, 18.784 ms] -451.499 µs (-2.4%)
tracing 17.578 ms [17.404 ms, 17.753 ms] -1.471 ms (-7.7%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~d2eddc04fcb, baseline=1.56.0-SNAPSHOT~7a4d8d030d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.188 ms) : 1176, 1199
.   : milestone, 1188,
iast (3.232 ms) : 3189, 3274
.   : milestone, 3232,
iast_FULL (5.975 ms) : 5915, 6036
.   : milestone, 5975,
iast_GLOBAL (3.597 ms) : 3540, 3655
.   : milestone, 3597,
profiling (1.993 ms) : 1977, 2010
.   : milestone, 1993,
tracing (1.822 ms) : 1808, 1837
.   : milestone, 1822,
section candidate
no_agent (1.186 ms) : 1174, 1197
.   : milestone, 1186,
iast (3.255 ms) : 3214, 3296
.   : milestone, 3255,
iast_FULL (5.75 ms) : 5637, 5862
.   : milestone, 5750,
iast_GLOBAL (3.536 ms) : 3451, 3621
.   : milestone, 3536,
profiling (1.943 ms) : 1926, 1960
.   : milestone, 1943,
tracing (1.839 ms) : 1823, 1854
.   : milestone, 1839,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.188 ms [1.176 ms, 1.199 ms] -
iast 3.232 ms [3.189 ms, 3.274 ms] 2.044 ms (172.0%)
iast_FULL 5.975 ms [5.915 ms, 6.036 ms] 4.787 ms (403.0%)
iast_GLOBAL 3.597 ms [3.54 ms, 3.655 ms] 2.409 ms (202.8%)
profiling 1.993 ms [1.977 ms, 2.01 ms] 805.444 µs (67.8%)
tracing 1.822 ms [1.808 ms, 1.837 ms] 634.371 µs (53.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.186 ms [1.174 ms, 1.197 ms] -
iast 3.255 ms [3.214 ms, 3.296 ms] 2.069 ms (174.5%)
iast_FULL 5.75 ms [5.637 ms, 5.862 ms] 4.564 ms (385.0%)
iast_GLOBAL 3.536 ms [3.451 ms, 3.621 ms] 2.351 ms (198.3%)
profiling 1.943 ms [1.926 ms, 1.96 ms] 757.131 µs (63.9%)
tracing 1.839 ms [1.823 ms, 1.854 ms] 653.083 µs (55.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/shortcut
git_commit_date 1763072899 1763108973
git_commit_sha 7a4d8d0 2eddc04fcb
release_version 1.56.0-SNAPSHOT~7a4d8d030d 1.56.0-SNAPSHOT~d2eddc04fcb
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1763110448 1763110448
ci_job_id 1234617132 1234617132
ci_pipeline_id 82377326 82377326
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-t3zhxbod 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-t3zhxbod 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~d2eddc04fcb, baseline=1.56.0-SNAPSHOT~7a4d8d030d
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.851 s) : 14851000, 14851000
.   : milestone, 14851000,
appsec (14.644 s) : 14644000, 14644000
.   : milestone, 14644000,
iast (18.043 s) : 18043000, 18043000
.   : milestone, 18043000,
iast_GLOBAL (17.742 s) : 17742000, 17742000
.   : milestone, 17742000,
profiling (14.863 s) : 14863000, 14863000
.   : milestone, 14863000,
tracing (14.732 s) : 14732000, 14732000
.   : milestone, 14732000,
section candidate
no_agent (15.377 s) : 15377000, 15377000
.   : milestone, 15377000,
appsec (14.85 s) : 14850000, 14850000
.   : milestone, 14850000,
iast (18.366 s) : 18366000, 18366000
.   : milestone, 18366000,
iast_GLOBAL (17.856 s) : 17856000, 17856000
.   : milestone, 17856000,
profiling (14.946 s) : 14946000, 14946000
.   : milestone, 14946000,
tracing (15.019 s) : 15019000, 15019000
.   : milestone, 15019000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.851 s [14.851 s, 14.851 s] -
appsec 14.644 s [14.644 s, 14.644 s] -207.0 ms (-1.4%)
iast 18.043 s [18.043 s, 18.043 s] 3.192 s (21.5%)
iast_GLOBAL 17.742 s [17.742 s, 17.742 s] 2.891 s (19.5%)
profiling 14.863 s [14.863 s, 14.863 s] 12.0 ms (0.1%)
tracing 14.732 s [14.732 s, 14.732 s] -119.0 ms (-0.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.377 s [15.377 s, 15.377 s] -
appsec 14.85 s [14.85 s, 14.85 s] -527.0 ms (-3.4%)
iast 18.366 s [18.366 s, 18.366 s] 2.989 s (19.4%)
iast_GLOBAL 17.856 s [17.856 s, 17.856 s] 2.479 s (16.1%)
profiling 14.946 s [14.946 s, 14.946 s] -431.0 ms (-2.8%)
tracing 15.019 s [15.019 s, 15.019 s] -358.0 ms (-2.3%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~d2eddc04fcb, baseline=1.56.0-SNAPSHOT~7a4d8d030d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.469 ms) : 1458, 1481
.   : milestone, 1469,
appsec (3.709 ms) : 3491, 3927
.   : milestone, 3709,
iast (2.22 ms) : 2155, 2285
.   : milestone, 2220,
iast_GLOBAL (2.262 ms) : 2196, 2327
.   : milestone, 2262,
profiling (2.055 ms) : 2003, 2108
.   : milestone, 2055,
tracing (2.034 ms) : 1983, 2085
.   : milestone, 2034,
section candidate
no_agent (1.469 ms) : 1458, 1481
.   : milestone, 1469,
appsec (3.708 ms) : 3484, 3932
.   : milestone, 3708,
iast (2.204 ms) : 2140, 2269
.   : milestone, 2204,
iast_GLOBAL (2.249 ms) : 2184, 2315
.   : milestone, 2249,
profiling (2.089 ms) : 2034, 2143
.   : milestone, 2089,
tracing (2.042 ms) : 1991, 2093
.   : milestone, 2042,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.458 ms, 1.481 ms] -
appsec 3.709 ms [3.491 ms, 3.927 ms] 2.24 ms (152.5%)
iast 2.22 ms [2.155 ms, 2.285 ms] 750.926 µs (51.1%)
iast_GLOBAL 2.262 ms [2.196 ms, 2.327 ms] 792.509 µs (53.9%)
profiling 2.055 ms [2.003 ms, 2.108 ms] 586.029 µs (39.9%)
tracing 2.034 ms [1.983 ms, 2.085 ms] 564.878 µs (38.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.458 ms, 1.481 ms] -
appsec 3.708 ms [3.484 ms, 3.932 ms] 2.239 ms (152.4%)
iast 2.204 ms [2.14 ms, 2.269 ms] 734.958 µs (50.0%)
iast_GLOBAL 2.249 ms [2.184 ms, 2.315 ms] 780.125 µs (53.1%)
profiling 2.089 ms [2.034 ms, 2.143 ms] 619.472 µs (42.2%)
tracing 2.042 ms [1.991 ms, 2.093 ms] 572.69 µs (39.0%)

@amarziali amarziali force-pushed the andrea.marziali/shortcut branch from 0f56010 to d2eddc0 Compare November 14, 2025 08:16
@amarziali amarziali enabled auto-merge (squash) November 14, 2025 08:56
@amarziali amarziali merged commit 8ceb94d into master Nov 14, 2025
540 checks passed
@amarziali amarziali deleted the andrea.marziali/shortcut branch November 14, 2025 09:10
@github-actions github-actions bot added this to the 1.56.0 milestone Nov 14, 2025
@amarziali amarziali changed the title exclude check-big-regression when not merging to master exclude check-big-regression when merging backport PRs Nov 14, 2025
@amarziali amarziali mentioned this pull request Nov 14, 2025
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@bric3 bric3 bric3 approved these changes

@pawelchcki pawelchcki pawelchcki approved these changes

@sarahchen6 sarahchen6 sarahchen6 approved these changes

Assignees

No one assigned

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.56.0

Development

Successfully merging this pull request may close these issues.

5 participants

@amarziali @bric3 @pawelchcki @sarahchen6