Skip to content

Increase again Maven smoke tests timeout #8997

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jun 17, 2025

Conversation

bric3
Copy link
Contributor

@bric3 bric3 commented Jun 16, 2025

What Does This Do

Bumps the command timeout to 120s. Follow up to #8993.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@bric3 bric3 requested a review from a team as a code owner June 16, 2025 19:19
@bric3 bric3 requested a review from Mariovido June 16, 2025 19:19
Copy link
Contributor

github-actions bot commented Jun 16, 2025

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@bric3 bric3 force-pushed the increase-again-maven-smoke-test-timeout branch from ad9052e to ed8bcb6 Compare June 16, 2025 19:20
@pr-commenter
Copy link

pr-commenter bot commented Jun 16, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master increase-again-maven-smoke-test-timeout
git_commit_date 1750101616 1750101648
git_commit_sha 3e93f43 ed8bcb6
release_version 1.50.0-SNAPSHOT~3e93f43e63 1.50.0-SNAPSHOT~ed8bcb6aa6
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1750103820 1750103820
ci_job_id 984490156 984490156
ci_pipeline_id 67903361 67903361
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-z87jatgw-project-304-concurrent-0-6qebyjgm 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-z87jatgw-project-304-concurrent-0-6qebyjgm 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 13 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~ed8bcb6aa6, baseline=1.50.0-SNAPSHOT~3e93f43e63

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.039 s) : 0, 1038940
Total [baseline] (8.561 s) : 0, 8560933
Agent [candidate] (1.027 s) : 0, 1026617
Total [candidate] (8.548 s) : 0, 8548219
section iast
Agent [baseline] (1.172 s) : 0, 1171648
Total [baseline] (9.273 s) : 0, 9272878
Agent [candidate] (1.156 s) : 0, 1156433
Total [candidate] (9.233 s) : 0, 9232954
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.153 s) : 0, 1153383
Total [baseline] (9.175 s) : 0, 9175209
Agent [candidate] (1.153 s) : 0, 1153074
Total [candidate] (9.193 s) : 0, 9193422
section iast_TELEMETRY_OFF
Agent [baseline] (1.153 s) : 0, 1153142
Total [baseline] (9.244 s) : 0, 9243880
Agent [candidate] (1.16 s) : 0, 1160155
Total [candidate] (9.224 s) : 0, 9224050
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.039 s -
Agent iast 1.172 s 132.708 ms (12.8%)
Agent iast_HARDCODED_SECRET_DISABLED 1.153 s 114.444 ms (11.0%)
Agent iast_TELEMETRY_OFF 1.153 s 114.202 ms (11.0%)
Total tracing 8.561 s -
Total iast 9.273 s 711.946 ms (8.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.175 s 614.276 ms (7.2%)
Total iast_TELEMETRY_OFF 9.244 s 682.948 ms (8.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.027 s -
Agent iast 1.156 s 129.816 ms (12.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.153 s 126.457 ms (12.3%)
Agent iast_TELEMETRY_OFF 1.16 s 133.538 ms (13.0%)
Total tracing 8.548 s -
Total iast 9.233 s 684.734 ms (8.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.193 s 645.203 ms (7.5%)
Total iast_TELEMETRY_OFF 9.224 s 675.831 ms (7.9%)
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~ed8bcb6aa6, baseline=1.50.0-SNAPSHOT~3e93f43e63

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (692.677 ms) : 0, 692677
BytebuddyAgent [candidate] (684.464 ms) : 0, 684464
GlobalTracer [baseline] (242.363 ms) : 0, 242363
GlobalTracer [candidate] (241.559 ms) : 0, 241559
AppSec [baseline] (60.327 ms) : 0, 60327
AppSec [candidate] (60.475 ms) : 0, 60475
Debugger [baseline] (6.269 ms) : 0, 6269
Debugger [candidate] (6.127 ms) : 0, 6127
Remote Config [baseline] (766.446 µs) : 0, 766
Remote Config [candidate] (739.766 µs) : 0, 740
Telemetry [baseline] (12.755 ms) : 0, 12755
Telemetry [candidate] (9.824 ms) : 0, 9824
section iast
BytebuddyAgent [baseline] (816.694 ms) : 0, 816694
BytebuddyAgent [candidate] (804.934 ms) : 0, 804934
GlobalTracer [baseline] (234.052 ms) : 0, 234052
GlobalTracer [candidate] (231.379 ms) : 0, 231379
IAST [baseline] (29.801 ms) : 0, 29801
IAST [candidate] (26.269 ms) : 0, 26269
AppSec [baseline] (52.736 ms) : 0, 52736
AppSec [candidate] (55.795 ms) : 0, 55795
Debugger [baseline] (6.088 ms) : 0, 6088
Debugger [candidate] (6.046 ms) : 0, 6046
Remote Config [baseline] (611.141 µs) : 0, 611
Remote Config [candidate] (608.977 µs) : 0, 609
Telemetry [baseline] (8.027 ms) : 0, 8027
Telemetry [candidate] (8.003 ms) : 0, 8003
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (802.579 ms) : 0, 802579
BytebuddyAgent [candidate] (802.272 ms) : 0, 802272
GlobalTracer [baseline] (231.16 ms) : 0, 231160
GlobalTracer [candidate] (230.995 ms) : 0, 230995
IAST [baseline] (27.777 ms) : 0, 27777
IAST [candidate] (26.082 ms) : 0, 26082
AppSec [baseline] (53.879 ms) : 0, 53879
AppSec [candidate] (55.89 ms) : 0, 55890
Debugger [baseline] (5.988 ms) : 0, 5988
Debugger [candidate] (5.982 ms) : 0, 5982
Remote Config [baseline] (592.605 µs) : 0, 593
Remote Config [candidate] (588.543 µs) : 0, 589
Telemetry [baseline] (7.935 ms) : 0, 7935
Telemetry [candidate] (7.87 ms) : 0, 7870
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (801.414 ms) : 0, 801414
BytebuddyAgent [candidate] (808.103 ms) : 0, 808103
GlobalTracer [baseline] (232.095 ms) : 0, 232095
GlobalTracer [candidate] (232.947 ms) : 0, 232947
IAST [baseline] (29.759 ms) : 0, 29759
IAST [candidate] (28.168 ms) : 0, 28168
AppSec [baseline] (51.765 ms) : 0, 51765
AppSec [candidate] (52.228 ms) : 0, 52228
Debugger [baseline] (6.079 ms) : 0, 6079
Debugger [candidate] (6.068 ms) : 0, 6068
Remote Config [baseline] (605.398 µs) : 0, 605
Remote Config [candidate] (588.332 µs) : 0, 588
Telemetry [baseline] (7.967 ms) : 0, 7967
Telemetry [candidate] (7.769 ms) : 0, 7769
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~ed8bcb6aa6, baseline=1.50.0-SNAPSHOT~3e93f43e63

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.028 s) : 0, 1028407
Total [baseline] (10.684 s) : 0, 10684221
Agent [candidate] (1.027 s) : 0, 1026848
Total [candidate] (10.648 s) : 0, 10648249
section appsec
Agent [baseline] (1.182 s) : 0, 1182055
Total [baseline] (10.707 s) : 0, 10706649
Agent [candidate] (1.18 s) : 0, 1180499
Total [candidate] (10.707 s) : 0, 10707161
section iast
Agent [baseline] (1.166 s) : 0, 1165912
Total [baseline] (10.892 s) : 0, 10891665
Agent [candidate] (1.157 s) : 0, 1157326
Total [candidate] (10.911 s) : 0, 10910745
section profiling
Agent [baseline] (1.289 s) : 0, 1288548
Total [baseline] (11.172 s) : 0, 11171731
Agent [candidate] (1.269 s) : 0, 1269383
Total [candidate] (10.917 s) : 0, 10916833
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.028 s -
Agent appsec 1.182 s 153.647 ms (14.9%)
Agent iast 1.166 s 137.504 ms (13.4%)
Agent profiling 1.289 s 260.141 ms (25.3%)
Total tracing 10.684 s -
Total appsec 10.707 s 22.429 ms (0.2%)
Total iast 10.892 s 207.444 ms (1.9%)
Total profiling 11.172 s 487.51 ms (4.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.027 s -
Agent appsec 1.18 s 153.651 ms (15.0%)
Agent iast 1.157 s 130.478 ms (12.7%)
Agent profiling 1.269 s 242.534 ms (23.6%)
Total tracing 10.648 s -
Total appsec 10.707 s 58.912 ms (0.6%)
Total iast 10.911 s 262.495 ms (2.5%)
Total profiling 10.917 s 268.584 ms (2.5%)
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~ed8bcb6aa6, baseline=1.50.0-SNAPSHOT~3e93f43e63

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (684.895 ms) : 0, 684895
BytebuddyAgent [candidate] (684.912 ms) : 0, 684912
GlobalTracer [baseline] (242.483 ms) : 0, 242483
GlobalTracer [candidate] (241.471 ms) : 0, 241471
AppSec [baseline] (60.731 ms) : 0, 60731
AppSec [candidate] (59.675 ms) : 0, 59675
Debugger [baseline] (6.871 ms) : 0, 6871
Debugger [candidate] (6.81 ms) : 0, 6810
Remote Config [baseline] (747.699 µs) : 0, 748
Remote Config [candidate] (751.36 µs) : 0, 751
Telemetry [baseline] (9.035 ms) : 0, 9035
Telemetry [candidate] (9.695 ms) : 0, 9695
section appsec
BytebuddyAgent [baseline] (707.359 ms) : 0, 707359
BytebuddyAgent [candidate] (707.135 ms) : 0, 707135
GlobalTracer [baseline] (235.917 ms) : 0, 235917
GlobalTracer [candidate] (235.45 ms) : 0, 235450
IAST [baseline] (21.772 ms) : 0, 21772
IAST [candidate] (21.758 ms) : 0, 21758
AppSec [baseline] (179.62 ms) : 0, 179620
AppSec [candidate] (178.918 ms) : 0, 178918
Debugger [baseline] (5.904 ms) : 0, 5904
Debugger [candidate] (5.861 ms) : 0, 5861
Remote Config [baseline] (612.24 µs) : 0, 612
Remote Config [candidate] (611.191 µs) : 0, 611
Telemetry [baseline] (7.335 ms) : 0, 7335
Telemetry [candidate] (7.282 ms) : 0, 7282
section iast
BytebuddyAgent [baseline] (812.165 ms) : 0, 812165
BytebuddyAgent [candidate] (804.949 ms) : 0, 804949
GlobalTracer [baseline] (233.301 ms) : 0, 233301
GlobalTracer [candidate] (231.995 ms) : 0, 231995
IAST [baseline] (28.959 ms) : 0, 28959
IAST [candidate] (26.909 ms) : 0, 26909
AppSec [baseline] (53.339 ms) : 0, 53339
AppSec [candidate] (55.204 ms) : 0, 55204
Debugger [baseline] (5.995 ms) : 0, 5995
Debugger [candidate] (6.098 ms) : 0, 6098
Remote Config [baseline] (594.612 µs) : 0, 595
Remote Config [candidate] (607.771 µs) : 0, 608
Telemetry [baseline] (7.922 ms) : 0, 7922
Telemetry [candidate] (7.992 ms) : 0, 7992
section profiling
BytebuddyAgent [baseline] (684.684 ms) : 0, 684684
BytebuddyAgent [candidate] (674.662 ms) : 0, 674662
GlobalTracer [baseline] (364.703 ms) : 0, 364703
GlobalTracer [candidate] (359.762 ms) : 0, 359762
AppSec [baseline] (64.906 ms) : 0, 64906
AppSec [candidate] (64.54 ms) : 0, 64540
Debugger [baseline] (6.179 ms) : 0, 6179
Debugger [candidate] (6.194 ms) : 0, 6194
Remote Config [baseline] (656.865 µs) : 0, 657
Remote Config [candidate] (647.055 µs) : 0, 647
Telemetry [baseline] (8.226 ms) : 0, 8226
Telemetry [candidate] (8.182 ms) : 0, 8182
ProfilingAgent [baseline] (107.776 ms) : 0, 107776
ProfilingAgent [candidate] (104.536 ms) : 0, 104536
Profiling [baseline] (107.801 ms) : 0, 107801
Profiling [candidate] (104.56 ms) : 0, 104560
Loading

Load

Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~ed8bcb6aa6, baseline=1.50.0-SNAPSHOT~3e93f43e63
    dateFormat X
    axisFormat %s
section baseline
no_agent (12.484 ms) : 12370, 12599
.   : milestone, 12484,
appsec (73.323 ms) : 72326, 74319
.   : milestone, 73323,
code_origins (88.693 ms) : 86949, 90438
.   : milestone, 88693,
iast (81.615 ms) : 80383, 82847
.   : milestone, 81615,
profiling (64.228 ms) : 63343, 65113
.   : milestone, 64228,
tracing (53.829 ms) : 53021, 54637
.   : milestone, 53829,
section candidate
no_agent (12.22 ms) : 12111, 12329
.   : milestone, 12220,
appsec (64.948 ms) : 63736, 66160
.   : milestone, 64948,
code_origins (79.976 ms) : 77284, 82667
.   : milestone, 79976,
iast (73.637 ms) : 71995, 75278
.   : milestone, 73637,
profiling (56.732 ms) : 55740, 57724
.   : milestone, 56732,
tracing (48.263 ms) : 47470, 49056
.   : milestone, 48263,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 12.484 ms [12.37 ms, 12.599 ms] -
appsec 73.323 ms [72.326 ms, 74.319 ms] 60.839 ms (487.3%)
code_origins 88.693 ms [86.949 ms, 90.438 ms] 76.209 ms (610.4%)
iast 81.615 ms [80.383 ms, 82.847 ms] 69.131 ms (553.8%)
profiling 64.228 ms [63.343 ms, 65.113 ms] 51.744 ms (414.5%)
tracing 53.829 ms [53.021 ms, 54.637 ms] 41.345 ms (331.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 12.22 ms [12.111 ms, 12.329 ms] -
appsec 64.948 ms [63.736 ms, 66.16 ms] 52.729 ms (431.5%)
code_origins 79.976 ms [77.284 ms, 82.667 ms] 67.756 ms (554.5%)
iast 73.637 ms [71.995 ms, 75.278 ms] 61.417 ms (502.6%)
profiling 56.732 ms [55.74 ms, 57.724 ms] 44.513 ms (364.3%)
tracing 48.263 ms [47.47 ms, 49.056 ms] 36.043 ms (295.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master increase-again-maven-smoke-test-timeout
git_commit_date 1750101616 1750101648
git_commit_sha 3e93f43 ed8bcb6
release_version 1.50.0-SNAPSHOT~3e93f43e63 1.50.0-SNAPSHOT~ed8bcb6aa6
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1750103651 1750103651
ci_job_id 984490160 984490160
ci_pipeline_id 67903361 67903361
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-z87jatgw-project-304-concurrent-2-n7wn9sd8 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-z87jatgw-project-304-concurrent-2-n7wn9sd8 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~ed8bcb6aa6, baseline=1.50.0-SNAPSHOT~3e93f43e63
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.478 ms) : 1466, 1489
.   : milestone, 1478,
appsec (2.412 ms) : 2363, 2461
.   : milestone, 2412,
iast (2.202 ms) : 2141, 2263
.   : milestone, 2202,
iast_GLOBAL (2.243 ms) : 2181, 2304
.   : milestone, 2243,
profiling (2.062 ms) : 2011, 2113
.   : milestone, 2062,
tracing (2.023 ms) : 1975, 2070
.   : milestone, 2023,
section candidate
no_agent (1.484 ms) : 1473, 1496
.   : milestone, 1484,
appsec (2.416 ms) : 2367, 2464
.   : milestone, 2416,
iast (2.196 ms) : 2135, 2258
.   : milestone, 2196,
iast_GLOBAL (2.239 ms) : 2178, 2300
.   : milestone, 2239,
profiling (2.039 ms) : 1990, 2088
.   : milestone, 2039,
tracing (2.008 ms) : 1960, 2055
.   : milestone, 2008,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.466 ms, 1.489 ms] -
appsec 2.412 ms [2.363 ms, 2.461 ms] 934.644 µs (63.3%)
iast 2.202 ms [2.141 ms, 2.263 ms] 724.976 µs (49.1%)
iast_GLOBAL 2.243 ms [2.181 ms, 2.304 ms] 765.181 µs (51.8%)
profiling 2.062 ms [2.011 ms, 2.113 ms] 584.481 µs (39.6%)
tracing 2.023 ms [1.975 ms, 2.07 ms] 545.154 µs (36.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.484 ms [1.473 ms, 1.496 ms] -
appsec 2.416 ms [2.367 ms, 2.464 ms] 931.328 µs (62.7%)
iast 2.196 ms [2.135 ms, 2.258 ms] 712.072 µs (48.0%)
iast_GLOBAL 2.239 ms [2.178 ms, 2.3 ms] 754.544 µs (50.8%)
profiling 2.039 ms [1.99 ms, 2.088 ms] 554.763 µs (37.4%)
tracing 2.008 ms [1.96 ms, 2.055 ms] 523.146 µs (35.2%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~ed8bcb6aa6, baseline=1.50.0-SNAPSHOT~3e93f43e63
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.958 s) : 14958000, 14958000
.   : milestone, 14958000,
appsec (14.647 s) : 14647000, 14647000
.   : milestone, 14647000,
iast (18.743 s) : 18743000, 18743000
.   : milestone, 18743000,
iast_GLOBAL (17.93 s) : 17930000, 17930000
.   : milestone, 17930000,
profiling (15.616 s) : 15616000, 15616000
.   : milestone, 15616000,
tracing (14.943 s) : 14943000, 14943000
.   : milestone, 14943000,
section candidate
no_agent (15.513 s) : 15513000, 15513000
.   : milestone, 15513000,
appsec (14.83 s) : 14830000, 14830000
.   : milestone, 14830000,
iast (18.783 s) : 18783000, 18783000
.   : milestone, 18783000,
iast_GLOBAL (18.015 s) : 18015000, 18015000
.   : milestone, 18015000,
profiling (15.099 s) : 15099000, 15099000
.   : milestone, 15099000,
tracing (14.959 s) : 14959000, 14959000
.   : milestone, 14959000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.958 s [14.958 s, 14.958 s] -
appsec 14.647 s [14.647 s, 14.647 s] -311.0 ms (-2.1%)
iast 18.743 s [18.743 s, 18.743 s] 3.785 s (25.3%)
iast_GLOBAL 17.93 s [17.93 s, 17.93 s] 2.972 s (19.9%)
profiling 15.616 s [15.616 s, 15.616 s] 658.0 ms (4.4%)
tracing 14.943 s [14.943 s, 14.943 s] -15.0 ms (-0.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.513 s [15.513 s, 15.513 s] -
appsec 14.83 s [14.83 s, 14.83 s] -683.0 ms (-4.4%)
iast 18.783 s [18.783 s, 18.783 s] 3.27 s (21.1%)
iast_GLOBAL 18.015 s [18.015 s, 18.015 s] 2.502 s (16.1%)
profiling 15.099 s [15.099 s, 15.099 s] -414.0 ms (-2.7%)
tracing 14.959 s [14.959 s, 14.959 s] -554.0 ms (-3.6%)

@bric3 bric3 added the tag: no release notes Changes to exclude from release notes label Jun 17, 2025
@bric3 bric3 merged commit 5ee43c6 into master Jun 17, 2025
484 of 487 checks passed
@bric3 bric3 deleted the increase-again-maven-smoke-test-timeout branch June 17, 2025 06:39
@github-actions github-actions bot added this to the 1.50.0 milestone Jun 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
tag: no release notes Changes to exclude from release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants