Skip to content

Conversation

@github-actions
Copy link
Contributor

This PR updates the Gradle dependencies. ⚠️ Don't forget to squash commits before merging. ⚠️

  • Update PR title if a code change is needed to support one of those new dependencies

@github-actions github-actions bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Jan 26, 2025
@github-actions github-actions bot requested review from a team as code owners January 26, 2025 04:18
@pr-commenter
Copy link

pr-commenter bot commented Jan 26, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250126
git_commit_date 1737765352 1737865125
git_commit_sha f701ba9 e3686d4
release_version 1.46.0-SNAPSHOT~f701ba9d75 1.46.0-SNAPSHOT~e3686d43f6
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1737867796 1737867796
ci_job_id 780712806 780712806
ci_pipeline_id 54001941 54001941
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-kcmwffss-project-304-concurrent-2-bk5avgat 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-kcmwffss-project-304-concurrent-2-bk5avgat 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 7 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.46.0-SNAPSHOT~e3686d43f6, baseline=1.46.0-SNAPSHOT~f701ba9d75

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.049 s) : 0, 1049281
Total [baseline] (10.441 s) : 0, 10441308
Agent [candidate] (1.036 s) : 0, 1036401
Total [candidate] (10.426 s) : 0, 10425679
section appsec
Agent [baseline] (1.18 s) : 0, 1179700
Total [baseline] (10.693 s) : 0, 10693296
Agent [candidate] (1.177 s) : 0, 1177231
Total [candidate] (10.697 s) : 0, 10696785
section iast
Agent [baseline] (1.18 s) : 0, 1179627
Total [baseline] (11.037 s) : 0, 11036844
Agent [candidate] (1.178 s) : 0, 1177798
Total [candidate] (10.986 s) : 0, 10985894
section profiling
Agent [baseline] (1.251 s) : 0, 1250771
Total [baseline] (10.786 s) : 0, 10786077
Agent [candidate] (1.25 s) : 0, 1250276
Total [candidate] (10.806 s) : 0, 10806478
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent appsec 1.18 s 130.419 ms (12.4%)
Agent iast 1.18 s 130.345 ms (12.4%)
Agent profiling 1.251 s 201.49 ms (19.2%)
Total tracing 10.441 s -
Total appsec 10.693 s 251.987 ms (2.4%)
Total iast 11.037 s 595.535 ms (5.7%)
Total profiling 10.786 s 344.769 ms (3.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.036 s -
Agent appsec 1.177 s 140.83 ms (13.6%)
Agent iast 1.178 s 141.397 ms (13.6%)
Agent profiling 1.25 s 213.875 ms (20.6%)
Total tracing 10.426 s -
Total appsec 10.697 s 271.107 ms (2.6%)
Total iast 10.986 s 560.215 ms (5.4%)
Total profiling 10.806 s 380.799 ms (3.7%)
gantt
    title petclinic - break down per module: candidate=1.46.0-SNAPSHOT~e3686d43f6, baseline=1.46.0-SNAPSHOT~f701ba9d75

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (723.897 ms) : 0, 723897
BytebuddyAgent [candidate] (714.454 ms) : 0, 714454
GlobalTracer [baseline] (241.478 ms) : 0, 241478
GlobalTracer [candidate] (239.354 ms) : 0, 239354
AppSec [baseline] (55.735 ms) : 0, 55735
AppSec [candidate] (55.529 ms) : 0, 55529
Remote Config [baseline] (725.311 µs) : 0, 725
Remote Config [candidate] (710.68 µs) : 0, 711
Telemetry [baseline] (12.281 ms) : 0, 12281
Telemetry [candidate] (11.378 ms) : 0, 11378
section appsec
BytebuddyAgent [baseline] (733.004 ms) : 0, 733004
BytebuddyAgent [candidate] (731.205 ms) : 0, 731205
GlobalTracer [baseline] (236.438 ms) : 0, 236438
GlobalTracer [candidate] (235.995 ms) : 0, 235995
AppSec [baseline] (176.439 ms) : 0, 176439
AppSec [candidate] (175.803 ms) : 0, 175803
Remote Config [baseline] (656.757 µs) : 0, 657
Remote Config [candidate] (665.907 µs) : 0, 666
Telemetry [baseline] (8.206 ms) : 0, 8206
Telemetry [candidate] (8.507 ms) : 0, 8507
IAST [baseline] (20.023 ms) : 0, 20023
IAST [candidate] (20.06 ms) : 0, 20060
section iast
BytebuddyAgent [baseline] (842.447 ms) : 0, 842447
BytebuddyAgent [candidate] (841.359 ms) : 0, 841359
GlobalTracer [baseline] (231.753 ms) : 0, 231753
GlobalTracer [candidate] (232.14 ms) : 0, 232140
AppSec [baseline] (58.908 ms) : 0, 58908
AppSec [candidate] (58.346 ms) : 0, 58346
Remote Config [baseline] (680.049 µs) : 0, 680
Remote Config [candidate] (666.441 µs) : 0, 666
Telemetry [baseline] (8.922 ms) : 0, 8922
Telemetry [candidate] (8.741 ms) : 0, 8741
IAST [baseline] (21.781 ms) : 0, 21781
IAST [candidate] (21.41 ms) : 0, 21410
section profiling
ProfilingAgent [baseline] (94.905 ms) : 0, 94905
ProfilingAgent [candidate] (94.507 ms) : 0, 94507
BytebuddyAgent [baseline] (702.591 ms) : 0, 702591
BytebuddyAgent [candidate] (702.784 ms) : 0, 702784
GlobalTracer [baseline] (347.329 ms) : 0, 347329
GlobalTracer [candidate] (348.09 ms) : 0, 348090
AppSec [baseline] (54.682 ms) : 0, 54682
AppSec [candidate] (53.629 ms) : 0, 53629
Remote Config [baseline] (708.337 µs) : 0, 708
Remote Config [candidate] (713.546 µs) : 0, 714
Telemetry [baseline] (8.734 ms) : 0, 8734
Telemetry [candidate] (8.759 ms) : 0, 8759
Profiling [baseline] (94.929 ms) : 0, 94929
Profiling [candidate] (94.533 ms) : 0, 94533
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.46.0-SNAPSHOT~e3686d43f6, baseline=1.46.0-SNAPSHOT~f701ba9d75

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.048 s) : 0, 1048421
Total [baseline] (8.665 s) : 0, 8664963
Agent [candidate] (1.035 s) : 0, 1034716
Total [candidate] (8.623 s) : 0, 8622519
section iast
Agent [baseline] (1.173 s) : 0, 1172673
Total [baseline] (9.205 s) : 0, 9205086
Agent [candidate] (1.175 s) : 0, 1175214
Total [candidate] (9.237 s) : 0, 9236838
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.165 s) : 0, 1164626
Total [baseline] (9.168 s) : 0, 9167603
Agent [candidate] (1.174 s) : 0, 1174487
Total [candidate] (9.165 s) : 0, 9164665
section iast_TELEMETRY_OFF
Agent [baseline] (1.16 s) : 0, 1159849
Total [baseline] (9.203 s) : 0, 9203014
Agent [candidate] (1.165 s) : 0, 1165245
Total [candidate] (9.273 s) : 0, 9272710
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.048 s -
Agent iast 1.173 s 124.252 ms (11.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.165 s 116.204 ms (11.1%)
Agent iast_TELEMETRY_OFF 1.16 s 111.427 ms (10.6%)
Total tracing 8.665 s -
Total iast 9.205 s 540.123 ms (6.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.168 s 502.64 ms (5.8%)
Total iast_TELEMETRY_OFF 9.203 s 538.051 ms (6.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.035 s -
Agent iast 1.175 s 140.498 ms (13.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.174 s 139.771 ms (13.5%)
Agent iast_TELEMETRY_OFF 1.165 s 130.529 ms (12.6%)
Total tracing 8.623 s -
Total iast 9.237 s 614.318 ms (7.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.165 s 542.146 ms (6.3%)
Total iast_TELEMETRY_OFF 9.273 s 650.191 ms (7.5%)
gantt
    title insecure-bank - break down per module: candidate=1.46.0-SNAPSHOT~e3686d43f6, baseline=1.46.0-SNAPSHOT~f701ba9d75

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (722.591 ms) : 0, 722591
BytebuddyAgent [candidate] (713.669 ms) : 0, 713669
GlobalTracer [baseline] (240.849 ms) : 0, 240849
GlobalTracer [candidate] (238.747 ms) : 0, 238747
AppSec [baseline] (55.804 ms) : 0, 55804
AppSec [candidate] (55.186 ms) : 0, 55186
Remote Config [baseline] (730.933 µs) : 0, 731
Remote Config [candidate] (725.833 µs) : 0, 726
Telemetry [baseline] (13.088 ms) : 0, 13088
Telemetry [candidate] (11.38 ms) : 0, 11380
section iast
BytebuddyAgent [baseline] (837.598 ms) : 0, 837598
BytebuddyAgent [candidate] (839.573 ms) : 0, 839573
GlobalTracer [baseline] (230.681 ms) : 0, 230681
GlobalTracer [candidate] (231.121 ms) : 0, 231121
AppSec [baseline] (58.508 ms) : 0, 58508
AppSec [candidate] (58.595 ms) : 0, 58595
IAST [baseline] (21.346 ms) : 0, 21346
IAST [candidate] (21.276 ms) : 0, 21276
Remote Config [baseline] (664.239 µs) : 0, 664
Remote Config [candidate] (659.112 µs) : 0, 659
Telemetry [baseline] (8.792 ms) : 0, 8792
Telemetry [candidate] (8.874 ms) : 0, 8874
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (832.43 ms) : 0, 832430
BytebuddyAgent [candidate] (839.291 ms) : 0, 839291
GlobalTracer [baseline] (229.198 ms) : 0, 229198
GlobalTracer [candidate] (230.387 ms) : 0, 230387
AppSec [baseline] (57.758 ms) : 0, 57758
AppSec [candidate] (58.667 ms) : 0, 58667
IAST [baseline] (20.966 ms) : 0, 20966
IAST [candidate] (21.525 ms) : 0, 21525
Remote Config [baseline] (644.426 µs) : 0, 644
Remote Config [candidate] (664.171 µs) : 0, 664
Telemetry [baseline] (8.643 ms) : 0, 8643
Telemetry [candidate] (8.824 ms) : 0, 8824
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (828.501 ms) : 0, 828501
BytebuddyAgent [candidate] (830.839 ms) : 0, 830839
GlobalTracer [baseline] (228.802 ms) : 0, 228802
GlobalTracer [candidate] (229.979 ms) : 0, 229979
AppSec [baseline] (57.712 ms) : 0, 57712
AppSec [candidate] (58.468 ms) : 0, 58468
IAST [baseline] (20.778 ms) : 0, 20778
IAST [candidate] (21.124 ms) : 0, 21124
Remote Config [baseline] (635.267 µs) : 0, 635
Remote Config [candidate] (1.034 ms) : 0, 1034
Telemetry [baseline] (8.427 ms) : 0, 8427
Telemetry [candidate] (8.676 ms) : 0, 8676
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-01-26T04:33:20 2025-01-26T04:40:24
git_branch master ci/update-gradle-dependencies-20250126
git_commit_date 1737765352 1737865125
git_commit_sha f701ba9 e3686d4
release_version 1.46.0-SNAPSHOT~f701ba9d75 1.46.0-SNAPSHOT~e3686d43f6
start_time 2025-01-26T04:33:07 2025-01-26T04:40:10
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1737866782 1737866782
ci_job_id 780712807 780712807
ci_pipeline_id 54001941 54001941
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-kcmwffss-project-304-concurrent-3-f3ri304v 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-kcmwffss-project-304-concurrent-3-f3ri304v 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~e3686d43f6, baseline=1.46.0-SNAPSHOT~f701ba9d75
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.351 ms) : 1332, 1371
.   : milestone, 1351,
appsec (1.747 ms) : 1723, 1771
.   : milestone, 1747,
appsec_no_iast (1.766 ms) : 1741, 1790
.   : milestone, 1766,
iast (1.509 ms) : 1485, 1533
.   : milestone, 1509,
profiling (1.58 ms) : 1554, 1606
.   : milestone, 1580,
tracing (1.5 ms) : 1476, 1524
.   : milestone, 1500,
section candidate
no_agent (1.37 ms) : 1351, 1390
.   : milestone, 1370,
appsec (1.743 ms) : 1719, 1766
.   : milestone, 1743,
appsec_no_iast (1.759 ms) : 1736, 1782
.   : milestone, 1759,
iast (1.507 ms) : 1483, 1531
.   : milestone, 1507,
profiling (1.536 ms) : 1512, 1560
.   : milestone, 1536,
tracing (1.497 ms) : 1472, 1521
.   : milestone, 1497,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.351 ms [1.332 ms, 1.371 ms] -
appsec 1.747 ms [1.723 ms, 1.771 ms] 396.215 µs (29.3%)
appsec_no_iast 1.766 ms [1.741 ms, 1.79 ms] 414.64 µs (30.7%)
iast 1.509 ms [1.485 ms, 1.533 ms] 157.573 µs (11.7%)
profiling 1.58 ms [1.554 ms, 1.606 ms] 228.704 µs (16.9%)
tracing 1.5 ms [1.476 ms, 1.524 ms] 149.145 µs (11.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.37 ms [1.351 ms, 1.39 ms] -
appsec 1.743 ms [1.719 ms, 1.766 ms] 372.151 µs (27.2%)
appsec_no_iast 1.759 ms [1.736 ms, 1.782 ms] 388.342 µs (28.3%)
iast 1.507 ms [1.483 ms, 1.531 ms] 136.575 µs (10.0%)
profiling 1.536 ms [1.512 ms, 1.56 ms] 165.648 µs (12.1%)
tracing 1.497 ms [1.472 ms, 1.521 ms] 126.189 µs (9.2%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~e3686d43f6, baseline=1.46.0-SNAPSHOT~f701ba9d75
    dateFormat X
    axisFormat %s
section baseline
no_agent (374.706 µs) : 355, 395
.   : milestone, 375,
iast (503.038 µs) : 481, 525
.   : milestone, 503,
iast_FULL (740.227 µs) : 717, 763
.   : milestone, 740,
iast_GLOBAL (557.864 µs) : 533, 582
.   : milestone, 558,
iast_HARDCODED_SECRET_DISABLED (508.88 µs) : 487, 531
.   : milestone, 509,
iast_INACTIVE (456.588 µs) : 434, 479
.   : milestone, 457,
iast_TELEMETRY_OFF (486.901 µs) : 464, 510
.   : milestone, 487,
tracing (447.856 µs) : 427, 468
.   : milestone, 448,
section candidate
no_agent (379.609 µs) : 360, 399
.   : milestone, 380,
iast (512.836 µs) : 490, 536
.   : milestone, 513,
iast_FULL (742.871 µs) : 721, 765
.   : milestone, 743,
iast_GLOBAL (564.407 µs) : 540, 589
.   : milestone, 564,
iast_HARDCODED_SECRET_DISABLED (511.404 µs) : 488, 535
.   : milestone, 511,
iast_INACTIVE (456.304 µs) : 435, 478
.   : milestone, 456,
iast_TELEMETRY_OFF (497.853 µs) : 474, 521
.   : milestone, 498,
tracing (448.761 µs) : 428, 469
.   : milestone, 449,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 374.706 µs [354.547 µs, 394.865 µs] -
iast 503.038 µs [481.437 µs, 524.638 µs] 128.332 µs (34.2%)
iast_FULL 740.227 µs [717.213 µs, 763.241 µs] 365.521 µs (97.5%)
iast_GLOBAL 557.864 µs [533.323 µs, 582.405 µs] 183.158 µs (48.9%)
iast_HARDCODED_SECRET_DISABLED 508.88 µs [486.761 µs, 530.999 µs] 134.174 µs (35.8%)
iast_INACTIVE 456.588 µs [434.241 µs, 478.936 µs] 81.882 µs (21.9%)
iast_TELEMETRY_OFF 486.901 µs [464.046 µs, 509.756 µs] 112.195 µs (29.9%)
tracing 447.856 µs [427.216 µs, 468.495 µs] 73.149 µs (19.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 379.609 µs [360.193 µs, 399.026 µs] -
iast 512.836 µs [489.666 µs, 536.006 µs] 133.227 µs (35.1%)
iast_FULL 742.871 µs [721.009 µs, 764.733 µs] 363.261 µs (95.7%)
iast_GLOBAL 564.407 µs [539.656 µs, 589.159 µs] 184.798 µs (48.7%)
iast_HARDCODED_SECRET_DISABLED 511.404 µs [488.238 µs, 534.57 µs] 131.794 µs (34.7%)
iast_INACTIVE 456.304 µs [434.791 µs, 477.818 µs] 76.695 µs (20.2%)
iast_TELEMETRY_OFF 497.853 µs [474.492 µs, 521.215 µs] 118.244 µs (31.1%)
tracing 448.761 µs [428.243 µs, 469.278 µs] 69.151 µs (18.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250126
git_commit_date 1737765352 1737865125
git_commit_sha f701ba9 e3686d4
release_version 1.46.0-SNAPSHOT~f701ba9d75 1.46.0-SNAPSHOT~e3686d43f6
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1737867315 1737867315
ci_job_id 780712808 780712808
ci_pipeline_id 54001941 54001941
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-xugqgpm8-project-304-concurrent-0-ne5hmpin 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-xugqgpm8-project-304-concurrent-0-ne5hmpin 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~e3686d43f6, baseline=1.46.0-SNAPSHOT~f701ba9d75
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.469 ms) : 1457, 1480
.   : milestone, 1469,
appsec (2.362 ms) : 2319, 2405
.   : milestone, 2362,
iast (2.097 ms) : 2043, 2151
.   : milestone, 2097,
iast_GLOBAL (2.142 ms) : 2088, 2197
.   : milestone, 2142,
profiling (1.963 ms) : 1920, 2006
.   : milestone, 1963,
tracing (1.946 ms) : 1904, 1987
.   : milestone, 1946,
section candidate
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (2.37 ms) : 2327, 2413
.   : milestone, 2370,
iast (2.111 ms) : 2056, 2166
.   : milestone, 2111,
iast_GLOBAL (2.144 ms) : 2090, 2199
.   : milestone, 2144,
profiling (1.967 ms) : 1923, 2010
.   : milestone, 1967,
tracing (1.945 ms) : 1903, 1987
.   : milestone, 1945,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.457 ms, 1.48 ms] -
appsec 2.362 ms [2.319 ms, 2.405 ms] 893.322 µs (60.8%)
iast 2.097 ms [2.043 ms, 2.151 ms] 628.237 µs (42.8%)
iast_GLOBAL 2.142 ms [2.088 ms, 2.197 ms] 673.482 µs (45.9%)
profiling 1.963 ms [1.92 ms, 2.006 ms] 494.227 µs (33.7%)
tracing 1.946 ms [1.904 ms, 1.987 ms] 476.898 µs (32.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.459 ms, 1.482 ms] -
appsec 2.37 ms [2.327 ms, 2.413 ms] 899.108 µs (61.1%)
iast 2.111 ms [2.056 ms, 2.166 ms] 640.688 µs (43.6%)
iast_GLOBAL 2.144 ms [2.09 ms, 2.199 ms] 673.673 µs (45.8%)
profiling 1.967 ms [1.923 ms, 2.01 ms] 496.029 µs (33.7%)
tracing 1.945 ms [1.903 ms, 1.987 ms] 474.658 µs (32.3%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~e3686d43f6, baseline=1.46.0-SNAPSHOT~f701ba9d75
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.032 s) : 15032000, 15032000
.   : milestone, 15032000,
appsec (15.024 s) : 15024000, 15024000
.   : milestone, 15024000,
iast (18.646 s) : 18646000, 18646000
.   : milestone, 18646000,
iast_GLOBAL (18.225 s) : 18225000, 18225000
.   : milestone, 18225000,
profiling (14.964 s) : 14964000, 14964000
.   : milestone, 14964000,
tracing (14.895 s) : 14895000, 14895000
.   : milestone, 14895000,
section candidate
no_agent (14.971 s) : 14971000, 14971000
.   : milestone, 14971000,
appsec (14.731 s) : 14731000, 14731000
.   : milestone, 14731000,
iast (18.395 s) : 18395000, 18395000
.   : milestone, 18395000,
iast_GLOBAL (18.27 s) : 18270000, 18270000
.   : milestone, 18270000,
profiling (15.021 s) : 15021000, 15021000
.   : milestone, 15021000,
tracing (14.918 s) : 14918000, 14918000
.   : milestone, 14918000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.032 s [15.032 s, 15.032 s] -
appsec 15.024 s [15.024 s, 15.024 s] -8.0 ms (-0.1%)
iast 18.646 s [18.646 s, 18.646 s] 3.614 s (24.0%)
iast_GLOBAL 18.225 s [18.225 s, 18.225 s] 3.193 s (21.2%)
profiling 14.964 s [14.964 s, 14.964 s] -68.0 ms (-0.5%)
tracing 14.895 s [14.895 s, 14.895 s] -137.0 ms (-0.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.971 s [14.971 s, 14.971 s] -
appsec 14.731 s [14.731 s, 14.731 s] -240.0 ms (-1.6%)
iast 18.395 s [18.395 s, 18.395 s] 3.424 s (22.9%)
iast_GLOBAL 18.27 s [18.27 s, 18.27 s] 3.299 s (22.0%)
profiling 15.021 s [15.021 s, 15.021 s] 50.0 ms (0.3%)
tracing 14.918 s [14.918 s, 14.918 s] -53.0 ms (-0.4%)

@pr-commenter
Copy link

pr-commenter bot commented Jan 26, 2025

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250126
git_commit_date 1737765352 1737865127
git_commit_sha f701ba9 6a15104
See matching parameters
Baseline Candidate
ci_job_date 1737866396 1737866396
ci_job_id 780712882 780712882
ci_pipeline_id 54001942 54001942
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce unsure
[+735.558op/s; +7836.390op/s] or [+0.435%; +4.634%]
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Jan 26, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250126
git_commit_date 1737765352 1737865125
git_commit_sha f701ba9 e3686d4
See matching parameters
Baseline Candidate
ci_job_date 1737866473 1737866473
ci_job_id 780712811 780712811
ci_pipeline_id 54001941 54001941
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@amarziali amarziali closed this Feb 6, 2025
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD deleted the ci/update-gradle-dependencies-20250126 branch July 22, 2025 19:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants