Skip to content

Don't skip muzzle and test_published_artifacts for the nightly Gitlab build #8449

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Feb 28, 2025
Merged

Don't skip muzzle and test_published_artifacts for the nightly Gitlab build #8449

merged 1 commit into from
Feb 28, 2025

Conversation

randomanderson
Copy link
Contributor

What Does This Do

Don't skip muzzle and test_published_artifacts for the nightly Gitlab build

Motivation

Test should run nightly. Skipping them broke the pipeline because required was not also skipped

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@randomanderson randomanderson added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Feb 26, 2025
@randomanderson randomanderson requested a review from a team as a code owner February 26, 2025 02:56
@pr-commenter
Copy link

pr-commenter bot commented Feb 26, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master landerson/always-run-gitlab
git_commit_date 1740507766 1740538514
git_commit_sha 5a2c959 d18f83a
release_version 1.47.0-SNAPSHOT~5a2c959566 1.47.0-SNAPSHOT~d18f83ab18
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1740541028 1740541028
ci_job_id 823196149 823196149
ci_pipeline_id 56978174 56978174
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-2rtlzjgm-project-304-concurrent-0-cl1ksdg8 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-2rtlzjgm-project-304-concurrent-0-cl1ksdg8 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 4 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~d18f83ab18, baseline=1.47.0-SNAPSHOT~5a2c959566

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.044 s) : 0, 1043628
Total [baseline] (10.43 s) : 0, 10430000
Agent [candidate] (1.045 s) : 0, 1044623
Total [candidate] (10.444 s) : 0, 10444464
section appsec
Agent [baseline] (1.181 s) : 0, 1180645
Total [baseline] (10.74 s) : 0, 10740354
Agent [candidate] (1.189 s) : 0, 1188676
Total [candidate] (10.743 s) : 0, 10742500
section iast
Agent [baseline] (1.172 s) : 0, 1171735
Total [baseline] (10.969 s) : 0, 10969491
Agent [candidate] (1.171 s) : 0, 1170931
Total [candidate] (10.977 s) : 0, 10976645
section profiling
Agent [baseline] (1.264 s) : 0, 1263553
Total [baseline] (10.877 s) : 0, 10876689
Agent [candidate] (1.262 s) : 0, 1261834
Total [candidate] (10.856 s) : 0, 10856494
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.044 s -
Agent appsec 1.181 s 137.017 ms (13.1%)
Agent iast 1.172 s 128.107 ms (12.3%)
Agent profiling 1.264 s 219.925 ms (21.1%)
Total tracing 10.43 s -
Total appsec 10.74 s 310.354 ms (3.0%)
Total iast 10.969 s 539.491 ms (5.2%)
Total profiling 10.877 s 446.689 ms (4.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.045 s -
Agent appsec 1.189 s 144.053 ms (13.8%)
Agent iast 1.171 s 126.308 ms (12.1%)
Agent profiling 1.262 s 217.211 ms (20.8%)
Total tracing 10.444 s -
Total appsec 10.743 s 298.036 ms (2.9%)
Total iast 10.977 s 532.181 ms (5.1%)
Total profiling 10.856 s 412.03 ms (3.9%) 
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~d18f83ab18, baseline=1.47.0-SNAPSHOT~5a2c959566

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (720.067 ms) : 0, 720067
BytebuddyAgent [candidate] (721.329 ms) : 0, 721329
GlobalTracer [baseline] (239.97 ms) : 0, 239970
GlobalTracer [candidate] (239.971 ms) : 0, 239971
AppSec [baseline] (56.217 ms) : 0, 56217
AppSec [candidate] (56.066 ms) : 0, 56066
Remote Config [baseline] (715.46 µs) : 0, 715
Remote Config [candidate] (706.117 µs) : 0, 706
Telemetry [baseline] (11.645 ms) : 0, 11645
Telemetry [candidate] (11.595 ms) : 0, 11595
section appsec
BytebuddyAgent [baseline] (733.543 ms) : 0, 733543
BytebuddyAgent [candidate] (739.032 ms) : 0, 739032
GlobalTracer [baseline] (235.674 ms) : 0, 235674
GlobalTracer [candidate] (237.329 ms) : 0, 237329
AppSec [baseline] (176.758 ms) : 0, 176758
AppSec [candidate] (177.437 ms) : 0, 177437
Remote Config [baseline] (665.228 µs) : 0, 665
Remote Config [candidate] (666.601 µs) : 0, 667
Telemetry [baseline] (8.278 ms) : 0, 8278
Telemetry [candidate] (8.362 ms) : 0, 8362
IAST [baseline] (21.599 ms) : 0, 21599
IAST [candidate] (21.804 ms) : 0, 21804
section iast
BytebuddyAgent [baseline] (837.303 ms) : 0, 837303
BytebuddyAgent [candidate] (836.573 ms) : 0, 836573
GlobalTracer [baseline] (230.141 ms) : 0, 230141
GlobalTracer [candidate] (230.25 ms) : 0, 230250
AppSec [baseline] (57.17 ms) : 0, 57170
AppSec [candidate] (56.979 ms) : 0, 56979
Remote Config [baseline] (618.274 µs) : 0, 618
Remote Config [candidate] (619.91 µs) : 0, 620
Telemetry [baseline] (8.712 ms) : 0, 8712
Telemetry [candidate] (8.735 ms) : 0, 8735
IAST [baseline] (22.786 ms) : 0, 22786
IAST [candidate] (22.798 ms) : 0, 22798
section profiling
BytebuddyAgent [baseline] (710.145 ms) : 0, 710145
BytebuddyAgent [candidate] (709.963 ms) : 0, 709963
GlobalTracer [baseline] (350.782 ms) : 0, 350782
GlobalTracer [candidate] (350.525 ms) : 0, 350525
AppSec [baseline] (55.871 ms) : 0, 55871
AppSec [candidate] (54.872 ms) : 0, 54872
Remote Config [baseline] (690.875 µs) : 0, 691
Remote Config [candidate] (675.489 µs) : 0, 675
Telemetry [baseline] (9.018 ms) : 0, 9018
Telemetry [candidate] (9.056 ms) : 0, 9056
ProfilingAgent [baseline] (96.704 ms) : 0, 96704
ProfilingAgent [candidate] (96.342 ms) : 0, 96342
Profiling [baseline] (96.728 ms) : 0, 96728
Profiling [candidate] (96.366 ms) : 0, 96366
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~d18f83ab18, baseline=1.47.0-SNAPSHOT~5a2c959566

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.047 s) : 0, 1046599
Total [baseline] (8.697 s) : 0, 8697253
Agent [candidate] (1.041 s) : 0, 1040815
Total [candidate] (8.664 s) : 0, 8664475
section iast
Agent [baseline] (1.17 s) : 0, 1169721
Total [baseline] (9.21 s) : 0, 9210418
Agent [candidate] (1.176 s) : 0, 1176496
Total [candidate] (9.251 s) : 0, 9251026
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.17 s) : 0, 1170091
Total [baseline] (9.203 s) : 0, 9203267
Agent [candidate] (1.172 s) : 0, 1171532
Total [candidate] (9.201 s) : 0, 9200503
section iast_TELEMETRY_OFF
Agent [baseline] (1.166 s) : 0, 1165837
Total [baseline] (9.228 s) : 0, 9228334
Agent [candidate] (1.166 s) : 0, 1165741
Total [candidate] (9.243 s) : 0, 9243425
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.047 s -
Agent iast 1.17 s 123.122 ms (11.8%)
Agent iast_HARDCODED_SECRET_DISABLED 1.17 s 123.492 ms (11.8%)
Agent iast_TELEMETRY_OFF 1.166 s 119.238 ms (11.4%)
Total tracing 8.697 s -
Total iast 9.21 s 513.166 ms (5.9%)
Total iast_HARDCODED_SECRET_DISABLED 9.203 s 506.014 ms (5.8%)
Total iast_TELEMETRY_OFF 9.228 s 531.081 ms (6.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.041 s -
Agent iast 1.176 s 135.681 ms (13.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.172 s 130.716 ms (12.6%)
Agent iast_TELEMETRY_OFF 1.166 s 124.926 ms (12.0%)
Total tracing 8.664 s -
Total iast 9.251 s 586.552 ms (6.8%)
Total iast_HARDCODED_SECRET_DISABLED 9.201 s 536.029 ms (6.2%)
Total iast_TELEMETRY_OFF 9.243 s 578.951 ms (6.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~d18f83ab18, baseline=1.47.0-SNAPSHOT~5a2c959566

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (722.187 ms) : 0, 722187
BytebuddyAgent [candidate] (716.424 ms) : 0, 716424
GlobalTracer [baseline] (240.319 ms) : 0, 240319
GlobalTracer [candidate] (238.887 ms) : 0, 238887
AppSec [baseline] (56.837 ms) : 0, 56837
AppSec [candidate] (55.642 ms) : 0, 55642
Remote Config [baseline] (715.52 µs) : 0, 716
Remote Config [candidate] (702.81 µs) : 0, 703
Telemetry [baseline] (11.505 ms) : 0, 11505
Telemetry [candidate] (14.324 ms) : 0, 14324
section iast
BytebuddyAgent [baseline] (835.968 ms) : 0, 835968
BytebuddyAgent [candidate] (842.256 ms) : 0, 842256
GlobalTracer [baseline] (229.713 ms) : 0, 229713
GlobalTracer [candidate] (229.774 ms) : 0, 229774
AppSec [baseline] (56.855 ms) : 0, 56855
AppSec [candidate] (57.343 ms) : 0, 57343
Remote Config [baseline] (615.964 µs) : 0, 616
Remote Config [candidate] (620.204 µs) : 0, 620
Telemetry [baseline] (8.733 ms) : 0, 8733
Telemetry [candidate] (8.742 ms) : 0, 8742
IAST [baseline] (22.91 ms) : 0, 22910
IAST [candidate] (22.71 ms) : 0, 22710
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (834.832 ms) : 0, 834832
BytebuddyAgent [candidate] (836.518 ms) : 0, 836518
GlobalTracer [baseline] (230.527 ms) : 0, 230527
GlobalTracer [candidate] (229.897 ms) : 0, 229897
AppSec [baseline] (57.437 ms) : 0, 57437
AppSec [candidate] (57.486 ms) : 0, 57486
Remote Config [baseline] (624.997 µs) : 0, 625
Remote Config [candidate] (621.652 µs) : 0, 622
Telemetry [baseline] (8.835 ms) : 0, 8835
Telemetry [candidate] (8.809 ms) : 0, 8809
IAST [baseline] (22.91 ms) : 0, 22910
IAST [candidate] (23.172 ms) : 0, 23172
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (833.264 ms) : 0, 833264
BytebuddyAgent [candidate] (833.28 ms) : 0, 833280
GlobalTracer [baseline] (229.731 ms) : 0, 229731
GlobalTracer [candidate] (229.79 ms) : 0, 229790
AppSec [baseline] (53.501 ms) : 0, 53501
AppSec [candidate] (55.085 ms) : 0, 55085
Remote Config [baseline] (618.75 µs) : 0, 619
Remote Config [candidate] (609.732 µs) : 0, 610
Telemetry [baseline] (8.551 ms) : 0, 8551
Telemetry [candidate] (8.463 ms) : 0, 8463
IAST [baseline] (25.291 ms) : 0, 25291
IAST [candidate] (23.576 ms) : 0, 23576
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-02-26T03:07:23 2025-02-26T03:15:05
git_branch master landerson/always-run-gitlab
git_commit_date 1740507766 1740538514
git_commit_sha 5a2c959 d18f83a
release_version 1.47.0-SNAPSHOT~5a2c959566 1.47.0-SNAPSHOT~d18f83ab18
start_time 2025-02-26T03:07:09 2025-02-26T03:14:52
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1740540103 1740540103
ci_job_id 823196150 823196150
ci_pipeline_id 56978174 56978174
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-2rtlzjgm-project-304-concurrent-1-zvxmplty 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-2rtlzjgm-project-304-concurrent-1-zvxmplty 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~d18f83ab18, baseline=1.47.0-SNAPSHOT~5a2c959566
    dateFormat X
    axisFormat %s
section baseline
no_agent (379.157 µs) : 359, 399
.   : milestone, 379,
iast (507.654 µs) : 486, 529
.   : milestone, 508,
iast_FULL (727.888 µs) : 706, 750
.   : milestone, 728,
iast_GLOBAL (552.035 µs) : 530, 574
.   : milestone, 552,
iast_HARDCODED_SECRET_DISABLED (505.476 µs) : 484, 527
.   : milestone, 505,
iast_INACTIVE (462.589 µs) : 441, 484
.   : milestone, 463,
iast_TELEMETRY_OFF (498.506 µs) : 475, 522
.   : milestone, 499,
tracing (455.72 µs) : 435, 477
.   : milestone, 456,
section candidate
no_agent (375.994 µs) : 355, 397
.   : milestone, 376,
iast (504.012 µs) : 482, 526
.   : milestone, 504,
iast_FULL (724.054 µs) : 702, 746
.   : milestone, 724,
iast_GLOBAL (555.812 µs) : 534, 577
.   : milestone, 556,
iast_HARDCODED_SECRET_DISABLED (508.101 µs) : 486, 530
.   : milestone, 508,
iast_INACTIVE (463.611 µs) : 442, 485
.   : milestone, 464,
iast_TELEMETRY_OFF (496.539 µs) : 473, 520
.   : milestone, 497,
tracing (454.239 µs) : 433, 475
.   : milestone, 454,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 379.157 µs [359.431 µs, 398.884 µs] -
iast 507.654 µs [486.189 µs, 529.119 µs] 128.497 µs (33.9%)
iast_FULL 727.888 µs [705.676 µs, 750.101 µs] 348.731 µs (92.0%)
iast_GLOBAL 552.035 µs [530.264 µs, 573.805 µs] 172.877 µs (45.6%)
iast_HARDCODED_SECRET_DISABLED 505.476 µs [483.846 µs, 527.106 µs] 126.319 µs (33.3%)
iast_INACTIVE 462.589 µs [440.76 µs, 484.419 µs] 83.432 µs (22.0%)
iast_TELEMETRY_OFF 498.506 µs [474.774 µs, 522.238 µs] 119.349 µs (31.5%)
tracing 455.72 µs [434.705 µs, 476.736 µs] 76.563 µs (20.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 375.994 µs [355.171 µs, 396.816 µs] -
iast 504.012 µs [481.676 µs, 526.347 µs] 128.018 µs (34.0%)
iast_FULL 724.054 µs [702.364 µs, 745.744 µs] 348.061 µs (92.6%)
iast_GLOBAL 555.812 µs [534.152 µs, 577.471 µs] 179.818 µs (47.8%)
iast_HARDCODED_SECRET_DISABLED 508.101 µs [485.759 µs, 530.444 µs] 132.108 µs (35.1%)
iast_INACTIVE 463.611 µs [442.345 µs, 484.877 µs] 87.618 µs (23.3%)
iast_TELEMETRY_OFF 496.539 µs [473.229 µs, 519.849 µs] 120.546 µs (32.1%)
tracing 454.239 µs [433.167 µs, 475.31 µs] 78.245 µs (20.8%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~d18f83ab18, baseline=1.47.0-SNAPSHOT~5a2c959566
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.345 ms) : 1326, 1364
.   : milestone, 1345,
appsec (1.76 ms) : 1737, 1784
.   : milestone, 1760,
appsec_no_iast (1.766 ms) : 1742, 1790
.   : milestone, 1766,
code_origins (1.68 ms) : 1647, 1713
.   : milestone, 1680,
iast (1.519 ms) : 1495, 1542
.   : milestone, 1519,
profiling (1.49 ms) : 1466, 1513
.   : milestone, 1490,
tracing (1.488 ms) : 1463, 1513
.   : milestone, 1488,
section candidate
no_agent (1.352 ms) : 1332, 1371
.   : milestone, 1352,
appsec (1.769 ms) : 1746, 1793
.   : milestone, 1769,
appsec_no_iast (1.768 ms) : 1744, 1792
.   : milestone, 1768,
code_origins (1.705 ms) : 1673, 1738
.   : milestone, 1705,
iast (1.5 ms) : 1475, 1524
.   : milestone, 1500,
profiling (1.519 ms) : 1496, 1542
.   : milestone, 1519,
tracing (1.483 ms) : 1458, 1507
.   : milestone, 1483,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.345 ms [1.326 ms, 1.364 ms] -
appsec 1.76 ms [1.737 ms, 1.784 ms] 415.395 µs (30.9%)
appsec_no_iast 1.766 ms [1.742 ms, 1.79 ms] 421.346 µs (31.3%)
code_origins 1.68 ms [1.647 ms, 1.713 ms] 334.786 µs (24.9%)
iast 1.519 ms [1.495 ms, 1.542 ms] 173.613 µs (12.9%)
profiling 1.49 ms [1.466 ms, 1.513 ms] 144.787 µs (10.8%)
tracing 1.488 ms [1.463 ms, 1.513 ms] 143.082 µs (10.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.352 ms [1.332 ms, 1.371 ms] -
appsec 1.769 ms [1.746 ms, 1.793 ms] 417.729 µs (30.9%)
appsec_no_iast 1.768 ms [1.744 ms, 1.792 ms] 416.635 µs (30.8%)
code_origins 1.705 ms [1.673 ms, 1.738 ms] 353.731 µs (26.2%)
iast 1.5 ms [1.475 ms, 1.524 ms] 147.958 µs (10.9%)
profiling 1.519 ms [1.496 ms, 1.542 ms] 167.05 µs (12.4%)
tracing 1.483 ms [1.458 ms, 1.507 ms] 131.045 µs (9.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master landerson/always-run-gitlab
git_commit_date 1740507766 1740538514
git_commit_sha 5a2c959 d18f83a
release_version 1.47.0-SNAPSHOT~5a2c959566 1.47.0-SNAPSHOT~d18f83ab18
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1740540597 1740540597
ci_job_id 823196151 823196151
ci_pipeline_id 56978174 56978174
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-2rtlzjgm-project-304-concurrent-2-y757y52l 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-2rtlzjgm-project-304-concurrent-2-y757y52l 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~d18f83ab18, baseline=1.47.0-SNAPSHOT~5a2c959566
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.954 s) : 14954000, 14954000
.   : milestone, 14954000,
appsec (14.957 s) : 14957000, 14957000
.   : milestone, 14957000,
iast (19.043 s) : 19043000, 19043000
.   : milestone, 19043000,
iast_GLOBAL (17.761 s) : 17761000, 17761000
.   : milestone, 17761000,
profiling (15.615 s) : 15615000, 15615000
.   : milestone, 15615000,
tracing (15.01 s) : 15010000, 15010000
.   : milestone, 15010000,
section candidate
no_agent (14.972 s) : 14972000, 14972000
.   : milestone, 14972000,
appsec (15.107 s) : 15107000, 15107000
.   : milestone, 15107000,
iast (18.977 s) : 18977000, 18977000
.   : milestone, 18977000,
iast_GLOBAL (18.06 s) : 18060000, 18060000
.   : milestone, 18060000,
profiling (15.433 s) : 15433000, 15433000
.   : milestone, 15433000,
tracing (14.831 s) : 14831000, 14831000
.   : milestone, 14831000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.954 s [14.954 s, 14.954 s] -
appsec 14.957 s [14.957 s, 14.957 s] 3.0 ms (0.0%)
iast 19.043 s [19.043 s, 19.043 s] 4.089 s (27.3%)
iast_GLOBAL 17.761 s [17.761 s, 17.761 s] 2.807 s (18.8%)
profiling 15.615 s [15.615 s, 15.615 s] 661.0 ms (4.4%)
tracing 15.01 s [15.01 s, 15.01 s] 56.0 ms (0.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.972 s [14.972 s, 14.972 s] -
appsec 15.107 s [15.107 s, 15.107 s] 135.0 ms (0.9%)
iast 18.977 s [18.977 s, 18.977 s] 4.005 s (26.7%)
iast_GLOBAL 18.06 s [18.06 s, 18.06 s] 3.088 s (20.6%)
profiling 15.433 s [15.433 s, 15.433 s] 461.0 ms (3.1%)
tracing 14.831 s [14.831 s, 14.831 s] -141.0 ms (-0.9%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~d18f83ab18, baseline=1.47.0-SNAPSHOT~5a2c959566
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (2.37 ms) : 2326, 2413
.   : milestone, 2370,
iast (2.11 ms) : 2055, 2165
.   : milestone, 2110,
iast_GLOBAL (2.157 ms) : 2101, 2212
.   : milestone, 2157,
profiling (2.422 ms) : 2254, 2591
.   : milestone, 2422,
tracing (1.95 ms) : 1908, 1992
.   : milestone, 1950,
section candidate
no_agent (1.472 ms) : 1461, 1483
.   : milestone, 1472,
appsec (2.359 ms) : 2316, 2402
.   : milestone, 2359,
iast (2.112 ms) : 2058, 2167
.   : milestone, 2112,
iast_GLOBAL (2.15 ms) : 2094, 2205
.   : milestone, 2150,
profiling (1.973 ms) : 1929, 2017
.   : milestone, 1973,
tracing (1.957 ms) : 1914, 1999
.   : milestone, 1957,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 2.37 ms [2.326 ms, 2.413 ms] 899.665 µs (61.2%)
iast 2.11 ms [2.055 ms, 2.165 ms] 639.909 µs (43.5%)
iast_GLOBAL 2.157 ms [2.101 ms, 2.212 ms] 686.336 µs (46.7%)
profiling 2.422 ms [2.254 ms, 2.591 ms] 952.061 µs (64.8%)
tracing 1.95 ms [1.908 ms, 1.992 ms] 479.569 µs (32.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.461 ms, 1.483 ms] -
appsec 2.359 ms [2.316 ms, 2.402 ms] 887.395 µs (60.3%)
iast 2.112 ms [2.058 ms, 2.167 ms] 640.282 µs (43.5%)
iast_GLOBAL 2.15 ms [2.094 ms, 2.205 ms] 677.569 µs (46.0%)
profiling 1.973 ms [1.929 ms, 2.017 ms] 500.835 µs (34.0%)
tracing 1.957 ms [1.914 ms, 1.999 ms] 484.717 µs (32.9%)

@randomanderson randomanderson enabled auto-merge (squash) February 26, 2025 13:51
@randomanderson randomanderson merged commit 08e0fa3 into master Feb 28, 2025
218 checks passed
@randomanderson randomanderson deleted the landerson/always-run-gitlab branch February 28, 2025 12:09
@github-actions github-actions bot added this to the 1.47.0 milestone Feb 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@mcculls mcculls mcculls approved these changes

Assignees
No one assigned
Labels
comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.47.0
Development

Successfully merging this pull request may close these issues.
2 participants
@randomanderson @mcculls