Re-Update test source file reporting to match codeowners file #9002

sarahchen6 · 2025-06-17T21:31:00Z

What Does This Do

Fix our test source file retrieval script

Motivation

Adjust change in #8936 that did not actually resolve missing codeowners

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2025-06-17T22:08:07Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/fix-codeowner-retrieval-again
git_commit_date	1750176286	1750195705
git_commit_sha	`72f45a8`	`326d5bc`
release_version	1.50.0-SNAPSHOT~72f45a8563	1.50.0-SNAPSHOT~326d5bc135

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1750197825	1750197825
ci_job_id	987103261	987103261
ci_pipeline_id	68052311	68052311
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-clrnfvyp-project-304-concurrent-0-vvu9rsow 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-clrnfvyp-project-304-concurrent-0-vvu9rsow 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 45 metrics, 8 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~326d5bc135, baseline=1.50.0-SNAPSHOT~72f45a8563

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.023 s) : 0, 1022953
Total [baseline] (8.497 s) : 0, 8497428
Agent [candidate] (1.032 s) : 0, 1032380
Total [candidate] (8.577 s) : 0, 8577366
section iast
Agent [baseline] (1.151 s) : 0, 1150646
Total [baseline] (9.175 s) : 0, 9175076
Agent [candidate] (1.152 s) : 0, 1152133
Total [candidate] (9.203 s) : 0, 9203021

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.023 s	-
Agent	iast	1.151 s	127.693 ms (12.5%)
Total	tracing	8.497 s	-
Total	iast	9.175 s	677.649 ms (8.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.032 s	-
Agent	iast	1.152 s	119.752 ms (11.6%)
Total	tracing	8.577 s	-
Total	iast	9.203 s	625.655 ms (7.3%)

gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~326d5bc135, baseline=1.50.0-SNAPSHOT~72f45a8563

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.805 ms) : 0, 682805
BytebuddyAgent [candidate] (688.615 ms) : 0, 688615
GlobalTracer [baseline] (239.462 ms) : 0, 239462
GlobalTracer [candidate] (241.916 ms) : 0, 241916
AppSec [baseline] (59.09 ms) : 0, 59090
AppSec [candidate] (60.822 ms) : 0, 60822
Debugger [baseline] (6.104 ms) : 0, 6104
Debugger [candidate] (6.184 ms) : 0, 6184
Remote Config [baseline] (726.185 µs) : 0, 726
Remote Config [candidate] (741.998 µs) : 0, 742
Telemetry [baseline] (11.427 ms) : 0, 11427
Telemetry [candidate] (10.541 ms) : 0, 10541
section iast
BytebuddyAgent [baseline] (801.421 ms) : 0, 801421
BytebuddyAgent [candidate] (802.271 ms) : 0, 802271
GlobalTracer [baseline] (229.89 ms) : 0, 229890
GlobalTracer [candidate] (230.376 ms) : 0, 230376
AppSec [baseline] (55.569 ms) : 0, 55569
AppSec [candidate] (55.431 ms) : 0, 55431
Debugger [baseline] (5.972 ms) : 0, 5972
Debugger [candidate] (6.004 ms) : 0, 6004
Remote Config [baseline] (593.802 µs) : 0, 594
Remote Config [candidate] (590.421 µs) : 0, 590
Telemetry [baseline] (7.885 ms) : 0, 7885
Telemetry [candidate] (7.932 ms) : 0, 7932
IAST [baseline] (25.972 ms) : 0, 25972
IAST [candidate] (26.15 ms) : 0, 26150

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~326d5bc135, baseline=1.50.0-SNAPSHOT~72f45a8563

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.026 s) : 0, 1025996
Total [baseline] (10.457 s) : 0, 10456860
Agent [candidate] (1.025 s) : 0, 1024787
Total [candidate] (10.594 s) : 0, 10594014
section appsec
Agent [baseline] (1.175 s) : 0, 1175158
Total [baseline] (10.668 s) : 0, 10667894
Agent [candidate] (1.175 s) : 0, 1175169
Total [candidate] (10.68 s) : 0, 10679515
section iast
Agent [baseline] (1.153 s) : 0, 1152680
Total [baseline] (10.812 s) : 0, 10812041
Agent [candidate] (1.153 s) : 0, 1153379
Total [candidate] (10.885 s) : 0, 10885243
section profiling
Agent [baseline] (1.276 s) : 0, 1275998
Total [baseline] (10.924 s) : 0, 10923748
Agent [candidate] (1.271 s) : 0, 1271362
Total [candidate] (10.949 s) : 0, 10948746

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.026 s	-
Agent	appsec	1.175 s	149.162 ms (14.5%)
Agent	iast	1.153 s	126.684 ms (12.3%)
Agent	profiling	1.276 s	250.002 ms (24.4%)
Total	tracing	10.457 s	-
Total	appsec	10.668 s	211.034 ms (2.0%)
Total	iast	10.812 s	355.181 ms (3.4%)
Total	profiling	10.924 s	466.888 ms (4.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.025 s	-
Agent	appsec	1.175 s	150.382 ms (14.7%)
Agent	iast	1.153 s	128.592 ms (12.5%)
Agent	profiling	1.271 s	246.576 ms (24.1%)
Total	tracing	10.594 s	-
Total	appsec	10.68 s	85.501 ms (0.8%)
Total	iast	10.885 s	291.229 ms (2.7%)
Total	profiling	10.949 s	354.731 ms (3.3%)

gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~326d5bc135, baseline=1.50.0-SNAPSHOT~72f45a8563

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.404 ms) : 0, 682404
BytebuddyAgent [candidate] (682.673 ms) : 0, 682673
GlobalTracer [baseline] (240.273 ms) : 0, 240273
GlobalTracer [candidate] (240.945 ms) : 0, 240945
AppSec [baseline] (61.247 ms) : 0, 61247
AppSec [candidate] (59.006 ms) : 0, 59006
Debugger [baseline] (7.512 ms) : 0, 7512
Debugger [candidate] (6.837 ms) : 0, 6837
Remote Config [baseline] (728.91 µs) : 0, 729
Remote Config [candidate] (732.099 µs) : 0, 732
Telemetry [baseline] (10.34 ms) : 0, 10340
Telemetry [candidate] (11.275 ms) : 0, 11275
section appsec
BytebuddyAgent [baseline] (703.838 ms) : 0, 703838
BytebuddyAgent [candidate] (704.092 ms) : 0, 704092
GlobalTracer [baseline] (233.908 ms) : 0, 233908
GlobalTracer [candidate] (233.951 ms) : 0, 233951
IAST [baseline] (21.803 ms) : 0, 21803
IAST [candidate] (21.748 ms) : 0, 21748
AppSec [baseline] (178.505 ms) : 0, 178505
AppSec [candidate] (178.351 ms) : 0, 178351
Debugger [baseline] (5.844 ms) : 0, 5844
Debugger [candidate] (5.838 ms) : 0, 5838
Remote Config [baseline] (602.025 µs) : 0, 602
Remote Config [candidate] (602.331 µs) : 0, 602
Telemetry [baseline] (7.241 ms) : 0, 7241
Telemetry [candidate] (7.239 ms) : 0, 7239
section iast
BytebuddyAgent [baseline] (802.476 ms) : 0, 802476
BytebuddyAgent [candidate] (803.285 ms) : 0, 803285
GlobalTracer [baseline] (230.41 ms) : 0, 230410
GlobalTracer [candidate] (230.641 ms) : 0, 230641
IAST [baseline] (27.625 ms) : 0, 27625
IAST [candidate] (27.515 ms) : 0, 27515
AppSec [baseline] (54.227 ms) : 0, 54227
AppSec [candidate] (53.995 ms) : 0, 53995
Debugger [baseline] (6.041 ms) : 0, 6041
Debugger [candidate] (5.986 ms) : 0, 5986
Remote Config [baseline] (583.17 µs) : 0, 583
Remote Config [candidate] (586.292 µs) : 0, 586
Telemetry [baseline] (7.877 ms) : 0, 7877
Telemetry [candidate] (7.879 ms) : 0, 7879
section profiling
BytebuddyAgent [baseline] (677.688 ms) : 0, 677688
BytebuddyAgent [candidate] (673.436 ms) : 0, 673436
GlobalTracer [baseline] (361.21 ms) : 0, 361210
GlobalTracer [candidate] (360.51 ms) : 0, 360510
AppSec [baseline] (64.683 ms) : 0, 64683
AppSec [candidate] (64.827 ms) : 0, 64827
Debugger [baseline] (6.149 ms) : 0, 6149
Debugger [candidate] (6.185 ms) : 0, 6185
Remote Config [baseline] (665.982 µs) : 0, 666
Remote Config [candidate] (642.992 µs) : 0, 643
Telemetry [baseline] (8.137 ms) : 0, 8137
Telemetry [candidate] (8.205 ms) : 0, 8205
ProfilingAgent [baseline] (106.626 ms) : 0, 106626
ProfilingAgent [candidate] (107.033 ms) : 0, 107033
Profiling [baseline] (106.652 ms) : 0, 106652
Profiling [candidate] (107.059 ms) : 0, 107059

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-06-17T21:48:06	2025-06-17T21:51:29
git_branch	master	sarahchen6/fix-codeowner-retrieval-again
git_commit_date	1750176286	1750195705
git_commit_sha	`72f45a8`	`326d5bc`
release_version	1.50.0-SNAPSHOT~72f45a8563	1.50.0-SNAPSHOT~326d5bc135
start_time	2025-06-17T21:47:33	2025-06-17T21:49:19

See matching parameters

	Baseline	Candidate
application	petclinic	petclinic
ci_job_date	1750197251	1750197251
ci_job_id	987103262	987103262
ci_pipeline_id	68052311	68052311
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-2oizdj4a-project-304-concurrent-0-clxyf83w 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-2oizdj4a-project-304-concurrent-0-clxyf83w 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
thresholds_or_results	results	results
variant	appsec	appsec

Summary

Found 5 performance improvements and 0 performance regressions! Performance is the same for 0 metrics, 5 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:petclinic:appsec	better [-61.555ms; -60.118ms] or [-89.392%; -87.306%]	unstable [+525.629op/s; +556.334op/s] or [+754.066%; +798.116%]	8.023ms	610.687op/s	68.859ms	69.706op/s
scenario:load:petclinic:code_origins	better [-62.340ms; -59.682ms] or [-72.409%; -69.322%]	unstable [+115.353op/s; +159.981op/s] or [+214.943%; +298.101%]	25.083ms	191.333op/s	86.094ms	53.667op/s
scenario:load:petclinic:iast	better [-67.762ms; -66.010ms] or [-88.036%; -85.760%]	unstable [+404.110op/s; +445.325op/s] or [+647.251%; +713.265%]	10.084ms	487.152op/s	76.971ms	62.435op/s
scenario:load:petclinic:no_agent	better [-12.215ms; -12.017ms] or [-96.566%; -95.002%]	unstable [+2019.415op/s; +6607.162op/s] or [+514.378%; +1682.951%]	0.533ms	4705.882op/s	12.649ms	392.594op/s
scenario:load:petclinic:tracing	better [-50.710ms; -49.575ms] or [-100.991%; -98.730%]	unstable [+5728.358op/s; +10076.806op/s] or [+5880.173%; +10343.866%]	0.070ms	8000.000op/s	50.212ms	97.418op/s

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/fix-codeowner-retrieval-again
git_commit_date	1750176286	1750195705
git_commit_sha	`72f45a8`	`326d5bc`
release_version	1.50.0-SNAPSHOT~72f45a8563	1.50.0-SNAPSHOT~326d5bc135

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1750198049	1750198049
ci_job_id	987103263	987103263
ci_pipeline_id	68052311	68052311
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-clrnfvyp-project-304-concurrent-1-ua3xe6kl 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-clrnfvyp-project-304-concurrent-1-ua3xe6kl 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~326d5bc135, baseline=1.50.0-SNAPSHOT~72f45a8563
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.575 s) : 15575000, 15575000
.   : milestone, 15575000,
appsec (14.892 s) : 14892000, 14892000
.   : milestone, 14892000,
iast (18.691 s) : 18691000, 18691000
.   : milestone, 18691000,
iast_GLOBAL (17.938 s) : 17938000, 17938000
.   : milestone, 17938000,
profiling (15.576 s) : 15576000, 15576000
.   : milestone, 15576000,
tracing (14.931 s) : 14931000, 14931000
.   : milestone, 14931000,
section candidate
no_agent (15.515 s) : 15515000, 15515000
.   : milestone, 15515000,
appsec (19.197 s) : 19197000, 19197000
.   : milestone, 19197000,
iast (19.193 s) : 19193000, 19193000
.   : milestone, 19193000,
iast_GLOBAL (17.916 s) : 17916000, 17916000
.   : milestone, 17916000,
profiling (15.16 s) : 15160000, 15160000
.   : milestone, 15160000,
tracing (15.002 s) : 15002000, 15002000
.   : milestone, 15002000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.575 s [15.575 s, 15.575 s]	-
appsec	14.892 s [14.892 s, 14.892 s]	-683.0 ms (-4.4%)
iast	18.691 s [18.691 s, 18.691 s]	3.116 s (20.0%)
iast_GLOBAL	17.938 s [17.938 s, 17.938 s]	2.363 s (15.2%)
profiling	15.576 s [15.576 s, 15.576 s]	1.0 ms (0.0%)
tracing	14.931 s [14.931 s, 14.931 s]	-644.0 ms (-4.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.515 s [15.515 s, 15.515 s]	-
appsec	19.197 s [19.197 s, 19.197 s]	3.682 s (23.7%)
iast	19.193 s [19.193 s, 19.193 s]	3.678 s (23.7%)
iast_GLOBAL	17.916 s [17.916 s, 17.916 s]	2.401 s (15.5%)
profiling	15.16 s [15.16 s, 15.16 s]	-355.0 ms (-2.3%)
tracing	15.002 s [15.002 s, 15.002 s]	-513.0 ms (-3.3%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~326d5bc135, baseline=1.50.0-SNAPSHOT~72f45a8563
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.48 ms) : 1469, 1492
.   : milestone, 1480,
appsec (2.416 ms) : 2368, 2465
.   : milestone, 2416,
iast (2.204 ms) : 2142, 2266
.   : milestone, 2204,
iast_GLOBAL (2.248 ms) : 2186, 2311
.   : milestone, 2248,
profiling (2.077 ms) : 2026, 2129
.   : milestone, 2077,
tracing (2.018 ms) : 1970, 2066
.   : milestone, 2018,
section candidate
no_agent (1.48 ms) : 1469, 1492
.   : milestone, 1480,
appsec (2.433 ms) : 2384, 2483
.   : milestone, 2433,
iast (2.203 ms) : 2141, 2265
.   : milestone, 2203,
iast_GLOBAL (2.251 ms) : 2189, 2313
.   : milestone, 2251,
profiling (2.048 ms) : 1998, 2098
.   : milestone, 2048,
tracing (2.022 ms) : 1975, 2070
.   : milestone, 2022,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.48 ms [1.469 ms, 1.492 ms]	-
appsec	2.416 ms [2.368 ms, 2.465 ms]	936.084 µs (63.2%)
iast	2.204 ms [2.142 ms, 2.266 ms]	723.333 µs (48.9%)
iast_GLOBAL	2.248 ms [2.186 ms, 2.311 ms]	767.879 µs (51.9%)
profiling	2.077 ms [2.026 ms, 2.129 ms]	596.914 µs (40.3%)
tracing	2.018 ms [1.97 ms, 2.066 ms]	537.661 µs (36.3%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.48 ms [1.469 ms, 1.492 ms]	-
appsec	2.433 ms [2.384 ms, 2.483 ms]	953.304 µs (64.4%)
iast	2.203 ms [2.141 ms, 2.265 ms]	723.022 µs (48.8%)
iast_GLOBAL	2.251 ms [2.189 ms, 2.313 ms]	770.681 µs (52.1%)
profiling	2.048 ms [1.998 ms, 2.098 ms]	567.97 µs (38.4%)
tracing	2.022 ms [1.975 ms, 2.07 ms]	542.187 µs (36.6%)

sarahchen6 · 2025-06-20T20:09:24Z

Fixed by #9008 :)

Move forward slash placement

326d5bc

sarahchen6 added type: enhancement tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Jun 17, 2025

sarahchen6 closed this Jun 20, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Re-Update test source file reporting to match codeowners file #9002

Re-Update test source file reporting to match codeowners file #9002

Uh oh!

sarahchen6 commented Jun 17, 2025

Uh oh!

pr-commenter bot commented Jun 17, 2025

Uh oh!

sarahchen6 commented Jun 20, 2025

Uh oh!

Uh oh!

Re-Update test source file reporting to match codeowners file #9002

Re-Update test source file reporting to match codeowners file #9002

Uh oh!

Conversation

sarahchen6 commented Jun 17, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Jun 17, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

sarahchen6 commented Jun 20, 2025

Uh oh!

Uh oh!