-
Notifications
You must be signed in to change notification settings - Fork 292
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix JUnit test case name uniqueness when uploading results #8046
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 12 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.44.0-SNAPSHOT~cede1b7ee2, baseline=1.44.0-SNAPSHOT~722c8f7af5
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.089 s) : 0, 1088765
Total [baseline] (10.508 s) : 0, 10508466
Agent [candidate] (1.092 s) : 0, 1092227
Total [candidate] (10.457 s) : 0, 10456533
section appsec
Agent [baseline] (1.228 s) : 0, 1228199
Total [baseline] (10.728 s) : 0, 10728046
Agent [candidate] (1.226 s) : 0, 1226290
Total [candidate] (10.768 s) : 0, 10767734
section iast
Agent [baseline] (1.218 s) : 0, 1217761
Total [baseline] (10.914 s) : 0, 10913587
Agent [candidate] (1.231 s) : 0, 1230589
Total [candidate] (10.967 s) : 0, 10967083
section profiling
Agent [baseline] (1.326 s) : 0, 1325645
Total [baseline] (10.853 s) : 0, 10852839
Agent [candidate] (1.329 s) : 0, 1328917
Total [candidate] (10.887 s) : 0, 10887071
gantt
title petclinic - break down per module: candidate=1.44.0-SNAPSHOT~cede1b7ee2, baseline=1.44.0-SNAPSHOT~722c8f7af5
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (692.766 ms) : 0, 692766
BytebuddyAgent [candidate] (694.295 ms) : 0, 694295
GlobalTracer [baseline] (317.783 ms) : 0, 317783
GlobalTracer [candidate] (317.674 ms) : 0, 317674
AppSec [baseline] (54.7 ms) : 0, 54700
AppSec [candidate] (55.019 ms) : 0, 55019
Remote Config [baseline] (676.57 µs) : 0, 677
Remote Config [candidate] (689.119 µs) : 0, 689
Telemetry [baseline] (9.131 ms) : 0, 9131
Telemetry [candidate] (10.774 ms) : 0, 10774
section appsec
BytebuddyAgent [baseline] (712.727 ms) : 0, 712727
BytebuddyAgent [candidate] (711.731 ms) : 0, 711731
GlobalTracer [baseline] (315.608 ms) : 0, 315608
GlobalTracer [candidate] (314.859 ms) : 0, 314859
AppSec [baseline] (167.454 ms) : 0, 167454
AppSec [candidate] (167.557 ms) : 0, 167557
Remote Config [baseline] (644.438 µs) : 0, 644
Remote Config [candidate] (652.612 µs) : 0, 653
Telemetry [baseline] (8.574 ms) : 0, 8574
Telemetry [candidate] (7.826 ms) : 0, 7826
IAST [baseline] (18.909 ms) : 0, 18909
IAST [candidate] (19.807 ms) : 0, 19807
section iast
BytebuddyAgent [baseline] (810.545 ms) : 0, 810545
BytebuddyAgent [candidate] (819.905 ms) : 0, 819905
GlobalTracer [baseline] (306.64 ms) : 0, 306640
GlobalTracer [candidate] (308.728 ms) : 0, 308728
AppSec [baseline] (58.116 ms) : 0, 58116
AppSec [candidate] (58.399 ms) : 0, 58399
Remote Config [baseline] (620.193 µs) : 0, 620
Remote Config [candidate] (678.155 µs) : 0, 678
Telemetry [baseline] (7.466 ms) : 0, 7466
Telemetry [candidate] (7.607 ms) : 0, 7607
IAST [baseline] (20.689 ms) : 0, 20689
IAST [candidate] (21.239 ms) : 0, 21239
section profiling
ProfilingAgent [baseline] (95.074 ms) : 0, 95074
ProfilingAgent [candidate] (94.009 ms) : 0, 94009
BytebuddyAgent [baseline] (692.593 ms) : 0, 692593
BytebuddyAgent [candidate] (694.434 ms) : 0, 694434
GlobalTracer [baseline] (436.27 ms) : 0, 436270
GlobalTracer [candidate] (438.618 ms) : 0, 438618
AppSec [baseline] (53.961 ms) : 0, 53961
AppSec [candidate] (54.062 ms) : 0, 54062
Remote Config [baseline] (672.248 µs) : 0, 672
Remote Config [candidate] (670.367 µs) : 0, 670
Telemetry [baseline] (7.758 ms) : 0, 7758
Telemetry [candidate] (7.864 ms) : 0, 7864
Profiling [baseline] (95.097 ms) : 0, 95097
Profiling [candidate] (94.033 ms) : 0, 94033
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.44.0-SNAPSHOT~cede1b7ee2, baseline=1.44.0-SNAPSHOT~722c8f7af5
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.092 s) : 0, 1091794
Total [baseline] (8.677 s) : 0, 8676506
Agent [candidate] (1.107 s) : 0, 1107264
Total [candidate] (8.723 s) : 0, 8723063
section iast
Agent [baseline] (1.22 s) : 0, 1220324
Total [baseline] (9.266 s) : 0, 9266206
Agent [candidate] (1.22 s) : 0, 1219681
Total [candidate] (9.19 s) : 0, 9189699
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.237 s) : 0, 1236699
Total [baseline] (9.245 s) : 0, 9244667
Agent [candidate] (1.231 s) : 0, 1231481
Total [candidate] (9.264 s) : 0, 9263527
section iast_TELEMETRY_OFF
Agent [baseline] (1.216 s) : 0, 1215675
Total [baseline] (9.216 s) : 0, 9216108
Agent [candidate] (1.218 s) : 0, 1217526
Total [candidate] (9.195 s) : 0, 9195239
gantt
title insecure-bank - break down per module: candidate=1.44.0-SNAPSHOT~cede1b7ee2, baseline=1.44.0-SNAPSHOT~722c8f7af5
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (695.229 ms) : 0, 695229
BytebuddyAgent [candidate] (704.366 ms) : 0, 704366
GlobalTracer [baseline] (318.67 ms) : 0, 318670
GlobalTracer [candidate] (322.454 ms) : 0, 322454
AppSec [baseline] (54.881 ms) : 0, 54881
AppSec [candidate] (55.036 ms) : 0, 55036
Remote Config [baseline] (683.761 µs) : 0, 684
Remote Config [candidate] (713.031 µs) : 0, 713
Telemetry [baseline] (8.541 ms) : 0, 8541
Telemetry [candidate] (10.719 ms) : 0, 10719
section iast
BytebuddyAgent [baseline] (811.629 ms) : 0, 811629
BytebuddyAgent [candidate] (812.169 ms) : 0, 812169
GlobalTracer [baseline] (306.904 ms) : 0, 306904
GlobalTracer [candidate] (306.44 ms) : 0, 306440
AppSec [baseline] (57.034 ms) : 0, 57034
AppSec [candidate] (57.329 ms) : 0, 57329
IAST [baseline] (22.835 ms) : 0, 22835
IAST [candidate] (21.77 ms) : 0, 21770
Remote Config [baseline] (649.749 µs) : 0, 650
Remote Config [candidate] (651.344 µs) : 0, 651
Telemetry [baseline] (7.545 ms) : 0, 7545
Telemetry [candidate] (7.527 ms) : 0, 7527
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (824.35 ms) : 0, 824350
BytebuddyAgent [candidate] (819.19 ms) : 0, 819190
GlobalTracer [baseline] (310.539 ms) : 0, 310539
GlobalTracer [candidate] (309.687 ms) : 0, 309687
AppSec [baseline] (55.976 ms) : 0, 55976
AppSec [candidate] (57.993 ms) : 0, 57993
IAST [baseline] (23.598 ms) : 0, 23598
IAST [candidate] (22.395 ms) : 0, 22395
Remote Config [baseline] (648.582 µs) : 0, 649
Remote Config [candidate] (658.852 µs) : 0, 659
Telemetry [baseline] (7.607 ms) : 0, 7607
Telemetry [candidate] (7.661 ms) : 0, 7661
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (808.502 ms) : 0, 808502
BytebuddyAgent [candidate] (810.042 ms) : 0, 810042
GlobalTracer [baseline] (306.517 ms) : 0, 306517
GlobalTracer [candidate] (307.037 ms) : 0, 307037
AppSec [baseline] (58.176 ms) : 0, 58176
AppSec [candidate] (57.971 ms) : 0, 57971
IAST [baseline] (20.564 ms) : 0, 20564
IAST [candidate] (20.54 ms) : 0, 20540
Remote Config [baseline] (639.68 µs) : 0, 640
Remote Config [candidate] (645.291 µs) : 0, 645
Telemetry [baseline] (7.532 ms) : 0, 7532
Telemetry [candidate] (7.484 ms) : 0, 7484
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 15 unstable metrics. Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.44.0-SNAPSHOT~cede1b7ee2, baseline=1.44.0-SNAPSHOT~722c8f7af5
dateFormat X
axisFormat %s
section baseline
no_agent (1.358 ms) : 1338, 1377
. : milestone, 1358,
appsec (1.764 ms) : 1739, 1789
. : milestone, 1764,
appsec_no_iast (1.779 ms) : 1754, 1804
. : milestone, 1779,
iast (1.492 ms) : 1470, 1515
. : milestone, 1492,
profiling (1.52 ms) : 1497, 1543
. : milestone, 1520,
tracing (1.504 ms) : 1479, 1529
. : milestone, 1504,
section candidate
no_agent (1.353 ms) : 1332, 1373
. : milestone, 1353,
appsec (1.754 ms) : 1729, 1779
. : milestone, 1754,
appsec_no_iast (1.754 ms) : 1727, 1780
. : milestone, 1754,
iast (1.5 ms) : 1477, 1522
. : milestone, 1500,
profiling (1.53 ms) : 1506, 1555
. : milestone, 1530,
tracing (1.482 ms) : 1458, 1507
. : milestone, 1482,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.44.0-SNAPSHOT~cede1b7ee2, baseline=1.44.0-SNAPSHOT~722c8f7af5
dateFormat X
axisFormat %s
section baseline
no_agent (368.199 µs) : 348, 388
. : milestone, 368,
iast (497.725 µs) : 476, 520
. : milestone, 498,
iast_FULL (648.156 µs) : 627, 670
. : milestone, 648,
iast_GLOBAL (515.829 µs) : 494, 537
. : milestone, 516,
iast_HARDCODED_SECRET_DISABLED (495.69 µs) : 474, 517
. : milestone, 496,
iast_INACTIVE (456.498 µs) : 436, 477
. : milestone, 456,
iast_TELEMETRY_OFF (478.334 µs) : 457, 500
. : milestone, 478,
tracing (459.727 µs) : 438, 482
. : milestone, 460,
section candidate
no_agent (374.76 µs) : 355, 394
. : milestone, 375,
iast (488.338 µs) : 467, 510
. : milestone, 488,
iast_FULL (654.748 µs) : 633, 676
. : milestone, 655,
iast_GLOBAL (510.993 µs) : 490, 532
. : milestone, 511,
iast_HARDCODED_SECRET_DISABLED (497.262 µs) : 476, 519
. : milestone, 497,
iast_INACTIVE (452.173 µs) : 431, 473
. : milestone, 452,
iast_TELEMETRY_OFF (488.86 µs) : 466, 511
. : milestone, 489,
tracing (448.142 µs) : 428, 469
. : milestone, 448,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.44.0-SNAPSHOT~cede1b7ee2, baseline=1.44.0-SNAPSHOT~46dcd32b34
dateFormat X
axisFormat %s
section baseline
no_agent (14.694 s) : 14694000, 14694000
. : milestone, 14694000,
appsec (14.988 s) : 14988000, 14988000
. : milestone, 14988000,
iast (18.707 s) : 18707000, 18707000
. : milestone, 18707000,
iast_GLOBAL (18.255 s) : 18255000, 18255000
. : milestone, 18255000,
profiling (15.144 s) : 15144000, 15144000
. : milestone, 15144000,
tracing (15.142 s) : 15142000, 15142000
. : milestone, 15142000,
section candidate
no_agent (14.96 s) : 14960000, 14960000
. : milestone, 14960000,
appsec (15.294 s) : 15294000, 15294000
. : milestone, 15294000,
iast (18.756 s) : 18756000, 18756000
. : milestone, 18756000,
iast_GLOBAL (17.673 s) : 17673000, 17673000
. : milestone, 17673000,
profiling (15.235 s) : 15235000, 15235000
. : milestone, 15235000,
tracing (15.1 s) : 15100000, 15100000
. : milestone, 15100000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.44.0-SNAPSHOT~cede1b7ee2, baseline=1.44.0-SNAPSHOT~46dcd32b34
dateFormat X
axisFormat %s
section baseline
no_agent (1.461 ms) : 1450, 1473
. : milestone, 1461,
appsec (2.35 ms) : 2308, 2392
. : milestone, 2350,
iast (2.079 ms) : 2027, 2131
. : milestone, 2079,
iast_GLOBAL (2.122 ms) : 2069, 2174
. : milestone, 2122,
profiling (1.976 ms) : 1932, 2019
. : milestone, 1976,
tracing (1.926 ms) : 1885, 1966
. : milestone, 1926,
section candidate
no_agent (1.465 ms) : 1454, 1477
. : milestone, 1465,
appsec (2.343 ms) : 2301, 2385
. : milestone, 2343,
iast (2.082 ms) : 2030, 2135
. : milestone, 2082,
iast_GLOBAL (2.13 ms) : 2077, 2183
. : milestone, 2130,
profiling (1.949 ms) : 1907, 1991
. : milestone, 1949,
tracing (1.92 ms) : 1880, 1960
. : milestone, 1920,
|
bm1549
approved these changes
Dec 2, 2024
PerfectSlayer
added
the
tag: no release notes
Changes to exclude from release notes
label
Dec 12, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
comp: tooling
Build & Tooling
tag: no release notes
Changes to exclude from release notes
type: enhancement
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
This PR will alter JUnit test reports that are uploaded to CI Visibility to remove random port number from the test case name, replacing them by
PORT
.Motivation
This will help with CI monitoring to keep track of test execution.
Additional Notes
Contributor Checklist
type:
and (comp:
orinst:
) labels in addition to any usefull labelsclose
,fix
or any linking keywords when referencing an issue.Use
solves
instead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]