-
Notifications
You must be signed in to change notification settings - Fork 318
Add support for JUnit 6.0.0-RC3 #9592
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
🎯 Code Coverage 🔗 Commit SHA: 50ac212 | Docs | Was this helpful? Give us feedback! |
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 53 metrics, 6 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~50ac212b42, baseline=1.54.0-SNAPSHOT~0094a60a80
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.005 s) : 0, 1005482
Total [baseline] (10.721 s) : 0, 10721333
Agent [candidate] (1.003 s) : 0, 1002815
Total [candidate] (10.638 s) : 0, 10637691
section appsec
Agent [baseline] (1.193 s) : 0, 1192763
Total [baseline] (10.974 s) : 0, 10974404
Agent [candidate] (1.185 s) : 0, 1185351
Total [candidate] (10.977 s) : 0, 10976910
section iast
Agent [baseline] (1.152 s) : 0, 1151927
Total [baseline] (10.885 s) : 0, 10885014
Agent [candidate] (1.151 s) : 0, 1150685
Total [candidate] (10.936 s) : 0, 10935745
section profiling
Agent [baseline] (1.155 s) : 0, 1154829
Total [baseline] (11.091 s) : 0, 11091085
Agent [candidate] (1.157 s) : 0, 1156968
Total [candidate] (11.055 s) : 0, 11055045
gantt
title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~50ac212b42, baseline=1.54.0-SNAPSHOT~0094a60a80
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.465 ms) : 0, 1465
crashtracking [candidate] (1.459 ms) : 0, 1459
BytebuddyAgent [baseline] (687.391 ms) : 0, 687391
BytebuddyAgent [candidate] (685.864 ms) : 0, 685864
GlobalTracer [baseline] (248.096 ms) : 0, 248096
GlobalTracer [candidate] (247.414 ms) : 0, 247414
AppSec [baseline] (31.22 ms) : 0, 31220
AppSec [candidate] (31.008 ms) : 0, 31008
Debugger [baseline] (6.38 ms) : 0, 6380
Debugger [candidate] (6.308 ms) : 0, 6308
Remote Config [baseline] (692.145 µs) : 0, 692
Remote Config [candidate] (686.23 µs) : 0, 686
Telemetry [baseline] (8.951 ms) : 0, 8951
Telemetry [candidate] (8.916 ms) : 0, 8916
section appsec
crashtracking [baseline] (1.472 ms) : 0, 1472
crashtracking [candidate] (1.46 ms) : 0, 1460
BytebuddyAgent [baseline] (715.992 ms) : 0, 715992
BytebuddyAgent [candidate] (710.847 ms) : 0, 710847
GlobalTracer [baseline] (241.346 ms) : 0, 241346
GlobalTracer [candidate] (239.536 ms) : 0, 239536
AppSec [baseline] (170.903 ms) : 0, 170903
AppSec [candidate] (170.381 ms) : 0, 170381
Debugger [baseline] (6.047 ms) : 0, 6047
Debugger [candidate] (6.799 ms) : 0, 6799
Remote Config [baseline] (636.817 µs) : 0, 637
Remote Config [candidate] (627.208 µs) : 0, 627
Telemetry [baseline] (10.054 ms) : 0, 10054
Telemetry [candidate] (9.914 ms) : 0, 9914
IAST [baseline] (24.937 ms) : 0, 24937
IAST [candidate] (24.641 ms) : 0, 24641
section iast
crashtracking [baseline] (1.477 ms) : 0, 1477
crashtracking [candidate] (1.46 ms) : 0, 1460
BytebuddyAgent [baseline] (814.708 ms) : 0, 814708
BytebuddyAgent [candidate] (812.995 ms) : 0, 812995
GlobalTracer [baseline] (239.026 ms) : 0, 239026
GlobalTracer [candidate] (239.153 ms) : 0, 239153
AppSec [baseline] (33.127 ms) : 0, 33127
AppSec [candidate] (34.176 ms) : 0, 34176
Debugger [baseline] (6.11 ms) : 0, 6110
Debugger [candidate] (6.127 ms) : 0, 6127
Remote Config [baseline] (585.877 µs) : 0, 586
Remote Config [candidate] (595.237 µs) : 0, 595
Telemetry [baseline] (8.269 ms) : 0, 8269
Telemetry [candidate] (8.425 ms) : 0, 8425
IAST [baseline] (27.194 ms) : 0, 27194
IAST [candidate] (26.39 ms) : 0, 26390
section profiling
ProfilingAgent [baseline] (101.503 ms) : 0, 101503
ProfilingAgent [candidate] (103.746 ms) : 0, 103746
crashtracking [baseline] (1.444 ms) : 0, 1444
crashtracking [candidate] (1.456 ms) : 0, 1456
BytebuddyAgent [baseline] (720.315 ms) : 0, 720315
BytebuddyAgent [candidate] (720.854 ms) : 0, 720854
GlobalTracer [baseline] (225.161 ms) : 0, 225161
GlobalTracer [candidate] (225.139 ms) : 0, 225139
AppSec [baseline] (31.59 ms) : 0, 31590
AppSec [candidate] (31.398 ms) : 0, 31398
Debugger [baseline] (6.539 ms) : 0, 6539
Debugger [candidate] (6.554 ms) : 0, 6554
Remote Config [baseline] (694.309 µs) : 0, 694
Remote Config [candidate] (695.362 µs) : 0, 695
Telemetry [baseline] (16.371 ms) : 0, 16371
Telemetry [candidate] (15.596 ms) : 0, 15596
Profiling [baseline] (102.118 ms) : 0, 102118
Profiling [candidate] (104.351 ms) : 0, 104351
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~50ac212b42, baseline=1.54.0-SNAPSHOT~0094a60a80
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.004 s) : 0, 1004474
Total [baseline] (8.643 s) : 0, 8643413
Agent [candidate] (1.008 s) : 0, 1008048
Total [candidate] (8.688 s) : 0, 8688099
section iast
Agent [baseline] (1.143 s) : 0, 1143074
Total [baseline] (9.312 s) : 0, 9312223
Agent [candidate] (1.143 s) : 0, 1142612
Total [candidate] (9.343 s) : 0, 9343178
gantt
title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~50ac212b42, baseline=1.54.0-SNAPSHOT~0094a60a80
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.464 ms) : 0, 1464
crashtracking [candidate] (1.452 ms) : 0, 1452
BytebuddyAgent [baseline] (687.252 ms) : 0, 687252
BytebuddyAgent [candidate] (688.825 ms) : 0, 688825
GlobalTracer [baseline] (247.472 ms) : 0, 247472
GlobalTracer [candidate] (249.425 ms) : 0, 249425
AppSec [baseline] (31.124 ms) : 0, 31124
AppSec [candidate] (31.208 ms) : 0, 31208
Debugger [baseline] (6.351 ms) : 0, 6351
Debugger [candidate] (6.328 ms) : 0, 6328
Remote Config [baseline] (682.325 µs) : 0, 682
Remote Config [candidate] (678.94 µs) : 0, 679
Telemetry [baseline] (9.017 ms) : 0, 9017
Telemetry [candidate] (9.01 ms) : 0, 9010
section iast
crashtracking [baseline] (1.459 ms) : 0, 1459
crashtracking [candidate] (1.457 ms) : 0, 1457
BytebuddyAgent [baseline] (808.371 ms) : 0, 808371
BytebuddyAgent [candidate] (807.935 ms) : 0, 807935
GlobalTracer [baseline] (237.174 ms) : 0, 237174
GlobalTracer [candidate] (237.537 ms) : 0, 237537
IAST [baseline] (26.237 ms) : 0, 26237
IAST [candidate] (25.952 ms) : 0, 25952
AppSec [baseline] (33.648 ms) : 0, 33648
AppSec [candidate] (33.62 ms) : 0, 33620
Debugger [baseline] (6.078 ms) : 0, 6078
Debugger [candidate] (6.041 ms) : 0, 6041
Remote Config [baseline] (590.209 µs) : 0, 590
Remote Config [candidate] (580.366 µs) : 0, 580
Telemetry [baseline] (8.24 ms) : 0, 8240
Telemetry [candidate] (8.254 ms) : 0, 8254
LoadParameters
See matching parameters
SummaryFound 2 performance improvements and 1 performance regressions! Performance is the same for 9 metrics, 12 unstable metrics.
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~50ac212b42, baseline=1.54.0-SNAPSHOT~0094a60a80
dateFormat X
axisFormat %s
section baseline
no_agent (37.829 ms) : 37520, 38138
. : milestone, 37829,
appsec (48.627 ms) : 48198, 49057
. : milestone, 48627,
code_origins (43.366 ms) : 42988, 43744
. : milestone, 43366,
iast (44.133 ms) : 43751, 44515
. : milestone, 44133,
profiling (49.655 ms) : 49179, 50130
. : milestone, 49655,
tracing (44.969 ms) : 44603, 45336
. : milestone, 44969,
section candidate
no_agent (37.106 ms) : 36801, 37410
. : milestone, 37106,
appsec (49.246 ms) : 48799, 49693
. : milestone, 49246,
code_origins (44.49 ms) : 44091, 44890
. : milestone, 44490,
iast (44.813 ms) : 44425, 45201
. : milestone, 44813,
profiling (49.723 ms) : 49283, 50163
. : milestone, 49723,
tracing (45.872 ms) : 45476, 46268
. : milestone, 45872,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~50ac212b42, baseline=1.54.0-SNAPSHOT~0094a60a80
dateFormat X
axisFormat %s
section baseline
no_agent (4.458 ms) : 4408, 4508
. : milestone, 4458,
iast (10.434 ms) : 10256, 10611
. : milestone, 10434,
iast_FULL (14.149 ms) : 13870, 14428
. : milestone, 14149,
iast_GLOBAL (11.243 ms) : 11038, 11448
. : milestone, 11243,
profiling (8.505 ms) : 8373, 8637
. : milestone, 8505,
tracing (7.609 ms) : 7502, 7715
. : milestone, 7609,
section candidate
no_agent (4.282 ms) : 4235, 4329
. : milestone, 4282,
iast (10.381 ms) : 10206, 10556
. : milestone, 10381,
iast_FULL (13.873 ms) : 13599, 14146
. : milestone, 13873,
iast_GLOBAL (10.221 ms) : 10043, 10400
. : milestone, 10221,
profiling (9.015 ms) : 8872, 9158
. : milestone, 9015,
tracing (7.6 ms) : 7490, 7709
. : milestone, 7600,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~50ac212b42, baseline=1.54.0-SNAPSHOT~0094a60a80
dateFormat X
axisFormat %s
section baseline
no_agent (1.476 ms) : 1464, 1487
. : milestone, 1476,
appsec (3.654 ms) : 3441, 3868
. : milestone, 3654,
iast (2.209 ms) : 2145, 2272
. : milestone, 2209,
iast_GLOBAL (2.248 ms) : 2184, 2312
. : milestone, 2248,
profiling (2.06 ms) : 2009, 2112
. : milestone, 2060,
tracing (2.033 ms) : 1983, 2083
. : milestone, 2033,
section candidate
no_agent (1.481 ms) : 1469, 1492
. : milestone, 1481,
appsec (3.704 ms) : 3485, 3923
. : milestone, 3704,
iast (2.206 ms) : 2143, 2270
. : milestone, 2206,
iast_GLOBAL (2.266 ms) : 2202, 2330
. : milestone, 2266,
profiling (2.063 ms) : 2012, 2114
. : milestone, 2063,
tracing (2.034 ms) : 1985, 2084
. : milestone, 2034,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~50ac212b42, baseline=1.54.0-SNAPSHOT~0094a60a80
dateFormat X
axisFormat %s
section baseline
no_agent (14.972 s) : 14972000, 14972000
. : milestone, 14972000,
appsec (15.081 s) : 15081000, 15081000
. : milestone, 15081000,
iast (18.768 s) : 18768000, 18768000
. : milestone, 18768000,
iast_GLOBAL (17.594 s) : 17594000, 17594000
. : milestone, 17594000,
profiling (15.703 s) : 15703000, 15703000
. : milestone, 15703000,
tracing (15.189 s) : 15189000, 15189000
. : milestone, 15189000,
section candidate
no_agent (15.156 s) : 15156000, 15156000
. : milestone, 15156000,
appsec (15.35 s) : 15350000, 15350000
. : milestone, 15350000,
iast (18.796 s) : 18796000, 18796000
. : milestone, 18796000,
iast_GLOBAL (17.936 s) : 17936000, 17936000
. : milestone, 17936000,
profiling (15.471 s) : 15471000, 15471000
. : milestone, 15471000,
tracing (15.154 s) : 15154000, 15154000
. : milestone, 15154000,
|
What Does This Do
Motivation
OutputDirectoryProviderin favor ofOutputDirectoryCreator, which broke our instrumentation inExecutionRequestFactory.Contributor Checklist
type:and (comp:orinst:) labels in addition to any usefull labelsclose,fixor any linking keywords when referencing an issue.Use
solvesinstead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]