-
Notifications
You must be signed in to change notification settings - Fork 318
Added UtilityMain from Open Liberty to SSI exclusion list.
#9460
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
🎯 Code Coverage 🔗 Commit SHA: 4ae1279 | Docs | Was this helpful? Give us feedback! |
PerfectSlayer
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The change looks good but you would have to generate and commit the json file too. Check the build-requirements.sh script to do that
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 47 metrics, 12 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.53.0-SNAPSHOT~4ae12797d3, baseline=1.54.0-SNAPSHOT~9c70b0c71b
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1058936
Total [baseline] (10.735 s) : 0, 10735447
Agent [candidate] (1.05 s) : 0, 1049611
Total [candidate] (10.742 s) : 0, 10742083
section appsec
Agent [baseline] (1.228 s) : 0, 1227893
Total [baseline] (10.879 s) : 0, 10878710
Agent [candidate] (1.224 s) : 0, 1223685
Total [candidate] (10.825 s) : 0, 10825348
section iast
Agent [baseline] (1.181 s) : 0, 1181347
Total [baseline] (10.982 s) : 0, 10981531
Agent [candidate] (1.183 s) : 0, 1182718
Total [candidate] (10.955 s) : 0, 10955235
section profiling
Agent [baseline] (1.209 s) : 0, 1208799
Total [baseline] (10.918 s) : 0, 10918015
Agent [candidate] (1.2 s) : 0, 1200308
Total [candidate] (10.943 s) : 0, 10942650
gantt
title petclinic - break down per module: candidate=1.53.0-SNAPSHOT~4ae12797d3, baseline=1.54.0-SNAPSHOT~9c70b0c71b
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.469 ms) : 0, 1469
crashtracking [candidate] (1.45 ms) : 0, 1450
BytebuddyAgent [baseline] (740.128 ms) : 0, 740128
BytebuddyAgent [candidate] (734.346 ms) : 0, 734346
GlobalTracer [baseline] (245.384 ms) : 0, 245384
GlobalTracer [candidate] (243.547 ms) : 0, 243547
AppSec [baseline] (30.548 ms) : 0, 30548
AppSec [candidate] (30.163 ms) : 0, 30163
Debugger [baseline] (6.108 ms) : 0, 6108
Debugger [candidate] (6.073 ms) : 0, 6073
Remote Config [baseline] (715.808 µs) : 0, 716
Remote Config [candidate] (693.708 µs) : 0, 694
Telemetry [baseline] (13.247 ms) : 0, 13247
Telemetry [candidate] (12.193 ms) : 0, 12193
section appsec
crashtracking [baseline] (1.477 ms) : 0, 1477
crashtracking [candidate] (1.449 ms) : 0, 1449
BytebuddyAgent [baseline] (758.287 ms) : 0, 758287
BytebuddyAgent [candidate] (755.774 ms) : 0, 755774
GlobalTracer [baseline] (236.532 ms) : 0, 236532
GlobalTracer [candidate] (235.594 ms) : 0, 235594
IAST [baseline] (23.655 ms) : 0, 23655
IAST [candidate] (23.579 ms) : 0, 23579
AppSec [baseline] (168.985 ms) : 0, 168985
AppSec [candidate] (169.224 ms) : 0, 169224
Debugger [baseline] (8.76 ms) : 0, 8760
Debugger [candidate] (7.971 ms) : 0, 7971
Remote Config [baseline] (627.473 µs) : 0, 627
Remote Config [candidate] (637.747 µs) : 0, 638
Telemetry [baseline] (8.443 ms) : 0, 8443
Telemetry [candidate] (8.408 ms) : 0, 8408
section iast
crashtracking [baseline] (1.465 ms) : 0, 1465
crashtracking [candidate] (1.456 ms) : 0, 1456
BytebuddyAgent [baseline] (852.158 ms) : 0, 852158
BytebuddyAgent [candidate] (853.839 ms) : 0, 853839
GlobalTracer [baseline] (233.863 ms) : 0, 233863
GlobalTracer [candidate] (233.794 ms) : 0, 233794
IAST [baseline] (32.075 ms) : 0, 32075
IAST [candidate] (29.28 ms) : 0, 29280
AppSec [baseline] (25.199 ms) : 0, 25199
AppSec [candidate] (27.763 ms) : 0, 27763
Debugger [baseline] (6.626 ms) : 0, 6626
Debugger [candidate] (6.609 ms) : 0, 6609
Remote Config [baseline] (616.44 µs) : 0, 616
Remote Config [candidate] (605.389 µs) : 0, 605
Telemetry [baseline] (8.181 ms) : 0, 8181
Telemetry [candidate] (8.203 ms) : 0, 8203
section profiling
crashtracking [baseline] (1.444 ms) : 0, 1444
crashtracking [candidate] (1.446 ms) : 0, 1446
BytebuddyAgent [baseline] (768.838 ms) : 0, 768838
BytebuddyAgent [candidate] (763.5 ms) : 0, 763500
GlobalTracer [baseline] (224.564 ms) : 0, 224564
GlobalTracer [candidate] (222.588 ms) : 0, 222588
AppSec [baseline] (30.672 ms) : 0, 30672
AppSec [candidate] (30.608 ms) : 0, 30608
Debugger [baseline] (6.288 ms) : 0, 6288
Debugger [candidate] (7.088 ms) : 0, 7088
Remote Config [baseline] (740.797 µs) : 0, 741
Remote Config [candidate] (715.768 µs) : 0, 716
Telemetry [baseline] (16.482 ms) : 0, 16482
Telemetry [candidate] (15.688 ms) : 0, 15688
ProfilingAgent [baseline] (108.794 ms) : 0, 108794
ProfilingAgent [candidate] (108.16 ms) : 0, 108160
Profiling [baseline] (109.473 ms) : 0, 109473
Profiling [candidate] (108.835 ms) : 0, 108835
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.53.0-SNAPSHOT~4ae12797d3, baseline=1.54.0-SNAPSHOT~9c70b0c71b
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1059671
Total [baseline] (8.666 s) : 0, 8665691
Agent [candidate] (1.049 s) : 0, 1049012
Total [candidate] (8.67 s) : 0, 8670032
section iast
Agent [baseline] (1.194 s) : 0, 1193565
Total [baseline] (9.408 s) : 0, 9408423
Agent [candidate] (1.183 s) : 0, 1182776
Total [candidate] (9.332 s) : 0, 9331659
gantt
title insecure-bank - break down per module: candidate=1.53.0-SNAPSHOT~4ae12797d3, baseline=1.54.0-SNAPSHOT~9c70b0c71b
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.468 ms) : 0, 1468
crashtracking [candidate] (1.47 ms) : 0, 1470
BytebuddyAgent [baseline] (739.562 ms) : 0, 739562
BytebuddyAgent [candidate] (734.199 ms) : 0, 734199
GlobalTracer [baseline] (244.758 ms) : 0, 244758
GlobalTracer [candidate] (243.045 ms) : 0, 243045
AppSec [baseline] (30.464 ms) : 0, 30464
AppSec [candidate] (30.112 ms) : 0, 30112
Debugger [baseline] (6.186 ms) : 0, 6186
Debugger [candidate] (6.097 ms) : 0, 6097
Remote Config [baseline] (702.05 µs) : 0, 702
Remote Config [candidate] (699.179 µs) : 0, 699
Telemetry [baseline] (15.325 ms) : 0, 15325
Telemetry [candidate] (12.328 ms) : 0, 12328
section iast
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.455 ms) : 0, 1455
BytebuddyAgent [baseline] (862.072 ms) : 0, 862072
BytebuddyAgent [candidate] (853.783 ms) : 0, 853783
GlobalTracer [baseline] (235.342 ms) : 0, 235342
GlobalTracer [candidate] (233.803 ms) : 0, 233803
IAST [baseline] (31.136 ms) : 0, 31136
IAST [candidate] (29.346 ms) : 0, 29346
AppSec [baseline] (27.39 ms) : 0, 27390
AppSec [candidate] (26.94 ms) : 0, 26940
Debugger [baseline] (5.862 ms) : 0, 5862
Debugger [candidate] (7.562 ms) : 0, 7562
Remote Config [baseline] (622.981 µs) : 0, 623
Remote Config [candidate] (602.881 µs) : 0, 603
Telemetry [baseline] (8.486 ms) : 0, 8486
Telemetry [candidate] (8.22 ms) : 0, 8220
LoadParameters
See matching parameters
SummaryFound 2 performance improvements and 2 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~4ae12797d3, baseline=1.54.0-SNAPSHOT~9c70b0c71b
dateFormat X
axisFormat %s
section baseline
no_agent (4.344 ms) : 4295, 4393
. : milestone, 4344,
iast (9.178 ms) : 9028, 9327
. : milestone, 9178,
iast_FULL (13.59 ms) : 13318, 13862
. : milestone, 13590,
iast_GLOBAL (10.43 ms) : 10243, 10617
. : milestone, 10430,
profiling (8.717 ms) : 8578, 8855
. : milestone, 8717,
tracing (7.445 ms) : 7338, 7553
. : milestone, 7445,
section candidate
no_agent (4.323 ms) : 4272, 4374
. : milestone, 4323,
iast (9.302 ms) : 9146, 9458
. : milestone, 9302,
iast_FULL (13.86 ms) : 13590, 14130
. : milestone, 13860,
iast_GLOBAL (10.056 ms) : 9864, 10247
. : milestone, 10056,
profiling (9.143 ms) : 9000, 9287
. : milestone, 9143,
tracing (8.075 ms) : 7957, 8194
. : milestone, 8075,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~4ae12797d3, baseline=1.54.0-SNAPSHOT~9c70b0c71b
dateFormat X
axisFormat %s
section baseline
no_agent (38.295 ms) : 37987, 38604
. : milestone, 38295,
appsec (46.854 ms) : 46429, 47279
. : milestone, 46854,
code_origins (44.303 ms) : 43919, 44687
. : milestone, 44303,
iast (44.819 ms) : 44433, 45204
. : milestone, 44819,
profiling (46.975 ms) : 46559, 47391
. : milestone, 46975,
tracing (44.584 ms) : 44207, 44960
. : milestone, 44584,
section candidate
no_agent (37.198 ms) : 36900, 37496
. : milestone, 37198,
appsec (48.107 ms) : 47672, 48542
. : milestone, 48107,
code_origins (45.266 ms) : 44868, 45664
. : milestone, 45266,
iast (43.766 ms) : 43385, 44147
. : milestone, 43766,
profiling (46.987 ms) : 46521, 47453
. : milestone, 46987,
tracing (42.714 ms) : 42349, 43079
. : milestone, 42714,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~4ae12797d3, baseline=1.54.0-SNAPSHOT~9c70b0c71b
dateFormat X
axisFormat %s
section baseline
no_agent (15.318 s) : 15318000, 15318000
. : milestone, 15318000,
appsec (14.828 s) : 14828000, 14828000
. : milestone, 14828000,
iast (18.769 s) : 18769000, 18769000
. : milestone, 18769000,
iast_GLOBAL (17.834 s) : 17834000, 17834000
. : milestone, 17834000,
profiling (15.494 s) : 15494000, 15494000
. : milestone, 15494000,
tracing (15.043 s) : 15043000, 15043000
. : milestone, 15043000,
section candidate
no_agent (15.568 s) : 15568000, 15568000
. : milestone, 15568000,
appsec (14.648 s) : 14648000, 14648000
. : milestone, 14648000,
iast (18.363 s) : 18363000, 18363000
. : milestone, 18363000,
iast_GLOBAL (18.046 s) : 18046000, 18046000
. : milestone, 18046000,
profiling (15.357 s) : 15357000, 15357000
. : milestone, 15357000,
tracing (15.12 s) : 15120000, 15120000
. : milestone, 15120000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~4ae12797d3, baseline=1.54.0-SNAPSHOT~9c70b0c71b
dateFormat X
axisFormat %s
section baseline
no_agent (1.476 ms) : 1465, 1488
. : milestone, 1476,
appsec (3.686 ms) : 3467, 3905
. : milestone, 3686,
iast (2.205 ms) : 2142, 2269
. : milestone, 2205,
iast_GLOBAL (2.252 ms) : 2189, 2316
. : milestone, 2252,
profiling (2.056 ms) : 2004, 2107
. : milestone, 2056,
tracing (2.036 ms) : 1987, 2086
. : milestone, 2036,
section candidate
no_agent (1.478 ms) : 1466, 1489
. : milestone, 1478,
appsec (3.685 ms) : 3468, 3901
. : milestone, 3685,
iast (2.208 ms) : 2145, 2271
. : milestone, 2208,
iast_GLOBAL (2.255 ms) : 2191, 2319
. : milestone, 2255,
profiling (2.061 ms) : 2010, 2112
. : milestone, 2061,
tracing (2.04 ms) : 1990, 2089
. : milestone, 2040,
|
Generated |
UtilityMain from Open Liberty to exclusion list.UtilityMain from Open Liberty to SSI exclusion list.
What Does This Do
Added
UtilityMainfrom Open Liberty to exclusion list.Motivation
Exclude
UtilityMainclass that is using for running some short-living commands from SSI.Additional Notes