Skip to content

Add support for JUnit 5.13-RC1 #8865

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
May 22, 2025
Merged

Add support for JUnit 5.13-RC1 #8865

merged 1 commit into from
May 22, 2025

Conversation

daniel-mohedano
Copy link
Contributor

@daniel-mohedano daniel-mohedano commented May 22, 2025 •
edited
Loading

What Does This Do

  • Updates JUnit 5 instrumentation to reflect changes introduced in version 5.13-RC1 to org.junit.platform.engine.ExecutionRequest, adding two new fields to the class, at least one of them required for the execution of tests. The instrumentation now chooses the available method to create objects of the class through reflection.

Motivation

Unblocks #8842

Additional Notes

Tested locally by upgrading the gradle dependencies on junit-5.3 and junit-5.8 instrumentations and running both test and latestDepTest.

Passing results for junit-5.3:

image image

Passing results for junit-5.8:

image image

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@daniel-mohedano daniel-mohedano added type: enhancement comp: ci visibility Continuous Integration Visibility labels May 22, 2025
@daniel-mohedano daniel-mohedano changed the title Add support for JUnit 5.13-RC Add support for JUnit 5.13-RC1 May 22, 2025
@pr-commenter
Copy link

pr-commenter bot commented May 22, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/junit5-execution-request-fix
git_commit_date 1747901310 1747901594
git_commit_sha 8e7b515 a08d100
release_version 1.50.0-SNAPSHOT~8e7b515c37 1.50.0-SNAPSHOT~a08d1007c4
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1747903933 1747903933
ci_job_id 949570563 949570563
ci_pipeline_id 65823270 65823270
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner--hkbl4tc-project-304-concurrent-2-uxe3nc4y 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner--hkbl4tc-project-304-concurrent-2-uxe3nc4y 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 54 metrics, 16 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:petclinic:profiling:GlobalTracer worse
[+8.908ms; +17.549ms] or [+2.466%; +4.858%]		 374.490ms 361.262ms
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~a08d1007c4, baseline=1.50.0-SNAPSHOT~8e7b515c37

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.021 s) : 0, 1020538
Total [baseline] (8.642 s) : 0, 8642340
Agent [candidate] (1.026 s) : 0, 1025779
Total [candidate] (8.646 s) : 0, 8646413
section iast
Agent [baseline] (1.151 s) : 0, 1150747
Total [baseline] (9.226 s) : 0, 9225719
Agent [candidate] (1.153 s) : 0, 1152672
Total [candidate] (9.211 s) : 0, 9210645
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.156 s) : 0, 1156213
Total [baseline] (9.187 s) : 0, 9186862
Agent [candidate] (1.15 s) : 0, 1149683
Total [candidate] (9.185 s) : 0, 9184776
section iast_TELEMETRY_OFF
Agent [baseline] (1.147 s) : 0, 1147354
Total [baseline] (9.224 s) : 0, 9223544
Agent [candidate] (1.144 s) : 0, 1143852
Total [candidate] (9.176 s) : 0, 9176192
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.021 s -
Agent iast 1.151 s 130.21 ms (12.8%)
Agent iast_HARDCODED_SECRET_DISABLED 1.156 s 135.675 ms (13.3%)
Agent iast_TELEMETRY_OFF 1.147 s 126.816 ms (12.4%)
Total tracing 8.642 s -
Total iast 9.226 s 583.379 ms (6.8%)
Total iast_HARDCODED_SECRET_DISABLED 9.187 s 544.522 ms (6.3%)
Total iast_TELEMETRY_OFF 9.224 s 581.204 ms (6.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.026 s -
Agent iast 1.153 s 126.893 ms (12.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.15 s 123.904 ms (12.1%)
Agent iast_TELEMETRY_OFF 1.144 s 118.073 ms (11.5%)
Total tracing 8.646 s -
Total iast 9.211 s 564.232 ms (6.5%)
Total iast_HARDCODED_SECRET_DISABLED 9.185 s 538.362 ms (6.2%)
Total iast_TELEMETRY_OFF 9.176 s 529.779 ms (6.1%) 
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~a08d1007c4, baseline=1.50.0-SNAPSHOT~8e7b515c37

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.113 ms) : 0, 682113
BytebuddyAgent [candidate] (686.927 ms) : 0, 686927
GlobalTracer [baseline] (239.941 ms) : 0, 239941
GlobalTracer [candidate] (241.525 ms) : 0, 241525
AppSec [baseline] (54.257 ms) : 0, 54257
AppSec [candidate] (55.592 ms) : 0, 55592
Debugger [baseline] (9.604 ms) : 0, 9604
Debugger [candidate] (8.283 ms) : 0, 8283
Remote Config [baseline] (694.046 µs) : 0, 694
Remote Config [candidate] (703.269 µs) : 0, 703
Telemetry [baseline] (10.436 ms) : 0, 10436
Telemetry [candidate] (9.078 ms) : 0, 9078
section iast
BytebuddyAgent [baseline] (803.152 ms) : 0, 803152
BytebuddyAgent [candidate] (806.101 ms) : 0, 806101
GlobalTracer [baseline] (230.716 ms) : 0, 230716
GlobalTracer [candidate] (230.849 ms) : 0, 230849
IAST [baseline] (26.068 ms) : 0, 26068
IAST [candidate] (28.927 ms) : 0, 28927
AppSec [baseline] (50.624 ms) : 0, 50624
AppSec [candidate] (48.937 ms) : 0, 48937
Debugger [baseline] (5.907 ms) : 0, 5907
Debugger [candidate] (5.818 ms) : 0, 5818
Remote Config [baseline] (593.11 µs) : 0, 593
Remote Config [candidate] (578.545 µs) : 0, 579
Telemetry [baseline] (7.852 ms) : 0, 7852
Telemetry [candidate] (7.809 ms) : 0, 7809
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (807.355 ms) : 0, 807355
BytebuddyAgent [candidate] (801.657 ms) : 0, 801657
GlobalTracer [baseline] (232.14 ms) : 0, 232140
GlobalTracer [candidate] (231.017 ms) : 0, 231017
IAST [baseline] (29.885 ms) : 0, 29885
IAST [candidate] (27.764 ms) : 0, 27764
AppSec [baseline] (48.716 ms) : 0, 48716
AppSec [candidate] (51.275 ms) : 0, 51275
Debugger [baseline] (5.887 ms) : 0, 5887
Debugger [candidate] (5.887 ms) : 0, 5887
Remote Config [baseline] (602.205 µs) : 0, 602
Remote Config [candidate] (578.533 µs) : 0, 579
Telemetry [baseline] (7.965 ms) : 0, 7965
Telemetry [candidate] (7.909 ms) : 0, 7909
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (798.113 ms) : 0, 798113
BytebuddyAgent [candidate] (797.804 ms) : 0, 797804
GlobalTracer [baseline] (232.297 ms) : 0, 232297
GlobalTracer [candidate] (230.455 ms) : 0, 230455
IAST [baseline] (23.371 ms) : 0, 23371
IAST [candidate] (22.23 ms) : 0, 22230
AppSec [baseline] (55.507 ms) : 0, 55507
AppSec [candidate] (55.569 ms) : 0, 55569
Debugger [baseline] (6.008 ms) : 0, 6008
Debugger [candidate] (5.902 ms) : 0, 5902
Remote Config [baseline] (607.025 µs) : 0, 607
Remote Config [candidate] (596.621 µs) : 0, 597
Telemetry [baseline] (7.857 ms) : 0, 7857
Telemetry [candidate] (7.75 ms) : 0, 7750
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~a08d1007c4, baseline=1.50.0-SNAPSHOT~8e7b515c37

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.021 s) : 0, 1020848
Total [baseline] (10.429 s) : 0, 10428549
Agent [candidate] (1.031 s) : 0, 1031400
Total [candidate] (10.484 s) : 0, 10484230
section appsec
Agent [baseline] (1.168 s) : 0, 1167919
Total [baseline] (10.652 s) : 0, 10652238
Agent [candidate] (1.165 s) : 0, 1164762
Total [candidate] (10.657 s) : 0, 10657252
section iast
Agent [baseline] (1.153 s) : 0, 1152587
Total [baseline] (10.851 s) : 0, 10851071
Agent [candidate] (1.156 s) : 0, 1155568
Total [candidate] (10.828 s) : 0, 10828150
section profiling
Agent [baseline] (1.269 s) : 0, 1269323
Total [baseline] (10.821 s) : 0, 10821187
Agent [candidate] (1.279 s) : 0, 1279099
Total [candidate] (10.818 s) : 0, 10818208
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.021 s -
Agent appsec 1.168 s 147.071 ms (14.4%)
Agent iast 1.153 s 131.739 ms (12.9%)
Agent profiling 1.269 s 248.475 ms (24.3%)
Total tracing 10.429 s -
Total appsec 10.652 s 223.688 ms (2.1%)
Total iast 10.851 s 422.521 ms (4.1%)
Total profiling 10.821 s 392.638 ms (3.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.031 s -
Agent appsec 1.165 s 133.362 ms (12.9%)
Agent iast 1.156 s 124.168 ms (12.0%)
Agent profiling 1.279 s 247.699 ms (24.0%)
Total tracing 10.484 s -
Total appsec 10.657 s 173.022 ms (1.7%)
Total iast 10.828 s 343.921 ms (3.3%)
Total profiling 10.818 s 333.979 ms (3.2%) 
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~a08d1007c4, baseline=1.50.0-SNAPSHOT~8e7b515c37

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.8 ms) : 0, 682800
BytebuddyAgent [candidate] (691.571 ms) : 0, 691571
GlobalTracer [baseline] (240.313 ms) : 0, 240313
GlobalTracer [candidate] (241.542 ms) : 0, 241542
AppSec [baseline] (55.205 ms) : 0, 55205
AppSec [candidate] (55.534 ms) : 0, 55534
Debugger [baseline] (7.615 ms) : 0, 7615
Debugger [candidate] (7.65 ms) : 0, 7650
Remote Config [baseline] (696.198 µs) : 0, 696
Remote Config [candidate] (720.388 µs) : 0, 720
Telemetry [baseline] (10.53 ms) : 0, 10530
Telemetry [candidate] (10.731 ms) : 0, 10731
section appsec
BytebuddyAgent [baseline] (704.606 ms) : 0, 704606
BytebuddyAgent [candidate] (702.281 ms) : 0, 702281
GlobalTracer [baseline] (238.246 ms) : 0, 238246
GlobalTracer [candidate] (237.718 ms) : 0, 237718
IAST [baseline] (21.946 ms) : 0, 21946
IAST [candidate] (21.937 ms) : 0, 21937
AppSec [baseline] (175.535 ms) : 0, 175535
AppSec [candidate] (176.285 ms) : 0, 176285
Debugger [baseline] (6.363 ms) : 0, 6363
Debugger [candidate] (5.936 ms) : 0, 5936
Remote Config [baseline] (621.473 µs) : 0, 621
Remote Config [candidate] (623.646 µs) : 0, 624
Telemetry [baseline] (7.786 ms) : 0, 7786
Telemetry [candidate] (7.38 ms) : 0, 7380
section iast
BytebuddyAgent [baseline] (804.109 ms) : 0, 804109
BytebuddyAgent [candidate] (807.656 ms) : 0, 807656
GlobalTracer [baseline] (231.23 ms) : 0, 231230
GlobalTracer [candidate] (231.143 ms) : 0, 231143
IAST [baseline] (28.578 ms) : 0, 28578
IAST [candidate] (27.541 ms) : 0, 27541
AppSec [baseline] (50.592 ms) : 0, 50592
AppSec [candidate] (51.224 ms) : 0, 51224
Debugger [baseline] (5.951 ms) : 0, 5951
Debugger [candidate] (5.921 ms) : 0, 5921
Remote Config [baseline] (583.641 µs) : 0, 584
Remote Config [candidate] (595.896 µs) : 0, 596
Telemetry [baseline] (7.905 ms) : 0, 7905
Telemetry [candidate] (7.862 ms) : 0, 7862
section profiling
BytebuddyAgent [baseline] (676.359 ms) : 0, 676359
BytebuddyAgent [candidate] (672.392 ms) : 0, 672392
GlobalTracer [baseline] (361.262 ms) : 0, 361262
GlobalTracer [candidate] (374.49 ms) : 0, 374490
AppSec [baseline] (62.277 ms) : 0, 62277
AppSec [candidate] (62.434 ms) : 0, 62434
Debugger [baseline] (6.337 ms) : 0, 6337
Debugger [candidate] (6.369 ms) : 0, 6369
Remote Config [baseline] (662.692 µs) : 0, 663
Remote Config [candidate] (683.124 µs) : 0, 683
Telemetry [baseline] (8.268 ms) : 0, 8268
Telemetry [candidate] (8.297 ms) : 0, 8297
ProfilingAgent [baseline] (103.345 ms) : 0, 103345
ProfilingAgent [candidate] (103.687 ms) : 0, 103687
Profiling [baseline] (103.37 ms) : 0, 103370
Profiling [candidate] (103.711 ms) : 0, 103711
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-05-22T08:24:34 2025-05-22T08:32:18
git_branch master daniel.mohedano/junit5-execution-request-fix
git_commit_date 1747901310 1747901594
git_commit_sha 8e7b515 a08d100
release_version 1.50.0-SNAPSHOT~8e7b515c37 1.50.0-SNAPSHOT~a08d1007c4
start_time 2025-05-22T08:24:20 2025-05-22T08:32:04
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1747903136 1747903136
ci_job_id 949570564 949570564
ci_pipeline_id 65823270 65823270
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-wra86y3r-project-304-concurrent-4-wxub48iv 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-wra86y3r-project-304-concurrent-4-wxub48iv 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~a08d1007c4, baseline=1.50.0-SNAPSHOT~8e7b515c37
    dateFormat X
    axisFormat %s
section baseline
no_agent (385.543 µs) : 364, 408
.   : milestone, 386,
iast (518.06 µs) : 496, 540
.   : milestone, 518,
iast_FULL (735.202 µs) : 713, 757
.   : milestone, 735,
iast_GLOBAL (580.782 µs) : 558, 604
.   : milestone, 581,
iast_HARDCODED_SECRET_DISABLED (515.04 µs) : 492, 538
.   : milestone, 515,
iast_INACTIVE (473.895 µs) : 449, 499
.   : milestone, 474,
iast_TELEMETRY_OFF (507.04 µs) : 484, 530
.   : milestone, 507,
tracing (459.08 µs) : 437, 481
.   : milestone, 459,
section candidate
no_agent (376.322 µs) : 356, 396
.   : milestone, 376,
iast (521.832 µs) : 500, 543
.   : milestone, 522,
iast_FULL (732.4 µs) : 710, 754
.   : milestone, 732,
iast_GLOBAL (569.757 µs) : 548, 592
.   : milestone, 570,
iast_HARDCODED_SECRET_DISABLED (517.52 µs) : 495, 540
.   : milestone, 518,
iast_INACTIVE (466.902 µs) : 444, 489
.   : milestone, 467,
iast_TELEMETRY_OFF (512.128 µs) : 489, 535
.   : milestone, 512,
tracing (457.373 µs) : 435, 479
.   : milestone, 457,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 385.543 µs [363.569 µs, 407.518 µs] -
iast 518.06 µs [496.089 µs, 540.032 µs] 132.517 µs (34.4%)
iast_FULL 735.202 µs [713.387 µs, 757.017 µs] 349.659 µs (90.7%)
iast_GLOBAL 580.782 µs [557.962 µs, 603.602 µs] 195.239 µs (50.6%)
iast_HARDCODED_SECRET_DISABLED 515.04 µs [491.809 µs, 538.271 µs] 129.496 µs (33.6%)
iast_INACTIVE 473.895 µs [448.965 µs, 498.824 µs] 88.351 µs (22.9%)
iast_TELEMETRY_OFF 507.04 µs [484.117 µs, 529.963 µs] 121.496 µs (31.5%)
tracing 459.08 µs [436.861 µs, 481.299 µs] 73.537 µs (19.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 376.322 µs [356.343 µs, 396.301 µs] -
iast 521.832 µs [500.172 µs, 543.492 µs] 145.51 µs (38.7%)
iast_FULL 732.4 µs [710.348 µs, 754.452 µs] 356.077 µs (94.6%)
iast_GLOBAL 569.757 µs [547.752 µs, 591.762 µs] 193.435 µs (51.4%)
iast_HARDCODED_SECRET_DISABLED 517.52 µs [494.859 µs, 540.182 µs] 141.198 µs (37.5%)
iast_INACTIVE 466.902 µs [444.461 µs, 489.343 µs] 90.58 µs (24.1%)
iast_TELEMETRY_OFF 512.128 µs [489.286 µs, 534.97 µs] 135.806 µs (36.1%)
tracing 457.373 µs [435.264 µs, 479.482 µs] 81.05 µs (21.5%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~a08d1007c4, baseline=1.50.0-SNAPSHOT~8e7b515c37
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.354 ms) : 1334, 1373
.   : milestone, 1354,
appsec (1.731 ms) : 1708, 1755
.   : milestone, 1731,
appsec_no_iast (1.719 ms) : 1695, 1743
.   : milestone, 1719,
code_origins (1.657 ms) : 1630, 1684
.   : milestone, 1657,
iast (1.51 ms) : 1485, 1534
.   : milestone, 1510,
profiling (1.51 ms) : 1486, 1535
.   : milestone, 1510,
tracing (1.497 ms) : 1474, 1520
.   : milestone, 1497,
section candidate
no_agent (1.334 ms) : 1316, 1353
.   : milestone, 1334,
appsec (1.737 ms) : 1713, 1760
.   : milestone, 1737,
appsec_no_iast (1.734 ms) : 1711, 1758
.   : milestone, 1734,
code_origins (1.669 ms) : 1641, 1696
.   : milestone, 1669,
iast (1.51 ms) : 1484, 1535
.   : milestone, 1510,
profiling (1.505 ms) : 1481, 1529
.   : milestone, 1505,
tracing (1.494 ms) : 1470, 1519
.   : milestone, 1494,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.354 ms [1.334 ms, 1.373 ms] -
appsec 1.731 ms [1.708 ms, 1.755 ms] 377.705 µs (27.9%)
appsec_no_iast 1.719 ms [1.695 ms, 1.743 ms] 365.397 µs (27.0%)
code_origins 1.657 ms [1.63 ms, 1.684 ms] 303.549 µs (22.4%)
iast 1.51 ms [1.485 ms, 1.534 ms] 156.185 µs (11.5%)
profiling 1.51 ms [1.486 ms, 1.535 ms] 156.612 µs (11.6%)
tracing 1.497 ms [1.474 ms, 1.52 ms] 143.453 µs (10.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.334 ms [1.316 ms, 1.353 ms] -
appsec 1.737 ms [1.713 ms, 1.76 ms] 402.169 µs (30.1%)
appsec_no_iast 1.734 ms [1.711 ms, 1.758 ms] 400.01 µs (30.0%)
code_origins 1.669 ms [1.641 ms, 1.696 ms] 334.084 µs (25.0%)
iast 1.51 ms [1.484 ms, 1.535 ms] 175.343 µs (13.1%)
profiling 1.505 ms [1.481 ms, 1.529 ms] 170.313 µs (12.8%)
tracing 1.494 ms [1.47 ms, 1.519 ms] 159.812 µs (12.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/junit5-execution-request-fix
git_commit_date 1747901310 1747901594
git_commit_sha 8e7b515 a08d100
release_version 1.50.0-SNAPSHOT~8e7b515c37 1.50.0-SNAPSHOT~a08d1007c4
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1747903698 1747903698
ci_job_id 949570565 949570565
ci_pipeline_id 65823270 65823270
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner--hkbl4tc-project-304-concurrent-3-l8z22qq4 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner--hkbl4tc-project-304-concurrent-3-l8z22qq4 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~a08d1007c4, baseline=1.50.0-SNAPSHOT~8e7b515c37
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.561 s) : 15561000, 15561000
.   : milestone, 15561000,
appsec (14.92 s) : 14920000, 14920000
.   : milestone, 14920000,
iast (18.59 s) : 18590000, 18590000
.   : milestone, 18590000,
iast_GLOBAL (18.11 s) : 18110000, 18110000
.   : milestone, 18110000,
profiling (14.846 s) : 14846000, 14846000
.   : milestone, 14846000,
tracing (15.069 s) : 15069000, 15069000
.   : milestone, 15069000,
section candidate
no_agent (15.235 s) : 15235000, 15235000
.   : milestone, 15235000,
appsec (14.993 s) : 14993000, 14993000
.   : milestone, 14993000,
iast (18.808 s) : 18808000, 18808000
.   : milestone, 18808000,
iast_GLOBAL (18.133 s) : 18133000, 18133000
.   : milestone, 18133000,
profiling (15.668 s) : 15668000, 15668000
.   : milestone, 15668000,
tracing (14.869 s) : 14869000, 14869000
.   : milestone, 14869000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.561 s [15.561 s, 15.561 s] -
appsec 14.92 s [14.92 s, 14.92 s] -641.0 ms (-4.1%)
iast 18.59 s [18.59 s, 18.59 s] 3.029 s (19.5%)
iast_GLOBAL 18.11 s [18.11 s, 18.11 s] 2.549 s (16.4%)
profiling 14.846 s [14.846 s, 14.846 s] -715.0 ms (-4.6%)
tracing 15.069 s [15.069 s, 15.069 s] -492.0 ms (-3.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.235 s [15.235 s, 15.235 s] -
appsec 14.993 s [14.993 s, 14.993 s] -242.0 ms (-1.6%)
iast 18.808 s [18.808 s, 18.808 s] 3.573 s (23.5%)
iast_GLOBAL 18.133 s [18.133 s, 18.133 s] 2.898 s (19.0%)
profiling 15.668 s [15.668 s, 15.668 s] 433.0 ms (2.8%)
tracing 14.869 s [14.869 s, 14.869 s] -366.0 ms (-2.4%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~a08d1007c4, baseline=1.50.0-SNAPSHOT~8e7b515c37
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (2.387 ms) : 2339, 2435
.   : milestone, 2387,
iast (2.176 ms) : 2115, 2237
.   : milestone, 2176,
iast_GLOBAL (2.214 ms) : 2152, 2275
.   : milestone, 2214,
profiling (2.039 ms) : 1990, 2089
.   : milestone, 2039,
tracing (1.999 ms) : 1952, 2046
.   : milestone, 1999,
section candidate
no_agent (1.472 ms) : 1460, 1483
.   : milestone, 1472,
appsec (2.398 ms) : 2349, 2447
.   : milestone, 2398,
iast (2.174 ms) : 2113, 2235
.   : milestone, 2174,
iast_GLOBAL (2.215 ms) : 2154, 2276
.   : milestone, 2215,
profiling (2.032 ms) : 1983, 2082
.   : milestone, 2032,
tracing (2.002 ms) : 1955, 2049
.   : milestone, 2002,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 2.387 ms [2.339 ms, 2.435 ms] 910.935 µs (61.7%)
iast 2.176 ms [2.115 ms, 2.237 ms] 699.937 µs (47.4%)
iast_GLOBAL 2.214 ms [2.152 ms, 2.275 ms] 737.267 µs (49.9%)
profiling 2.039 ms [1.99 ms, 2.089 ms] 563.163 µs (38.1%)
tracing 1.999 ms [1.952 ms, 2.046 ms] 522.924 µs (35.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.46 ms, 1.483 ms] -
appsec 2.398 ms [2.349 ms, 2.447 ms] 926.364 µs (62.9%)
iast 2.174 ms [2.113 ms, 2.235 ms] 702.263 µs (47.7%)
iast_GLOBAL 2.215 ms [2.154 ms, 2.276 ms] 743.166 µs (50.5%)
profiling 2.032 ms [1.983 ms, 2.082 ms] 560.414 µs (38.1%)
tracing 2.002 ms [1.955 ms, 2.049 ms] 529.885 µs (36.0%)

@daniel-mohedano daniel-mohedano marked this pull request as ready for review May 22, 2025 09:27
@daniel-mohedano daniel-mohedano requested a review from a team as a code owner May 22, 2025 09:27
@daniel-mohedano daniel-mohedano merged commit 35cbdee into master May 22, 2025
794 of 797 checks passed
@daniel-mohedano daniel-mohedano deleted the daniel.mohedano/junit5-execution-request-fix branch May 22, 2025 10:52
@github-actions github-actions bot added this to the 1.50.0 milestone May 22, 2025
@daniel-mohedano daniel-mohedano mentioned this pull request May 23, 2025
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@nikita-tkachenko-datadog nikita-tkachenko-datadog nikita-tkachenko-datadog approved these changes

Assignees
No one assigned
Labels
comp: ci visibility Continuous Integration Visibility type: enhancement
Projects
None yet
Milestone
1.50.0
Development

Successfully merging this pull request may close these issues.
2 participants
@daniel-mohedano @nikita-tkachenko-datadog