Skip to content

Add system tests check job to add as PR checks #9007

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 2 commits into from
Jun 19, 2025
Merged

Add system tests check job to add as PR checks #9007

merged 2 commits into from
Jun 19, 2025
+8 −44

Conversation

PerfectSlayer
Copy link
Contributor

@PerfectSlayer PerfectSlayer commented Jun 19, 2025 •
edited
Loading

What Does This Do

This PR adds a job to ensure that system tests matrix jobs are run to completion.
It also removes the all green pipeline as all checks are now handled by GitHub + GitLab / default-pipeline.

Motivation

This job will be used as PR check requirements to required system tests passing.

Additional Notes

The solution was recommended by @cbeauchesne and @randomanderson

Contributor Checklist

Jira ticket: LANGPLAT-534

@PerfectSlayer PerfectSlayer added type: enhancement tag: no release notes Changes to exclude from release notes labels Jun 19, 2025
@PerfectSlayer PerfectSlayer requested a review from a team as a code owner June 19, 2025 04:22
@PerfectSlayer PerfectSlayer added the comp: tooling Build & Tooling label Jun 19, 2025
@PerfectSlayer PerfectSlayer requested review from dougqh and removed request for a team June 19, 2025 04:22
@PerfectSlayer PerfectSlayer changed the title Add system tests check job to add in PR checks Add system tests check job to add as PR checks Jun 19, 2025
@pr-commenter
Copy link

pr-commenter bot commented Jun 19, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci
git_commit_date 1750259064 1750313141
git_commit_sha 712d5c3 bb7fc4d
release_version 1.50.0-SNAPSHOT~712d5c320e 1.50.0-SNAPSHOT~bb7fc4de78
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1750314962 1750314962
ci_job_id 989431258 989431258
ci_pipeline_id 68196211 68196211
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-ecr1ksdw-project-304-concurrent-0-t2t75ve7 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-ecr1ksdw-project-304-concurrent-0-t2t75ve7 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 44 metrics, 9 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~bb7fc4de78, baseline=1.50.0-SNAPSHOT~712d5c320e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.027 s) : 0, 1027469
Total [baseline] (8.542 s) : 0, 8542087
Agent [candidate] (1.028 s) : 0, 1027813
Total [candidate] (8.567 s) : 0, 8567148
section iast
Agent [baseline] (1.159 s) : 0, 1159069
Total [baseline] (9.259 s) : 0, 9258509
Agent [candidate] (1.156 s) : 0, 1156213
Total [candidate] (9.252 s) : 0, 9251661
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.027 s -
Agent iast 1.159 s 131.601 ms (12.8%)
Total tracing 8.542 s -
Total iast 9.259 s 716.422 ms (8.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.028 s -
Agent iast 1.156 s 128.4 ms (12.5%)
Total tracing 8.567 s -
Total iast 9.252 s 684.513 ms (8.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~bb7fc4de78, baseline=1.50.0-SNAPSHOT~712d5c320e

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (684.844 ms) : 0, 684844
BytebuddyAgent [candidate] (684.707 ms) : 0, 684707
GlobalTracer [baseline] (241.76 ms) : 0, 241760
GlobalTracer [candidate] (241.432 ms) : 0, 241432
AppSec [baseline] (59.786 ms) : 0, 59786
AppSec [candidate] (59.174 ms) : 0, 59174
Debugger [baseline] (6.111 ms) : 0, 6111
Debugger [candidate] (6.2 ms) : 0, 6200
Remote Config [baseline] (746.718 µs) : 0, 747
Remote Config [candidate] (742.529 µs) : 0, 743
Telemetry [baseline] (10.69 ms) : 0, 10690
Telemetry [candidate] (12.025 ms) : 0, 12025
section iast
BytebuddyAgent [baseline] (808.19 ms) : 0, 808190
BytebuddyAgent [candidate] (803.944 ms) : 0, 803944
GlobalTracer [baseline] (231.881 ms) : 0, 231881
GlobalTracer [candidate] (231.86 ms) : 0, 231860
IAST [baseline] (26.648 ms) : 0, 26648
IAST [candidate] (27.812 ms) : 0, 27812
AppSec [baseline] (54.372 ms) : 0, 54372
AppSec [candidate] (54.453 ms) : 0, 54453
Debugger [baseline] (5.951 ms) : 0, 5951
Debugger [candidate] (6.03 ms) : 0, 6030
Remote Config [baseline] (587.667 µs) : 0, 588
Remote Config [candidate] (593.129 µs) : 0, 593
Telemetry [baseline] (7.95 ms) : 0, 7950
Telemetry [candidate] (8.059 ms) : 0, 8059
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~bb7fc4de78, baseline=1.50.0-SNAPSHOT~712d5c320e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.03 s) : 0, 1029562
Total [baseline] (10.628 s) : 0, 10627758
Agent [candidate] (1.044 s) : 0, 1044414
Total [candidate] (10.65 s) : 0, 10650054
section appsec
Agent [baseline] (1.18 s) : 0, 1180151
Total [baseline] (10.803 s) : 0, 10802799
Agent [candidate] (1.18 s) : 0, 1179681
Total [candidate] (10.806 s) : 0, 10805831
section iast
Agent [baseline] (1.157 s) : 0, 1157302
Total [baseline] (10.955 s) : 0, 10954914
Agent [candidate] (1.165 s) : 0, 1165159
Total [candidate] (11.088 s) : 0, 11087509
section profiling
Agent [baseline] (1.277 s) : 0, 1277425
Total [baseline] (11.044 s) : 0, 11044288
Agent [candidate] (1.295 s) : 0, 1295412
Total [candidate] (11.032 s) : 0, 11032409
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.03 s -
Agent appsec 1.18 s 150.589 ms (14.6%)
Agent iast 1.157 s 127.74 ms (12.4%)
Agent profiling 1.277 s 247.863 ms (24.1%)
Total tracing 10.628 s -
Total appsec 10.803 s 175.04 ms (1.6%)
Total iast 10.955 s 327.156 ms (3.1%)
Total profiling 11.044 s 416.53 ms (3.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.044 s -
Agent appsec 1.18 s 135.267 ms (13.0%)
Agent iast 1.165 s 120.746 ms (11.6%)
Agent profiling 1.295 s 250.998 ms (24.0%)
Total tracing 10.65 s -
Total appsec 10.806 s 155.776 ms (1.5%)
Total iast 11.088 s 437.454 ms (4.1%)
Total profiling 11.032 s 382.354 ms (3.6%) 
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~bb7fc4de78, baseline=1.50.0-SNAPSHOT~712d5c320e

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (685.135 ms) : 0, 685135
BytebuddyAgent [candidate] (695.186 ms) : 0, 695186
GlobalTracer [baseline] (241.837 ms) : 0, 241837
GlobalTracer [candidate] (244.886 ms) : 0, 244886
AppSec [baseline] (59.388 ms) : 0, 59388
AppSec [candidate] (61.291 ms) : 0, 61291
Debugger [baseline] (7.686 ms) : 0, 7686
Debugger [candidate] (7.044 ms) : 0, 7044
Remote Config [baseline] (727.403 µs) : 0, 727
Remote Config [candidate] (735.045 µs) : 0, 735
Telemetry [baseline] (11.232 ms) : 0, 11232
Telemetry [candidate] (11.461 ms) : 0, 11461
section appsec
BytebuddyAgent [baseline] (706.906 ms) : 0, 706906
BytebuddyAgent [candidate] (706.275 ms) : 0, 706275
GlobalTracer [baseline] (235.365 ms) : 0, 235365
GlobalTracer [candidate] (234.937 ms) : 0, 234937
IAST [baseline] (21.815 ms) : 0, 21815
IAST [candidate] (21.851 ms) : 0, 21851
AppSec [baseline] (178.821 ms) : 0, 178821
AppSec [candidate] (179.409 ms) : 0, 179409
Debugger [baseline] (5.891 ms) : 0, 5891
Debugger [candidate] (5.852 ms) : 0, 5852
Remote Config [baseline] (601.034 µs) : 0, 601
Remote Config [candidate] (608.093 µs) : 0, 608
Telemetry [baseline] (7.313 ms) : 0, 7313
Telemetry [candidate] (7.254 ms) : 0, 7254
section iast
BytebuddyAgent [baseline] (805.795 ms) : 0, 805795
BytebuddyAgent [candidate] (811.32 ms) : 0, 811320
GlobalTracer [baseline] (231.528 ms) : 0, 231528
GlobalTracer [candidate] (233.154 ms) : 0, 233154
IAST [baseline] (28.232 ms) : 0, 28232
IAST [candidate] (27.104 ms) : 0, 27104
AppSec [baseline] (53.506 ms) : 0, 53506
AppSec [candidate] (55.339 ms) : 0, 55339
Debugger [baseline] (6.061 ms) : 0, 6061
Debugger [candidate] (6.06 ms) : 0, 6060
Remote Config [baseline] (604.306 µs) : 0, 604
Remote Config [candidate] (599.832 µs) : 0, 600
Telemetry [baseline] (7.987 ms) : 0, 7987
Telemetry [candidate] (7.973 ms) : 0, 7973
section profiling
BytebuddyAgent [baseline] (675.876 ms) : 0, 675876
BytebuddyAgent [candidate] (689.568 ms) : 0, 689568
GlobalTracer [baseline] (361.393 ms) : 0, 361393
GlobalTracer [candidate] (364.778 ms) : 0, 364778
AppSec [baseline] (65.385 ms) : 0, 65385
AppSec [candidate] (64.921 ms) : 0, 64921
Debugger [baseline] (6.295 ms) : 0, 6295
Debugger [candidate] (6.274 ms) : 0, 6274
Remote Config [baseline] (662.581 µs) : 0, 663
Remote Config [candidate] (670.177 µs) : 0, 670
Telemetry [baseline] (8.376 ms) : 0, 8376
Telemetry [candidate] (8.257 ms) : 0, 8257
ProfilingAgent [baseline] (108.592 ms) : 0, 108592
ProfilingAgent [candidate] (109.103 ms) : 0, 109103
Profiling [baseline] (108.617 ms) : 0, 108617
Profiling [candidate] (109.128 ms) : 0, 109128
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci
git_commit_date 1750259064 1750313141
git_commit_sha 712d5c3 bb7fc4d
release_version 1.50.0-SNAPSHOT~712d5c320e 1.50.0-SNAPSHOT~bb7fc4de78
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1750314715 1750314715
ci_job_id 989431259 989431259
ci_pipeline_id 68196211 68196211
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-5mx9dmj-project-304-concurrent-0-s1dt5o29 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-5mx9dmj-project-304-concurrent-0-s1dt5o29 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 0 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:tracing:high_load better
[-564.127µs; -337.790µs] or [-7.227%; -4.327%]		 unstable
[-35.184op/s; +107.372op/s] or [-5.930%; +18.096%]		 7.355ms 629.438op/s 7.806ms 593.344op/s
scenario:load:insecure-bank:profiling:high_load better
[-859.486µs; -551.472µs] or [-9.565%; -6.137%]		 unstable
[-20.496op/s; +107.496op/s] or [-3.969%; +20.818%]		 8.280ms 559.875op/s 8.986ms 516.375op/s
scenario:load:petclinic:no_agent:high_load better
[-1.827ms; -1.195ms] or [-4.852%; -3.174%]		 unstable
[-3.538op/s; +13.863op/s] or [-2.849%; +11.165%]		 36.145ms 129.325op/s 37.657ms 124.162op/s
scenario:load:petclinic:code_origins:high_load better
[-1.803ms; -0.982ms] or [-3.855%; -2.099%]		 unstable
[-4.060op/s; +10.285op/s] or [-4.059%; +10.283%]		 45.376ms 103.138op/s 46.768ms 100.025op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~bb7fc4de78, baseline=1.50.0-SNAPSHOT~712d5c320e
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.657 ms) : 37358, 37955
.   : milestone, 37657,
appsec (49.528 ms) : 49096, 49959
.   : milestone, 49528,
code_origins (46.768 ms) : 46383, 47153
.   : milestone, 46768,
iast (42.605 ms) : 42248, 42962
.   : milestone, 42605,
profiling (47.351 ms) : 46923, 47779
.   : milestone, 47351,
tracing (43.367 ms) : 43003, 43731
.   : milestone, 43367,
section candidate
no_agent (36.145 ms) : 35857, 36434
.   : milestone, 36145,
appsec (48.766 ms) : 48335, 49196
.   : milestone, 48766,
code_origins (45.376 ms) : 44997, 45754
.   : milestone, 45376,
iast (43.229 ms) : 42859, 43599
.   : milestone, 43229,
profiling (47.978 ms) : 47537, 48419
.   : milestone, 47978,
tracing (43.706 ms) : 43350, 44063
.   : milestone, 43706,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.657 ms [37.358 ms, 37.955 ms] -
appsec 49.528 ms [49.096 ms, 49.959 ms] 11.871 ms (31.5%)
code_origins 46.768 ms [46.383 ms, 47.153 ms] 9.111 ms (24.2%)
iast 42.605 ms [42.248 ms, 42.962 ms] 4.948 ms (13.1%)
profiling 47.351 ms [46.923 ms, 47.779 ms] 9.694 ms (25.7%)
tracing 43.367 ms [43.003 ms, 43.731 ms] 5.711 ms (15.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.145 ms [35.857 ms, 36.434 ms] -
appsec 48.766 ms [48.335 ms, 49.196 ms] 12.62 ms (34.9%)
code_origins 45.376 ms [44.997 ms, 45.754 ms] 9.23 ms (25.5%)
iast 43.229 ms [42.859 ms, 43.599 ms] 7.084 ms (19.6%)
profiling 47.978 ms [47.537 ms, 48.419 ms] 11.833 ms (32.7%)
tracing 43.706 ms [43.35 ms, 44.063 ms] 7.561 ms (20.9%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~bb7fc4de78, baseline=1.50.0-SNAPSHOT~712d5c320e
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.238 ms) : 4188, 4287
.   : milestone, 4238,
iast (9.155 ms) : 9005, 9305
.   : milestone, 9155,
iast_FULL (13.643 ms) : 13376, 13911
.   : milestone, 13643,
iast_GLOBAL (9.781 ms) : 9600, 9961
.   : milestone, 9781,
profiling (8.986 ms) : 8827, 9144
.   : milestone, 8986,
tracing (7.806 ms) : 7697, 7915
.   : milestone, 7806,
section candidate
no_agent (4.155 ms) : 4110, 4200
.   : milestone, 4155,
iast (9.178 ms) : 9029, 9327
.   : milestone, 9178,
iast_FULL (14.044 ms) : 13765, 14322
.   : milestone, 14044,
iast_GLOBAL (9.804 ms) : 9635, 9972
.   : milestone, 9804,
profiling (8.28 ms) : 8155, 8406
.   : milestone, 8280,
tracing (7.355 ms) : 7254, 7456
.   : milestone, 7355,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.238 ms [4.188 ms, 4.287 ms] -
iast 9.155 ms [9.005 ms, 9.305 ms] 4.917 ms (116.0%)
iast_FULL 13.643 ms [13.376 ms, 13.911 ms] 9.406 ms (222.0%)
iast_GLOBAL 9.781 ms [9.6 ms, 9.961 ms] 5.543 ms (130.8%)
profiling 8.986 ms [8.827 ms, 9.144 ms] 4.748 ms (112.1%)
tracing 7.806 ms [7.697 ms, 7.915 ms] 3.568 ms (84.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.155 ms [4.11 ms, 4.2 ms] -
iast 9.178 ms [9.029 ms, 9.327 ms] 5.023 ms (120.9%)
iast_FULL 14.044 ms [13.765 ms, 14.322 ms] 9.888 ms (238.0%)
iast_GLOBAL 9.804 ms [9.635 ms, 9.972 ms] 5.649 ms (135.9%)
profiling 8.28 ms [8.155 ms, 8.406 ms] 4.125 ms (99.3%)
tracing 7.355 ms [7.254 ms, 7.456 ms] 3.2 ms (77.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci
git_commit_date 1750259064 1750313141
git_commit_sha 712d5c3 bb7fc4d
release_version 1.50.0-SNAPSHOT~712d5c320e 1.50.0-SNAPSHOT~bb7fc4de78
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1750315203 1750315203
ci_job_id 989431260 989431260
ci_pipeline_id 68196211 68196211
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-9fhc4bx7-project-304-concurrent-0-6c7noo3v 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-9fhc4bx7-project-304-concurrent-0-6c7noo3v 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~bb7fc4de78, baseline=1.50.0-SNAPSHOT~712d5c320e
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.614 s) : 15614000, 15614000
.   : milestone, 15614000,
appsec (14.917 s) : 14917000, 14917000
.   : milestone, 14917000,
iast (18.594 s) : 18594000, 18594000
.   : milestone, 18594000,
iast_GLOBAL (18.048 s) : 18048000, 18048000
.   : milestone, 18048000,
profiling (15.311 s) : 15311000, 15311000
.   : milestone, 15311000,
tracing (15.1 s) : 15100000, 15100000
.   : milestone, 15100000,
section candidate
no_agent (15.069 s) : 15069000, 15069000
.   : milestone, 15069000,
appsec (14.676 s) : 14676000, 14676000
.   : milestone, 14676000,
iast (18.5 s) : 18500000, 18500000
.   : milestone, 18500000,
iast_GLOBAL (17.957 s) : 17957000, 17957000
.   : milestone, 17957000,
profiling (15.097 s) : 15097000, 15097000
.   : milestone, 15097000,
tracing (15.026 s) : 15026000, 15026000
.   : milestone, 15026000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.614 s [15.614 s, 15.614 s] -
appsec 14.917 s [14.917 s, 14.917 s] -697.0 ms (-4.5%)
iast 18.594 s [18.594 s, 18.594 s] 2.98 s (19.1%)
iast_GLOBAL 18.048 s [18.048 s, 18.048 s] 2.434 s (15.6%)
profiling 15.311 s [15.311 s, 15.311 s] -303.0 ms (-1.9%)
tracing 15.1 s [15.1 s, 15.1 s] -514.0 ms (-3.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.069 s [15.069 s, 15.069 s] -
appsec 14.676 s [14.676 s, 14.676 s] -393.0 ms (-2.6%)
iast 18.5 s [18.5 s, 18.5 s] 3.431 s (22.8%)
iast_GLOBAL 17.957 s [17.957 s, 17.957 s] 2.888 s (19.2%)
profiling 15.097 s [15.097 s, 15.097 s] 28.0 ms (0.2%)
tracing 15.026 s [15.026 s, 15.026 s] -43.0 ms (-0.3%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~bb7fc4de78, baseline=1.50.0-SNAPSHOT~712d5c320e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.48 ms) : 1469, 1492
.   : milestone, 1480,
appsec (2.421 ms) : 2372, 2470
.   : milestone, 2421,
iast (2.196 ms) : 2135, 2258
.   : milestone, 2196,
iast_GLOBAL (2.237 ms) : 2175, 2299
.   : milestone, 2237,
profiling (2.041 ms) : 1991, 2091
.   : milestone, 2041,
tracing (2.013 ms) : 1966, 2061
.   : milestone, 2013,
section candidate
no_agent (1.486 ms) : 1474, 1498
.   : milestone, 1486,
appsec (2.412 ms) : 2363, 2460
.   : milestone, 2412,
iast (2.204 ms) : 2143, 2266
.   : milestone, 2204,
iast_GLOBAL (2.251 ms) : 2189, 2313
.   : milestone, 2251,
profiling (2.061 ms) : 2010, 2112
.   : milestone, 2061,
tracing (2.017 ms) : 1970, 2064
.   : milestone, 2017,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.469 ms, 1.492 ms] -
appsec 2.421 ms [2.372 ms, 2.47 ms] 940.479 µs (63.5%)
iast 2.196 ms [2.135 ms, 2.258 ms] 715.886 µs (48.4%)
iast_GLOBAL 2.237 ms [2.175 ms, 2.299 ms] 756.563 µs (51.1%)
profiling 2.041 ms [1.991 ms, 2.091 ms] 560.963 µs (37.9%)
tracing 2.013 ms [1.966 ms, 2.061 ms] 533.076 µs (36.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.486 ms [1.474 ms, 1.498 ms] -
appsec 2.412 ms [2.363 ms, 2.46 ms] 925.443 µs (62.3%)
iast 2.204 ms [2.143 ms, 2.266 ms] 718.422 µs (48.3%)
iast_GLOBAL 2.251 ms [2.189 ms, 2.313 ms] 764.733 µs (51.5%)
profiling 2.061 ms [2.01 ms, 2.112 ms] 574.892 µs (38.7%)
tracing 2.017 ms [1.97 ms, 2.064 ms] 530.928 µs (35.7%)

@PerfectSlayer PerfectSlayer merged commit a7ce6e7 into master Jun 19, 2025
484 checks passed
@PerfectSlayer PerfectSlayer deleted the bbujon/ci branch June 19, 2025 08:57
@github-actions github-actions bot added this to the 1.50.0 milestone Jun 19, 2025
@PerfectSlayer PerfectSlayer mentioned this pull request Jun 19, 2025
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@amarziali amarziali amarziali approved these changes

@cbeauchesne cbeauchesne cbeauchesne approved these changes

@dougqh dougqh Awaiting requested review from dougqh dougqh is a code owner automatically assigned from DataDog/apm-lang-platform-java

Assignees
No one assigned
Labels
comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: enhancement
Projects
None yet
Milestone
1.50.0
Development

Successfully merging this pull request may close these issues.
3 participants
@PerfectSlayer @amarziali @cbeauchesne