Skip to content

Add springboot smoke tests for the open feature SDK #9961

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 2 commits into
base: malvarez/open-feature-sdk
Choose a base branch
from
Open

Add springboot smoke tests for the open feature SDK #9961

wants to merge 2 commits into from

Conversation

@manuel-alvarez-alvarez
Copy link
Member

@manuel-alvarez-alvarez manuel-alvarez-alvarez commented Nov 14, 2025 •
edited
Loading

What Does This Do

Adds smoke tests for the OpenFeature Java provider (PR)

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk-smoke branch from 6fcda55 to 188fdc6 Compare November 14, 2025 04:42
@manuel-alvarez-alvarez manuel-alvarez-alvarez mentioned this pull request Nov 14, 2025
Open
@manuel-alvarez-alvarez manuel-alvarez-alvarez marked this pull request as ready for review November 14, 2025 04:43
@manuel-alvarez-alvarez manuel-alvarez-alvarez requested review from AlexeyKuznetsov-DD and smola and removed request for a team November 14, 2025 04:43
@manuel-alvarez-alvarez manuel-alvarez-alvarez mentioned this pull request Nov 14, 2025
Closed
@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk-smoke branch from 188fdc6 to de1816f Compare November 14, 2025 04:45
@pr-commenter
Copy link

pr-commenter bot commented Nov 14, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/open-feature-sdk-smoke
git_commit_date 1763128431 1763336603
git_commit_sha b436de8 5fbc4da
release_version 1.56.0-SNAPSHOT~b436de808f 1.56.0-SNAPSHOT~5fbc4da0a1
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763338451 1763338451
ci_job_id 1237934819 1237934819
ci_pipeline_id 82632839 82632839
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-winkgrvm 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-winkgrvm 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 5 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:tracing:Remote Config better
[-73.805µs; -13.620µs] or [-11.149%; -2.057%]		 618.251µs 661.964µs
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~5fbc4da0a1, baseline=1.56.0-SNAPSHOT~b436de808f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.104 s) : 0, 1103896
Total [baseline] (10.789 s) : 0, 10788891
Agent [candidate] (1.099 s) : 0, 1099250
Total [candidate] (10.712 s) : 0, 10711602
section appsec
Agent [baseline] (1.286 s) : 0, 1285870
Total [baseline] (11.033 s) : 0, 11033446
Agent [candidate] (1.279 s) : 0, 1278574
Total [candidate] (10.982 s) : 0, 10982311
section iast
Agent [baseline] (1.246 s) : 0, 1245637
Total [baseline] (11.235 s) : 0, 11234605
Agent [candidate] (1.24 s) : 0, 1240032
Total [candidate] (11.176 s) : 0, 11176354
section profiling
Agent [baseline] (1.234 s) : 0, 1233594
Total [baseline] (11.043 s) : 0, 11043492
Agent [candidate] (1.233 s) : 0, 1232908
Total [candidate] (11.075 s) : 0, 11074711
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.104 s -
Agent appsec 1.286 s 181.974 ms (16.5%)
Agent iast 1.246 s 141.742 ms (12.8%)
Agent profiling 1.234 s 129.698 ms (11.7%)
Total tracing 10.789 s -
Total appsec 11.033 s 244.555 ms (2.3%)
Total iast 11.235 s 445.714 ms (4.1%)
Total profiling 11.043 s 254.601 ms (2.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.099 s -
Agent appsec 1.279 s 179.324 ms (16.3%)
Agent iast 1.24 s 140.782 ms (12.8%)
Agent profiling 1.233 s 133.658 ms (12.2%)
Total tracing 10.712 s -
Total appsec 10.982 s 270.709 ms (2.5%)
Total iast 11.176 s 464.752 ms (4.3%)
Total profiling 11.075 s 363.109 ms (3.4%) 
gantt
    title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~5fbc4da0a1, baseline=1.56.0-SNAPSHOT~b436de808f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.483 ms) : 0, 1483
crashtracking [candidate] (1.443 ms) : 0, 1443
BytebuddyAgent [baseline] (708.9 ms) : 0, 708900
BytebuddyAgent [candidate] (705.748 ms) : 0, 705748
GlobalTracer [baseline] (249.22 ms) : 0, 249220
GlobalTracer [candidate] (248.459 ms) : 0, 248459
AppSec [baseline] (32.5 ms) : 0, 32500
AppSec [candidate] (32.128 ms) : 0, 32128
Debugger [baseline] (64.307 ms) : 0, 64307
Debugger [candidate] (64.294 ms) : 0, 64294
Remote Config [baseline] (633.481 µs) : 0, 633
Remote Config [candidate] (631.301 µs) : 0, 631
Telemetry [baseline] (8.207 ms) : 0, 8207
Telemetry [candidate] (8.209 ms) : 0, 8209
Flare Poller [baseline] (3.715 ms) : 0, 3715
Flare Poller [candidate] (3.672 ms) : 0, 3672
section appsec
crashtracking [baseline] (1.461 ms) : 0, 1461
crashtracking [candidate] (1.451 ms) : 0, 1451
BytebuddyAgent [baseline] (734.528 ms) : 0, 734528
BytebuddyAgent [candidate] (730.142 ms) : 0, 730142
GlobalTracer [baseline] (241.988 ms) : 0, 241988
GlobalTracer [candidate] (240.875 ms) : 0, 240875
AppSec [baseline] (174.301 ms) : 0, 174301
AppSec [candidate] (173.236 ms) : 0, 173236
Debugger [baseline] (60.708 ms) : 0, 60708
Debugger [candidate] (60.543 ms) : 0, 60543
Remote Config [baseline] (654.718 µs) : 0, 655
Remote Config [candidate] (730.03 µs) : 0, 730
Telemetry [baseline] (8.236 ms) : 0, 8236
Telemetry [candidate] (8.175 ms) : 0, 8175
Flare Poller [baseline] (3.803 ms) : 0, 3803
Flare Poller [candidate] (3.854 ms) : 0, 3854
IAST [baseline] (25.014 ms) : 0, 25014
IAST [candidate] (24.833 ms) : 0, 24833
section iast
crashtracking [baseline] (1.452 ms) : 0, 1452
crashtracking [candidate] (1.462 ms) : 0, 1462
BytebuddyAgent [baseline] (835.503 ms) : 0, 835503
BytebuddyAgent [candidate] (831.496 ms) : 0, 831496
GlobalTracer [baseline] (239.194 ms) : 0, 239194
GlobalTracer [candidate] (238.601 ms) : 0, 238601
AppSec [baseline] (29.544 ms) : 0, 29544
AppSec [candidate] (31.366 ms) : 0, 31366
Debugger [baseline] (61.228 ms) : 0, 61228
Debugger [candidate] (60.591 ms) : 0, 60591
Remote Config [baseline] (545.044 µs) : 0, 545
Remote Config [candidate] (533.196 µs) : 0, 533
Telemetry [baseline] (7.646 ms) : 0, 7646
Telemetry [candidate] (7.676 ms) : 0, 7676
Flare Poller [baseline] (3.503 ms) : 0, 3503
Flare Poller [candidate] (3.503 ms) : 0, 3503
IAST [baseline] (32.009 ms) : 0, 32009
IAST [candidate] (29.838 ms) : 0, 29838
section profiling
ProfilingAgent [baseline] (98.118 ms) : 0, 98118
ProfilingAgent [candidate] (96.737 ms) : 0, 96737
crashtracking [baseline] (1.448 ms) : 0, 1448
crashtracking [candidate] (1.443 ms) : 0, 1443
BytebuddyAgent [baseline] (733.203 ms) : 0, 733203
BytebuddyAgent [candidate] (733.727 ms) : 0, 733727
GlobalTracer [baseline] (222.838 ms) : 0, 222838
GlobalTracer [candidate] (223.43 ms) : 0, 223430
AppSec [baseline] (32.369 ms) : 0, 32369
AppSec [candidate] (32.448 ms) : 0, 32448
Debugger [baseline] (63.253 ms) : 0, 63253
Debugger [candidate] (62.94 ms) : 0, 62940
Remote Config [baseline] (650.742 µs) : 0, 651
Remote Config [candidate] (647.168 µs) : 0, 647
Telemetry [baseline] (8.066 ms) : 0, 8066
Telemetry [candidate] (7.937 ms) : 0, 7937
Flare Poller [baseline] (3.717 ms) : 0, 3717
Flare Poller [candidate] (3.733 ms) : 0, 3733
Profiling [baseline] (98.711 ms) : 0, 98711
Profiling [candidate] (97.324 ms) : 0, 97324
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~5fbc4da0a1, baseline=1.56.0-SNAPSHOT~b436de808f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.108 s) : 0, 1108012
Total [baseline] (8.828 s) : 0, 8827771
Agent [candidate] (1.096 s) : 0, 1095991
Total [candidate] (8.837 s) : 0, 8836716
section iast
Agent [baseline] (1.242 s) : 0, 1241731
Total [baseline] (9.542 s) : 0, 9542039
Agent [candidate] (1.242 s) : 0, 1242075
Total [candidate] (9.552 s) : 0, 9551531
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.108 s -
Agent iast 1.242 s 133.719 ms (12.1%)
Total tracing 8.828 s -
Total iast 9.542 s 714.268 ms (8.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.096 s -
Agent iast 1.242 s 146.084 ms (13.3%)
Total tracing 8.837 s -
Total iast 9.552 s 714.815 ms (8.1%) 
gantt
    title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~5fbc4da0a1, baseline=1.56.0-SNAPSHOT~b436de808f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.465 ms) : 0, 1465
crashtracking [candidate] (1.449 ms) : 0, 1449
BytebuddyAgent [baseline] (710.84 ms) : 0, 710840
BytebuddyAgent [candidate] (704.778 ms) : 0, 704778
GlobalTracer [baseline] (251.266 ms) : 0, 251266
GlobalTracer [candidate] (247.787 ms) : 0, 247787
AppSec [baseline] (32.827 ms) : 0, 32827
AppSec [candidate] (32.085 ms) : 0, 32085
Debugger [baseline] (63.976 ms) : 0, 63976
Debugger [candidate] (62.838 ms) : 0, 62838
Remote Config [baseline] (661.964 µs) : 0, 662
Remote Config [candidate] (618.251 µs) : 0, 618
Telemetry [baseline] (8.223 ms) : 0, 8223
Telemetry [candidate] (8.104 ms) : 0, 8104
Flare Poller [baseline] (3.753 ms) : 0, 3753
Flare Poller [candidate] (3.679 ms) : 0, 3679
section iast
crashtracking [baseline] (1.468 ms) : 0, 1468
crashtracking [candidate] (1.46 ms) : 0, 1460
BytebuddyAgent [baseline] (834.842 ms) : 0, 834842
BytebuddyAgent [candidate] (833.283 ms) : 0, 833283
GlobalTracer [baseline] (237.35 ms) : 0, 237350
GlobalTracer [candidate] (238.245 ms) : 0, 238245
IAST [baseline] (27.438 ms) : 0, 27438
IAST [candidate] (29.473 ms) : 0, 29473
AppSec [baseline] (34.049 ms) : 0, 34049
AppSec [candidate] (32.532 ms) : 0, 32532
Debugger [baseline] (59.919 ms) : 0, 59919
Debugger [candidate] (60.428 ms) : 0, 60428
Remote Config [baseline] (542.153 µs) : 0, 542
Remote Config [candidate] (545.303 µs) : 0, 545
Telemetry [baseline] (7.642 ms) : 0, 7642
Telemetry [candidate] (7.688 ms) : 0, 7688
Flare Poller [baseline] (3.5 ms) : 0, 3500
Flare Poller [candidate] (3.515 ms) : 0, 3515
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/open-feature-sdk-smoke
git_commit_date 1763128431 1763336603
git_commit_sha b436de8 5fbc4da
release_version 1.56.0-SNAPSHOT~b436de808f 1.56.0-SNAPSHOT~5fbc4da0a1
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763338853 1763338853
ci_job_id 1237934823 1237934823
ci_pipeline_id 82632839 82632839
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-ipyjrtoo 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-ipyjrtoo 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 16 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load better
[-254.864µs; -114.555µs] or [-13.933%; -6.263%]		 unstable
[-1.501ms; -0.602ms] or [-26.701%; -10.713%]		 unstable
[+103.251op/s; +592.562op/s] or [+5.397%; +30.975%]		 1.644ms 4.570ms 2260.969op/s 1.829ms 5.621ms 1913.062op/s
scenario:load:petclinic:profiling:high_load worse
[+0.596ms; +2.180ms] or [+3.246%; +11.868%]		 unstable
[+1.551ms; +4.659ms] or [+5.251%; +15.771%]		 unstable
[-42.240op/s; +10.928op/s] or [-16.898%; +4.372%]		 19.756ms 32.647ms 234.312op/s 18.368ms 29.542ms 249.969op/s
scenario:load:petclinic:no_agent:high_load worse
[+0.593ms; +2.055ms] or [+3.386%; +11.730%]		 unsure
[+0.364ms; +3.241ms] or [+1.236%; +11.013%]		 unstable
[-44.866op/s; +9.616op/s] or [-17.373%; +3.723%]		 18.841ms 31.228ms 240.625op/s 17.517ms 29.426ms 258.250op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~5fbc4da0a1, baseline=1.56.0-SNAPSHOT~b436de808f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.175 ms) : 1163, 1186
.   : milestone, 1175,
iast (3.339 ms) : 3241, 3437
.   : milestone, 3339,
iast_FULL (5.753 ms) : 5697, 5809
.   : milestone, 5753,
iast_GLOBAL (3.686 ms) : 3623, 3748
.   : milestone, 3686,
profiling (2.372 ms) : 2349, 2395
.   : milestone, 2372,
tracing (1.869 ms) : 1854, 1885
.   : milestone, 1869,
section candidate
no_agent (1.187 ms) : 1175, 1198
.   : milestone, 1187,
iast (3.394 ms) : 3351, 3437
.   : milestone, 3394,
iast_FULL (5.642 ms) : 5570, 5714
.   : milestone, 5642,
iast_GLOBAL (3.656 ms) : 3594, 3717
.   : milestone, 3656,
profiling (1.998 ms) : 1980, 2016
.   : milestone, 1998,
tracing (1.817 ms) : 1802, 1833
.   : milestone, 1817,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.175 ms [1.163 ms, 1.186 ms] -
iast 3.339 ms [3.241 ms, 3.437 ms] 2.164 ms (184.2%)
iast_FULL 5.753 ms [5.697 ms, 5.809 ms] 4.578 ms (389.7%)
iast_GLOBAL 3.686 ms [3.623 ms, 3.748 ms] 2.511 ms (213.7%)
profiling 2.372 ms [2.349 ms, 2.395 ms] 1.197 ms (101.9%)
tracing 1.869 ms [1.854 ms, 1.885 ms] 694.736 µs (59.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.187 ms [1.175 ms, 1.198 ms] -
iast 3.394 ms [3.351 ms, 3.437 ms] 2.207 ms (186.0%)
iast_FULL 5.642 ms [5.57 ms, 5.714 ms] 4.455 ms (375.4%)
iast_GLOBAL 3.656 ms [3.594 ms, 3.717 ms] 2.469 ms (208.0%)
profiling 1.998 ms [1.98 ms, 2.016 ms] 811.085 µs (68.3%)
tracing 1.817 ms [1.802 ms, 1.833 ms] 630.429 µs (53.1%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~5fbc4da0a1, baseline=1.56.0-SNAPSHOT~b436de808f
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.071 ms) : 17888, 18253
.   : milestone, 18071,
appsec (19.288 ms) : 19095, 19481
.   : milestone, 19288,
code_origins (17.553 ms) : 17380, 17726
.   : milestone, 17553,
iast (18.28 ms) : 18094, 18466
.   : milestone, 18280,
profiling (18.673 ms) : 18487, 18859
.   : milestone, 18673,
tracing (17.719 ms) : 17543, 17896
.   : milestone, 17719,
section candidate
no_agent (19.404 ms) : 19205, 19603
.   : milestone, 19404,
appsec (18.875 ms) : 18678, 19071
.   : milestone, 18875,
code_origins (17.532 ms) : 17360, 17704
.   : milestone, 17532,
iast (18.622 ms) : 18432, 18812
.   : milestone, 18622,
profiling (19.922 ms) : 19707, 20138
.   : milestone, 19922,
tracing (17.632 ms) : 17458, 17805
.   : milestone, 17632,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.071 ms [17.888 ms, 18.253 ms] -
appsec 19.288 ms [19.095 ms, 19.481 ms] 1.217 ms (6.7%)
code_origins 17.553 ms [17.38 ms, 17.726 ms] -517.726 µs (-2.9%)
iast 18.28 ms [18.094 ms, 18.466 ms] 209.13 µs (1.2%)
profiling 18.673 ms [18.487 ms, 18.859 ms] 602.242 µs (3.3%)
tracing 17.719 ms [17.543 ms, 17.896 ms] -351.256 µs (-1.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.404 ms [19.205 ms, 19.603 ms] -
appsec 18.875 ms [18.678 ms, 19.071 ms] -529.118 µs (-2.7%)
code_origins 17.532 ms [17.36 ms, 17.704 ms] -1.872 ms (-9.6%)
iast 18.622 ms [18.432 ms, 18.812 ms] -781.858 µs (-4.0%)
profiling 19.922 ms [19.707 ms, 20.138 ms] 518.378 µs (2.7%)
tracing 17.632 ms [17.458 ms, 17.805 ms] -1.772 ms (-9.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/open-feature-sdk-smoke
git_commit_date 1763128431 1763336603
git_commit_sha b436de8 5fbc4da
release_version 1.56.0-SNAPSHOT~b436de808f 1.56.0-SNAPSHOT~5fbc4da0a1
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1763338690 1763338690
ci_job_id 1237934826 1237934826
ci_pipeline_id 82632839 82632839
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-owf5wo5o 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-owf5wo5o 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~5fbc4da0a1, baseline=1.56.0-SNAPSHOT~b436de808f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1460, 1483
.   : milestone, 1472,
appsec (3.64 ms) : 3427, 3852
.   : milestone, 3640,
iast (2.201 ms) : 2138, 2264
.   : milestone, 2201,
iast_GLOBAL (2.254 ms) : 2190, 2318
.   : milestone, 2254,
profiling (2.065 ms) : 2012, 2117
.   : milestone, 2065,
tracing (2.017 ms) : 1968, 2066
.   : milestone, 2017,
section candidate
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (3.713 ms) : 3496, 3929
.   : milestone, 3713,
iast (2.203 ms) : 2140, 2267
.   : milestone, 2203,
iast_GLOBAL (2.248 ms) : 2185, 2312
.   : milestone, 2248,
profiling (2.066 ms) : 2013, 2119
.   : milestone, 2066,
tracing (2.009 ms) : 1960, 2058
.   : milestone, 2009,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.46 ms, 1.483 ms] -
appsec 3.64 ms [3.427 ms, 3.852 ms] 2.168 ms (147.3%)
iast 2.201 ms [2.138 ms, 2.264 ms] 729.487 µs (49.6%)
iast_GLOBAL 2.254 ms [2.19 ms, 2.318 ms] 782.069 µs (53.1%)
profiling 2.065 ms [2.012 ms, 2.117 ms] 592.835 µs (40.3%)
tracing 2.017 ms [1.968 ms, 2.066 ms] 545.37 µs (37.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.485 ms] -
appsec 3.713 ms [3.496 ms, 3.929 ms] 2.239 ms (151.9%)
iast 2.203 ms [2.14 ms, 2.267 ms] 729.907 µs (49.5%)
iast_GLOBAL 2.248 ms [2.185 ms, 2.312 ms] 774.83 µs (52.6%)
profiling 2.066 ms [2.013 ms, 2.119 ms] 592.313 µs (40.2%)
tracing 2.009 ms [1.96 ms, 2.058 ms] 535.749 µs (36.4%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~5fbc4da0a1, baseline=1.56.0-SNAPSHOT~b436de808f
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.458 s) : 15458000, 15458000
.   : milestone, 15458000,
appsec (14.748 s) : 14748000, 14748000
.   : milestone, 14748000,
iast (18.716 s) : 18716000, 18716000
.   : milestone, 18716000,
iast_GLOBAL (17.806 s) : 17806000, 17806000
.   : milestone, 17806000,
profiling (14.747 s) : 14747000, 14747000
.   : milestone, 14747000,
tracing (14.755 s) : 14755000, 14755000
.   : milestone, 14755000,
section candidate
no_agent (14.962 s) : 14962000, 14962000
.   : milestone, 14962000,
appsec (15.195 s) : 15195000, 15195000
.   : milestone, 15195000,
iast (18.509 s) : 18509000, 18509000
.   : milestone, 18509000,
iast_GLOBAL (17.926 s) : 17926000, 17926000
.   : milestone, 17926000,
profiling (15.124 s) : 15124000, 15124000
.   : milestone, 15124000,
tracing (14.728 s) : 14728000, 14728000
.   : milestone, 14728000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.458 s [15.458 s, 15.458 s] -
appsec 14.748 s [14.748 s, 14.748 s] -710.0 ms (-4.6%)
iast 18.716 s [18.716 s, 18.716 s] 3.258 s (21.1%)
iast_GLOBAL 17.806 s [17.806 s, 17.806 s] 2.348 s (15.2%)
profiling 14.747 s [14.747 s, 14.747 s] -711.0 ms (-4.6%)
tracing 14.755 s [14.755 s, 14.755 s] -703.0 ms (-4.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.962 s [14.962 s, 14.962 s] -
appsec 15.195 s [15.195 s, 15.195 s] 233.0 ms (1.6%)
iast 18.509 s [18.509 s, 18.509 s] 3.547 s (23.7%)
iast_GLOBAL 17.926 s [17.926 s, 17.926 s] 2.964 s (19.8%)
profiling 15.124 s [15.124 s, 15.124 s] 162.0 ms (1.1%)
tracing 14.728 s [14.728 s, 14.728 s] -234.0 ms (-1.6%)

@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk-smoke branch 3 times, most recently from 6fea068 to c73df5f Compare November 16, 2025 23:11
@datadog-datadog-prod-us1
Copy link
Contributor

datadog-datadog-prod-us1 bot commented Nov 16, 2025 •
edited
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.81% (-0.01%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 5fbc4da | Docs | Datadog PR Page | Was this helpful? Give us feedback!

@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk-smoke branch from c73df5f to 5fbc4da Compare November 16, 2025 23:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD Awaiting requested review from AlexeyKuznetsov-DD AlexeyKuznetsov-DD is a code owner automatically assigned from DataDog/apm-lang-platform-java

@smola smola Awaiting requested review from smola smola is a code owner automatically assigned from DataDog/apm-java

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@manuel-alvarez-alvarez