Skip to content

Add Spark physical plan as a field in spark.sql spans #9600

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Sep 24, 2025
Merged

Add Spark physical plan as a field in spark.sql spans #9600

merged 1 commit into from
Sep 24, 2025

Conversation

@charlesmyu
Copy link
Contributor

@charlesmyu charlesmyu commented Sep 23, 2025 •
edited
Loading

What Does This Do

Adds the text-based physical query plan to spark.sql traces.

Motivation

The physical query plan contains useful, pre-formatted info that details how the query will be executed. This will complement the JSON-formatted query plan info already provided as it gives a more complete, e2e picture of the plan.

Additional Notes

N/A

Contributor Checklist

Jira ticket: DJM-964

@datadog-official
Copy link

datadog-official bot commented Sep 23, 2025 •
edited
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 68.73% (+8.89%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 4b6c8f9 | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Sep 23, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master charles.yu/djm-964/include-physical-plan
git_commit_date 1758726013 1758726700
git_commit_sha d76b984 4b6c8f9
release_version 1.54.0-SNAPSHOT~d76b984a7f 1.54.0-SNAPSHOT~4b6c8f97ce
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1758728583 1758728583
ci_job_id 1145678167 1145678167
ci_pipeline_id 77427750 77427750
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-dscc4jj8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-dscc4jj8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 54 metrics, 5 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~4b6c8f97ce, baseline=1.54.0-SNAPSHOT~d76b984a7f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.006 s) : 0, 1005807
Total [baseline] (10.755 s) : 0, 10755032
Agent [candidate] (1.005 s) : 0, 1005465
Total [candidate] (10.79 s) : 0, 10790319
section appsec
Agent [baseline] (1.197 s) : 0, 1196749
Total [baseline] (10.948 s) : 0, 10948199
Agent [candidate] (1.186 s) : 0, 1185908
Total [candidate] (10.943 s) : 0, 10943464
section iast
Agent [baseline] (1.145 s) : 0, 1144686
Total [baseline] (10.958 s) : 0, 10957957
Agent [candidate] (1.153 s) : 0, 1152880
Total [candidate] (10.912 s) : 0, 10912284
section profiling
Agent [baseline] (1.152 s) : 0, 1151570
Total [baseline] (11.078 s) : 0, 11078473
Agent [candidate] (1.16 s) : 0, 1159570
Total [candidate] (11.075 s) : 0, 11074520
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.006 s -
Agent appsec 1.197 s 190.941 ms (19.0%)
Agent iast 1.145 s 138.878 ms (13.8%)
Agent profiling 1.152 s 145.763 ms (14.5%)
Total tracing 10.755 s -
Total appsec 10.948 s 193.167 ms (1.8%)
Total iast 10.958 s 202.925 ms (1.9%)
Total profiling 11.078 s 323.44 ms (3.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.005 s -
Agent appsec 1.186 s 180.443 ms (17.9%)
Agent iast 1.153 s 147.416 ms (14.7%)
Agent profiling 1.16 s 154.106 ms (15.3%)
Total tracing 10.79 s -
Total appsec 10.943 s 153.145 ms (1.4%)
Total iast 10.912 s 121.965 ms (1.1%)
Total profiling 11.075 s 284.201 ms (2.6%) 
gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~4b6c8f97ce, baseline=1.54.0-SNAPSHOT~d76b984a7f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.464 ms) : 0, 1464
crashtracking [candidate] (1.448 ms) : 0, 1448
BytebuddyAgent [baseline] (688.343 ms) : 0, 688343
BytebuddyAgent [candidate] (688.014 ms) : 0, 688014
GlobalTracer [baseline] (247.634 ms) : 0, 247634
GlobalTracer [candidate] (247.794 ms) : 0, 247794
AppSec [baseline] (31.157 ms) : 0, 31157
AppSec [candidate] (31.044 ms) : 0, 31044
Debugger [baseline] (6.371 ms) : 0, 6371
Debugger [candidate] (6.358 ms) : 0, 6358
Remote Config [baseline] (675.641 µs) : 0, 676
Remote Config [candidate] (665.358 µs) : 0, 665
Telemetry [baseline] (8.972 ms) : 0, 8972
Telemetry [candidate] (9.04 ms) : 0, 9040
section appsec
crashtracking [baseline] (1.474 ms) : 0, 1474
crashtracking [candidate] (1.453 ms) : 0, 1453
BytebuddyAgent [baseline] (718.134 ms) : 0, 718134
BytebuddyAgent [candidate] (711.349 ms) : 0, 711349
GlobalTracer [baseline] (241.725 ms) : 0, 241725
GlobalTracer [candidate] (239.679 ms) : 0, 239679
IAST [baseline] (24.952 ms) : 0, 24952
IAST [candidate] (24.509 ms) : 0, 24509
AppSec [baseline] (171.761 ms) : 0, 171761
AppSec [candidate] (172.02 ms) : 0, 172020
Debugger [baseline] (6.042 ms) : 0, 6042
Debugger [candidate] (6.768 ms) : 0, 6768
Remote Config [baseline] (649.004 µs) : 0, 649
Remote Config [candidate] (637.962 µs) : 0, 638
Telemetry [baseline] (10.725 ms) : 0, 10725
Telemetry [candidate] (8.412 ms) : 0, 8412
section iast
crashtracking [baseline] (1.464 ms) : 0, 1464
crashtracking [candidate] (1.469 ms) : 0, 1469
BytebuddyAgent [baseline] (810.141 ms) : 0, 810141
BytebuddyAgent [candidate] (816.222 ms) : 0, 816222
GlobalTracer [baseline] (236.904 ms) : 0, 236904
GlobalTracer [candidate] (238.542 ms) : 0, 238542
IAST [baseline] (26.152 ms) : 0, 26152
IAST [candidate] (26.303 ms) : 0, 26303
AppSec [baseline] (33.86 ms) : 0, 33860
AppSec [candidate] (33.806 ms) : 0, 33806
Debugger [baseline] (5.99 ms) : 0, 5990
Debugger [candidate] (6.057 ms) : 0, 6057
Remote Config [baseline] (593.611 µs) : 0, 594
Remote Config [candidate] (595.913 µs) : 0, 596
Telemetry [baseline] (8.226 ms) : 0, 8226
Telemetry [candidate] (8.491 ms) : 0, 8491
section profiling
crashtracking [baseline] (1.451 ms) : 0, 1451
crashtracking [candidate] (1.454 ms) : 0, 1454
BytebuddyAgent [baseline] (718.924 ms) : 0, 718924
BytebuddyAgent [candidate] (723.728 ms) : 0, 723728
GlobalTracer [baseline] (223.328 ms) : 0, 223328
GlobalTracer [candidate] (225.566 ms) : 0, 225566
AppSec [baseline] (31.293 ms) : 0, 31293
AppSec [candidate] (31.62 ms) : 0, 31620
Debugger [baseline] (6.494 ms) : 0, 6494
Debugger [candidate] (8.067 ms) : 0, 8067
Remote Config [baseline] (717.966 µs) : 0, 718
Remote Config [candidate] (721.932 µs) : 0, 722
Telemetry [baseline] (16.12 ms) : 0, 16120
Telemetry [candidate] (14.807 ms) : 0, 14807
ProfilingAgent [baseline] (101.171 ms) : 0, 101171
ProfilingAgent [candidate] (101.256 ms) : 0, 101256
Profiling [baseline] (101.778 ms) : 0, 101778
Profiling [candidate] (101.879 ms) : 0, 101879
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~4b6c8f97ce, baseline=1.54.0-SNAPSHOT~d76b984a7f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.01 s) : 0, 1009588
Total [baseline] (8.661 s) : 0, 8661005
Agent [candidate] (1.007 s) : 0, 1006550
Total [candidate] (8.665 s) : 0, 8664606
section iast
Agent [baseline] (1.143 s) : 0, 1142728
Total [baseline] (9.276 s) : 0, 9275930
Agent [candidate] (1.141 s) : 0, 1141469
Total [candidate] (9.239 s) : 0, 9239214
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.01 s -
Agent iast 1.143 s 133.14 ms (13.2%)
Total tracing 8.661 s -
Total iast 9.276 s 614.925 ms (7.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.007 s -
Agent iast 1.141 s 134.919 ms (13.4%)
Total tracing 8.665 s -
Total iast 9.239 s 574.608 ms (6.6%) 
gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~4b6c8f97ce, baseline=1.54.0-SNAPSHOT~d76b984a7f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.476 ms) : 0, 1476
crashtracking [candidate] (1.456 ms) : 0, 1456
BytebuddyAgent [baseline] (691.505 ms) : 0, 691505
BytebuddyAgent [candidate] (689.44 ms) : 0, 689440
GlobalTracer [baseline] (248.197 ms) : 0, 248197
GlobalTracer [candidate] (247.328 ms) : 0, 247328
AppSec [baseline] (31.236 ms) : 0, 31236
AppSec [candidate] (31.193 ms) : 0, 31193
Debugger [baseline] (6.378 ms) : 0, 6378
Debugger [candidate] (6.391 ms) : 0, 6391
Remote Config [baseline] (675.326 µs) : 0, 675
Remote Config [candidate] (673.72 µs) : 0, 674
Telemetry [baseline] (8.911 ms) : 0, 8911
Telemetry [candidate] (8.968 ms) : 0, 8968
section iast
crashtracking [baseline] (1.459 ms) : 0, 1459
crashtracking [candidate] (1.458 ms) : 0, 1458
BytebuddyAgent [baseline] (809.327 ms) : 0, 809327
BytebuddyAgent [candidate] (807.814 ms) : 0, 807814
GlobalTracer [baseline] (236.2 ms) : 0, 236200
GlobalTracer [candidate] (236.473 ms) : 0, 236473
IAST [baseline] (25.912 ms) : 0, 25912
IAST [candidate] (25.948 ms) : 0, 25948
AppSec [baseline] (33.882 ms) : 0, 33882
AppSec [candidate] (33.548 ms) : 0, 33548
Debugger [baseline] (6.088 ms) : 0, 6088
Debugger [candidate] (6.046 ms) : 0, 6046
Remote Config [baseline] (596.556 µs) : 0, 597
Remote Config [candidate] (583.44 µs) : 0, 583
Telemetry [baseline] (8.053 ms) : 0, 8053
Telemetry [candidate] (8.33 ms) : 0, 8330
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master charles.yu/djm-964/include-physical-plan
git_commit_date 1758726013 1758726700
git_commit_sha d76b984 4b6c8f9
release_version 1.54.0-SNAPSHOT~d76b984a7f 1.54.0-SNAPSHOT~4b6c8f97ce
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1758728244 1758728244
ci_job_id 1145678168 1145678168
ci_pipeline_id 77427750 77427750
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-a49983p0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-a49983p0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 3 performance regressions! Performance is the same for 5 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:no_agent:high_load better
[-281.006µs; -173.099µs] or [-6.199%; -3.818%]		 unstable
[-70.530op/s; +175.343op/s] or [-6.963%; +17.310%]		 4.306ms 1065.375op/s 4.533ms 1012.969op/s
scenario:load:insecure-bank:profiling:high_load better
[-505.181µs; -199.668µs] or [-5.440%; -2.150%]		 unstable
[-47.330op/s; +84.830op/s] or [-9.456%; +16.948%]		 8.935ms 519.281op/s 9.287ms 500.531op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+467.293µs; +878.311µs] or [+4.524%; +8.503%]		 unstable
[-81.035op/s; +26.660op/s] or [-18.015%; +5.927%]		 11.002ms 422.625op/s 10.329ms 449.812op/s
scenario:load:petclinic:code_origins:high_load worse
[+2.135ms; +2.930ms] or [+5.033%; +6.910%]		 unstable
[-15.218op/s; +0.173op/s] or [-13.797%; +0.157%]		 44.942ms 102.778op/s 42.409ms 110.300op/s
scenario:load:petclinic:no_agent:high_load better
[-1.497ms; -0.875ms] or [-4.031%; -2.355%]		 unstable
[-4.711op/s; +12.986op/s] or [-3.741%; +10.313%]		 35.946ms 130.050op/s 37.131ms 125.912op/s
scenario:load:petclinic:appsec:high_load better
[-2.358ms; -1.441ms] or [-4.795%; -2.931%]		 unstable
[-3.137op/s; +10.762op/s] or [-3.295%; +11.304%]		 47.270ms 99.013op/s 49.169ms 95.200op/s
scenario:load:petclinic:profiling:high_load worse
[+1.475ms; +2.443ms] or [+3.034%; +5.027%]		 unstable
[-10.411op/s; +3.011op/s] or [-10.813%; +3.127%]		 50.556ms 92.588op/s 48.597ms 96.287op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~4b6c8f97ce, baseline=1.54.0-SNAPSHOT~d76b984a7f
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.533 ms) : 4482, 4585
.   : milestone, 4533,
iast (10.039 ms) : 9873, 10205
.   : milestone, 10039,
iast_FULL (14.624 ms) : 14335, 14914
.   : milestone, 14624,
iast_GLOBAL (10.329 ms) : 10145, 10514
.   : milestone, 10329,
profiling (9.287 ms) : 9140, 9434
.   : milestone, 9287,
tracing (8.108 ms) : 7989, 8226
.   : milestone, 8108,
section candidate
no_agent (4.306 ms) : 4258, 4355
.   : milestone, 4306,
iast (9.695 ms) : 9525, 9865
.   : milestone, 9695,
iast_FULL (14.399 ms) : 14114, 14684
.   : milestone, 14399,
iast_GLOBAL (11.002 ms) : 10805, 11199
.   : milestone, 11002,
profiling (8.935 ms) : 8798, 9071
.   : milestone, 8935,
tracing (8.113 ms) : 7994, 8232
.   : milestone, 8113,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.533 ms [4.482 ms, 4.585 ms] -
iast 10.039 ms [9.873 ms, 10.205 ms] 5.505 ms (121.4%)
iast_FULL 14.624 ms [14.335 ms, 14.914 ms] 10.091 ms (222.6%)
iast_GLOBAL 10.329 ms [10.145 ms, 10.514 ms] 5.796 ms (127.8%)
profiling 9.287 ms [9.14 ms, 9.434 ms] 4.754 ms (104.9%)
tracing 8.108 ms [7.989 ms, 8.226 ms] 3.574 ms (78.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.306 ms [4.258 ms, 4.355 ms] -
iast 9.695 ms [9.525 ms, 9.865 ms] 5.388 ms (125.1%)
iast_FULL 14.399 ms [14.114 ms, 14.684 ms] 10.093 ms (234.4%)
iast_GLOBAL 11.002 ms [10.805 ms, 11.199 ms] 6.696 ms (155.5%)
profiling 8.935 ms [8.798 ms, 9.071 ms] 4.628 ms (107.5%)
tracing 8.113 ms [7.994 ms, 8.232 ms] 3.806 ms (88.4%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~4b6c8f97ce, baseline=1.54.0-SNAPSHOT~d76b984a7f
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.131 ms) : 36833, 37429
.   : milestone, 37131,
appsec (49.169 ms) : 48738, 49601
.   : milestone, 49169,
code_origins (42.409 ms) : 42062, 42757
.   : milestone, 42409,
iast (45.569 ms) : 45188, 45949
.   : milestone, 45569,
profiling (48.597 ms) : 48166, 49028
.   : milestone, 48597,
tracing (44.604 ms) : 44213, 44994
.   : milestone, 44604,
section candidate
no_agent (35.946 ms) : 35666, 36226
.   : milestone, 35946,
appsec (47.27 ms) : 46850, 47690
.   : milestone, 47270,
code_origins (44.942 ms) : 44551, 45333
.   : milestone, 44942,
iast (46.223 ms) : 45830, 46616
.   : milestone, 46223,
profiling (50.556 ms) : 50088, 51024
.   : milestone, 50556,
tracing (44.706 ms) : 44327, 45086
.   : milestone, 44706,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.131 ms [36.833 ms, 37.429 ms] -
appsec 49.169 ms [48.738 ms, 49.601 ms] 12.038 ms (32.4%)
code_origins 42.409 ms [42.062 ms, 42.757 ms] 5.278 ms (14.2%)
iast 45.569 ms [45.188 ms, 45.949 ms] 8.437 ms (22.7%)
profiling 48.597 ms [48.166 ms, 49.028 ms] 11.466 ms (30.9%)
tracing 44.604 ms [44.213 ms, 44.994 ms] 7.472 ms (20.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 35.946 ms [35.666 ms, 36.226 ms] -
appsec 47.27 ms [46.85 ms, 47.69 ms] 11.324 ms (31.5%)
code_origins 44.942 ms [44.551 ms, 45.333 ms] 8.996 ms (25.0%)
iast 46.223 ms [45.83 ms, 46.616 ms] 10.277 ms (28.6%)
profiling 50.556 ms [50.088 ms, 51.024 ms] 14.61 ms (40.6%)
tracing 44.706 ms [44.327 ms, 45.086 ms] 8.761 ms (24.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master charles.yu/djm-964/include-physical-plan
git_commit_date 1758726013 1758726700
git_commit_sha d76b984 4b6c8f9
release_version 1.54.0-SNAPSHOT~d76b984a7f 1.54.0-SNAPSHOT~4b6c8f97ce
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1758728740 1758728740
ci_job_id 1145678169 1145678169
ci_pipeline_id 77427750 77427750
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-kvxwauyc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-kvxwauyc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~4b6c8f97ce, baseline=1.54.0-SNAPSHOT~d76b984a7f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.479 ms) : 1467, 1490
.   : milestone, 1479,
appsec (3.686 ms) : 3472, 3901
.   : milestone, 3686,
iast (2.206 ms) : 2143, 2269
.   : milestone, 2206,
iast_GLOBAL (2.244 ms) : 2180, 2308
.   : milestone, 2244,
profiling (2.054 ms) : 2003, 2105
.   : milestone, 2054,
tracing (2.025 ms) : 1976, 2074
.   : milestone, 2025,
section candidate
no_agent (1.475 ms) : 1463, 1486
.   : milestone, 1475,
appsec (3.685 ms) : 3471, 3899
.   : milestone, 3685,
iast (2.215 ms) : 2152, 2278
.   : milestone, 2215,
iast_GLOBAL (2.256 ms) : 2192, 2319
.   : milestone, 2256,
profiling (2.048 ms) : 1998, 2098
.   : milestone, 2048,
tracing (2.04 ms) : 1990, 2090
.   : milestone, 2040,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.467 ms, 1.49 ms] -
appsec 3.686 ms [3.472 ms, 3.901 ms] 2.207 ms (149.3%)
iast 2.206 ms [2.143 ms, 2.269 ms] 727.241 µs (49.2%)
iast_GLOBAL 2.244 ms [2.18 ms, 2.308 ms] 765.248 µs (51.7%)
profiling 2.054 ms [2.003 ms, 2.105 ms] 575.247 µs (38.9%)
tracing 2.025 ms [1.976 ms, 2.074 ms] 546.254 µs (36.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.463 ms, 1.486 ms] -
appsec 3.685 ms [3.471 ms, 3.899 ms] 2.211 ms (149.9%)
iast 2.215 ms [2.152 ms, 2.278 ms] 740.667 µs (50.2%)
iast_GLOBAL 2.256 ms [2.192 ms, 2.319 ms] 781.221 µs (53.0%)
profiling 2.048 ms [1.998 ms, 2.098 ms] 573.312 µs (38.9%)
tracing 2.04 ms [1.99 ms, 2.09 ms] 565.476 µs (38.3%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~4b6c8f97ce, baseline=1.54.0-SNAPSHOT~d76b984a7f
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.066 s) : 15066000, 15066000
.   : milestone, 15066000,
appsec (15.283 s) : 15283000, 15283000
.   : milestone, 15283000,
iast (18.338 s) : 18338000, 18338000
.   : milestone, 18338000,
iast_GLOBAL (18.504 s) : 18504000, 18504000
.   : milestone, 18504000,
profiling (15.4 s) : 15400000, 15400000
.   : milestone, 15400000,
tracing (15.21 s) : 15210000, 15210000
.   : milestone, 15210000,
section candidate
no_agent (14.944 s) : 14944000, 14944000
.   : milestone, 14944000,
appsec (15.057 s) : 15057000, 15057000
.   : milestone, 15057000,
iast (18.564 s) : 18564000, 18564000
.   : milestone, 18564000,
iast_GLOBAL (17.712 s) : 17712000, 17712000
.   : milestone, 17712000,
profiling (15.651 s) : 15651000, 15651000
.   : milestone, 15651000,
tracing (15.149 s) : 15149000, 15149000
.   : milestone, 15149000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.066 s [15.066 s, 15.066 s] -
appsec 15.283 s [15.283 s, 15.283 s] 217.0 ms (1.4%)
iast 18.338 s [18.338 s, 18.338 s] 3.272 s (21.7%)
iast_GLOBAL 18.504 s [18.504 s, 18.504 s] 3.438 s (22.8%)
profiling 15.4 s [15.4 s, 15.4 s] 334.0 ms (2.2%)
tracing 15.21 s [15.21 s, 15.21 s] 144.0 ms (1.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.944 s [14.944 s, 14.944 s] -
appsec 15.057 s [15.057 s, 15.057 s] 113.0 ms (0.8%)
iast 18.564 s [18.564 s, 18.564 s] 3.62 s (24.2%)
iast_GLOBAL 17.712 s [17.712 s, 17.712 s] 2.768 s (18.5%)
profiling 15.651 s [15.651 s, 15.651 s] 707.0 ms (4.7%)
tracing 15.149 s [15.149 s, 15.149 s] 205.0 ms (1.4%)

@charlesmyu charlesmyu added type: enhancement Enhancements and improvements inst: apache spark Apache Spark instrumentation labels Sep 24, 2025
@charlesmyu charlesmyu force-pushed the charles.yu/djm-964/include-physical-plan branch from 23e7690 to 4b6c8f9 Compare September 24, 2025 15:11
@charlesmyu charlesmyu marked this pull request as ready for review September 24, 2025 15:13
@charlesmyu charlesmyu requested a review from a team as a code owner September 24, 2025 15:13
@charlesmyu charlesmyu added the tag: no release notes Changes to exclude from release notes label Sep 24, 2025
@charlesmyu charlesmyu enabled auto-merge (squash) September 24, 2025 15:34
@charlesmyu charlesmyu merged commit 46f4b13 into master Sep 24, 2025
544 of 547 checks passed
@charlesmyu charlesmyu deleted the charles.yu/djm-964/include-physical-plan branch September 24, 2025 15:58
@github-actions github-actions bot added this to the 1.54.0 milestone Sep 24, 2025
mhlidd pushed a commit that referenced this pull request Sep 24, 2025
@charlesmyu @mhlidd
[DJM-964] Add Spark physical plan with spark.sql spans (#9600)
7406c06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@rkaneriya rkaneriya rkaneriya approved these changes

Assignees

No one assigned

Labels

inst: apache spark Apache Spark instrumentation tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.54.0

Development

Successfully merging this pull request may close these issues.

3 participants

@charlesmyu @rkaneriya