Add zstd scenario to profile uploading tests #8869

MattAlp · 2025-05-22T15:00:01Z

What Does This Do

Minor change to check zstd compression in the profile uploading E2E workflow alongside the testing in #8862.

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: PROF-11793

…onfig.java Co-authored-by: Jaroslav Bachorik <jaroslav.bachorik@datadoghq.com>

…m:DataDog/dd-trace-java into mattalp/enable-zstd-profiling-compression

github-actions · 2025-05-22T15:00:12Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

pr-commenter · 2025-05-22T15:39:27Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mattalp/enable-zstd-profiling-compression
git_commit_date	1746789389	1748049835
git_commit_sha	`ad6d5fe`	`6783698`
release_version	1.50.0-SNAPSHOT~ad6d5fef42	1.50.0-SNAPSHOT~6783698498

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1748052292	1748052292
ci_job_id	953186226	953186226
ci_pipeline_id	66041564	66041564
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-8t2n4jps-project-304-concurrent-0-plkn7ln4 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-8t2n4jps-project-304-concurrent-0-plkn7ln4 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 3 performance improvements and 1 performance regressions! Performance is the same for 53 metrics, 14 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:petclinic:profiling:ProfilingAgent	better [-9.953ms; -4.266ms] or [-9.002%; -3.858%]	103.459ms	110.568ms
scenario:startup:petclinic:profiling:GlobalTracer	better [-23.541ms; -15.157ms] or [-6.203%; -3.994%]	360.140ms	379.489ms
scenario:startup:petclinic:profiling:AppSec	worse [+5.250ms; +8.428ms] or [+9.603%; +15.418%]	61.506ms	54.667ms
scenario:startup:petclinic:profiling:Profiling	better [-9.955ms; -4.267ms] or [-9.001%; -3.858%]	103.483ms	110.593ms

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~6783698498, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.019 s) : 0, 1019148
Total [baseline] (10.44 s) : 0, 10439534
Agent [candidate] (1.02 s) : 0, 1020231
Total [candidate] (10.469 s) : 0, 10469247
section appsec
Agent [baseline] (1.161 s) : 0, 1161075
Total [baseline] (10.654 s) : 0, 10654253
Agent [candidate] (1.166 s) : 0, 1165529
Total [candidate] (10.74 s) : 0, 10739759
section iast
Agent [baseline] (1.149 s) : 0, 1148814
Total [baseline] (10.868 s) : 0, 10867660
Agent [candidate] (1.157 s) : 0, 1156763
Total [candidate] (10.928 s) : 0, 10928182
section profiling
Agent [baseline] (1.287 s) : 0, 1286527
Total [baseline] (10.94 s) : 0, 10939921
Agent [candidate] (1.266 s) : 0, 1266429
Total [candidate] (10.872 s) : 0, 10872373

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.019 s	-
Agent	appsec	1.161 s	141.927 ms (13.9%)
Agent	iast	1.149 s	129.667 ms (12.7%)
Agent	profiling	1.287 s	267.38 ms (26.2%)
Total	tracing	10.44 s	-
Total	appsec	10.654 s	214.719 ms (2.1%)
Total	iast	10.868 s	428.126 ms (4.1%)
Total	profiling	10.94 s	500.387 ms (4.8%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.02 s	-
Agent	appsec	1.166 s	145.298 ms (14.2%)
Agent	iast	1.157 s	136.532 ms (13.4%)
Agent	profiling	1.266 s	246.198 ms (24.1%)
Total	tracing	10.469 s	-
Total	appsec	10.74 s	270.512 ms (2.6%)
Total	iast	10.928 s	458.934 ms (4.4%)
Total	profiling	10.872 s	403.125 ms (3.9%)

gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~6783698498, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (683.616 ms) : 0, 683616
BytebuddyAgent [candidate] (683.437 ms) : 0, 683437
GlobalTracer [baseline] (240.069 ms) : 0, 240069
GlobalTracer [candidate] (240.606 ms) : 0, 240606
AppSec [baseline] (54.828 ms) : 0, 54828
AppSec [candidate] (54.286 ms) : 0, 54286
Debugger [baseline] (8.217 ms) : 0, 8217
Debugger [candidate] (8.454 ms) : 0, 8454
Remote Config [baseline] (679.98 µs) : 0, 680
Remote Config [candidate] (713.559 µs) : 0, 714
Telemetry [baseline] (8.243 ms) : 0, 8243
Telemetry [candidate] (9.094 ms) : 0, 9094
section appsec
BytebuddyAgent [baseline] (700.347 ms) : 0, 700347
BytebuddyAgent [candidate] (703.398 ms) : 0, 703398
GlobalTracer [baseline] (236.516 ms) : 0, 236516
GlobalTracer [candidate] (237.522 ms) : 0, 237522
AppSec [baseline] (175.166 ms) : 0, 175166
AppSec [candidate] (175.332 ms) : 0, 175332
Debugger [baseline] (5.929 ms) : 0, 5929
Debugger [candidate] (5.948 ms) : 0, 5948
Remote Config [baseline] (622.849 µs) : 0, 623
Remote Config [candidate] (620.363 µs) : 0, 620
Telemetry [baseline] (8.144 ms) : 0, 8144
Telemetry [candidate] (8.207 ms) : 0, 8207
IAST [baseline] (21.746 ms) : 0, 21746
IAST [candidate] (21.881 ms) : 0, 21881
section iast
BytebuddyAgent [baseline] (802.247 ms) : 0, 802247
BytebuddyAgent [candidate] (807.817 ms) : 0, 807817
GlobalTracer [baseline] (230.584 ms) : 0, 230584
GlobalTracer [candidate] (232.207 ms) : 0, 232207
AppSec [baseline] (48.494 ms) : 0, 48494
AppSec [candidate] (49.656 ms) : 0, 49656
Debugger [baseline] (5.91 ms) : 0, 5910
Debugger [candidate] (5.924 ms) : 0, 5924
Remote Config [baseline] (601.197 µs) : 0, 601
Remote Config [candidate] (599.234 µs) : 0, 599
Telemetry [baseline] (7.953 ms) : 0, 7953
Telemetry [candidate] (7.919 ms) : 0, 7919
IAST [baseline] (28.86 ms) : 0, 28860
IAST [candidate] (29.149 ms) : 0, 29149
section profiling
BytebuddyAgent [baseline] (675.966 ms) : 0, 675966
BytebuddyAgent [candidate] (675.236 ms) : 0, 675236
GlobalTracer [baseline] (379.489 ms) : 0, 379489
GlobalTracer [candidate] (360.14 ms) : 0, 360140
AppSec [baseline] (54.667 ms) : 0, 54667
AppSec [candidate] (61.506 ms) : 0, 61506
Debugger [baseline] (6.149 ms) : 0, 6149
Debugger [candidate] (6.315 ms) : 0, 6315
Remote Config [baseline] (665.209 µs) : 0, 665
Remote Config [candidate] (651.015 µs) : 0, 651
Telemetry [baseline] (8.111 ms) : 0, 8111
Telemetry [candidate] (8.184 ms) : 0, 8184
ProfilingAgent [baseline] (110.568 ms) : 0, 110568
ProfilingAgent [candidate] (103.459 ms) : 0, 103459
Profiling [baseline] (110.593 ms) : 0, 110593
Profiling [candidate] (103.483 ms) : 0, 103483

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~6783698498, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.025 s) : 0, 1025448
Total [baseline] (8.629 s) : 0, 8629481
Agent [candidate] (1.019 s) : 0, 1019279
Total [candidate] (8.665 s) : 0, 8665393
section iast
Agent [baseline] (1.155 s) : 0, 1155496
Total [baseline] (9.232 s) : 0, 9232035
Agent [candidate] (1.157 s) : 0, 1156610
Total [candidate] (9.234 s) : 0, 9234042
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.152 s) : 0, 1151767
Total [baseline] (9.194 s) : 0, 9193846
Agent [candidate] (1.157 s) : 0, 1156646
Total [candidate] (9.184 s) : 0, 9183678
section iast_TELEMETRY_OFF
Agent [baseline] (1.151 s) : 0, 1150591
Total [baseline] (9.223 s) : 0, 9223019
Agent [candidate] (1.144 s) : 0, 1144164
Total [candidate] (9.206 s) : 0, 9205734

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.025 s	-
Agent	iast	1.155 s	130.048 ms (12.7%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.152 s	126.319 ms (12.3%)
Agent	iast_TELEMETRY_OFF	1.151 s	125.142 ms (12.2%)
Total	tracing	8.629 s	-
Total	iast	9.232 s	602.555 ms (7.0%)
Total	iast_HARDCODED_SECRET_DISABLED	9.194 s	564.365 ms (6.5%)
Total	iast_TELEMETRY_OFF	9.223 s	593.538 ms (6.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.019 s	-
Agent	iast	1.157 s	137.331 ms (13.5%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.157 s	137.367 ms (13.5%)
Agent	iast_TELEMETRY_OFF	1.144 s	124.885 ms (12.3%)
Total	tracing	8.665 s	-
Total	iast	9.234 s	568.649 ms (6.6%)
Total	iast_HARDCODED_SECRET_DISABLED	9.184 s	518.286 ms (6.0%)
Total	iast_TELEMETRY_OFF	9.206 s	540.342 ms (6.2%)

gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~6783698498, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (685.565 ms) : 0, 685565
BytebuddyAgent [candidate] (681.728 ms) : 0, 681728
GlobalTracer [baseline] (240.622 ms) : 0, 240622
GlobalTracer [candidate] (239.549 ms) : 0, 239549
AppSec [baseline] (56.137 ms) : 0, 56137
AppSec [candidate] (55.078 ms) : 0, 55078
Debugger [baseline] (9.007 ms) : 0, 9007
Debugger [candidate] (9.83 ms) : 0, 9830
Remote Config [baseline] (697.591 µs) : 0, 698
Remote Config [candidate] (691.713 µs) : 0, 692
Telemetry [baseline] (9.765 ms) : 0, 9765
Telemetry [candidate] (8.888 ms) : 0, 8888
section iast
BytebuddyAgent [baseline] (807.624 ms) : 0, 807624
BytebuddyAgent [candidate] (807.621 ms) : 0, 807621
GlobalTracer [baseline] (231.277 ms) : 0, 231277
GlobalTracer [candidate] (231.913 ms) : 0, 231913
IAST [baseline] (29.329 ms) : 0, 29329
IAST [candidate] (30.217 ms) : 0, 30217
AppSec [baseline] (48.519 ms) : 0, 48519
AppSec [candidate] (48.816 ms) : 0, 48816
Debugger [baseline] (5.897 ms) : 0, 5897
Debugger [candidate] (5.906 ms) : 0, 5906
Remote Config [baseline] (586.998 µs) : 0, 587
Remote Config [candidate] (599.904 µs) : 0, 600
Telemetry [baseline] (7.898 ms) : 0, 7898
Telemetry [candidate] (7.928 ms) : 0, 7928
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (804.832 ms) : 0, 804832
BytebuddyAgent [candidate] (807.322 ms) : 0, 807322
GlobalTracer [baseline] (230.35 ms) : 0, 230350
GlobalTracer [candidate] (232.261 ms) : 0, 232261
IAST [baseline] (29.998 ms) : 0, 29998
IAST [candidate] (31.021 ms) : 0, 31021
AppSec [baseline] (48.502 ms) : 0, 48502
AppSec [candidate] (47.876 ms) : 0, 47876
Debugger [baseline] (5.908 ms) : 0, 5908
Debugger [candidate] (5.958 ms) : 0, 5958
Remote Config [baseline] (621.914 µs) : 0, 622
Remote Config [candidate] (593.933 µs) : 0, 594
Telemetry [baseline] (7.948 ms) : 0, 7948
Telemetry [candidate] (8.007 ms) : 0, 8007
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (803.62 ms) : 0, 803620
BytebuddyAgent [candidate] (797.773 ms) : 0, 797773
GlobalTracer [baseline] (230.955 ms) : 0, 230955
GlobalTracer [candidate] (230.672 ms) : 0, 230672
IAST [baseline] (23.928 ms) : 0, 23928
IAST [candidate] (23.863 ms) : 0, 23863
AppSec [baseline] (54.116 ms) : 0, 54116
AppSec [candidate] (54.106 ms) : 0, 54106
Debugger [baseline] (5.978 ms) : 0, 5978
Debugger [candidate] (5.939 ms) : 0, 5939
Remote Config [baseline] (617.999 µs) : 0, 618
Remote Config [candidate] (595.945 µs) : 0, 596
Telemetry [baseline] (7.771 ms) : 0, 7771
Telemetry [candidate] (7.784 ms) : 0, 7784

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-05-24T01:35:13	2025-05-24T01:42:59
git_branch	master	mattalp/enable-zstd-profiling-compression
git_commit_date	1746789389	1748049835
git_commit_sha	`ad6d5fe`	`6783698`
release_version	1.50.0-SNAPSHOT~ad6d5fef42	1.50.0-SNAPSHOT~6783698498
start_time	2025-05-24T01:34:59	2025-05-24T01:42:44

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1748051379	1748051379
ci_job_id	953186227	953186227
ci_pipeline_id	66041564	66041564
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-mtj9syws-project-304-concurrent-0-ik5jcz24 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-mtj9syws-project-304-concurrent-0-ik5jcz24 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~6783698498, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.356 ms) : 1336, 1375
.   : milestone, 1356,
appsec (1.751 ms) : 1727, 1775
.   : milestone, 1751,
appsec_no_iast (1.732 ms) : 1708, 1756
.   : milestone, 1732,
code_origins (1.678 ms) : 1651, 1706
.   : milestone, 1678,
iast (1.507 ms) : 1483, 1531
.   : milestone, 1507,
profiling (1.526 ms) : 1503, 1550
.   : milestone, 1526,
tracing (1.501 ms) : 1476, 1526
.   : milestone, 1501,
section candidate
no_agent (1.373 ms) : 1355, 1392
.   : milestone, 1373,
appsec (1.735 ms) : 1713, 1758
.   : milestone, 1735,
appsec_no_iast (1.724 ms) : 1701, 1748
.   : milestone, 1724,
code_origins (1.681 ms) : 1654, 1709
.   : milestone, 1681,
iast (1.525 ms) : 1500, 1550
.   : milestone, 1525,
profiling (1.539 ms) : 1515, 1563
.   : milestone, 1539,
tracing (1.489 ms) : 1464, 1514
.   : milestone, 1489,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.356 ms [1.336 ms, 1.375 ms]	-
appsec	1.751 ms [1.727 ms, 1.775 ms]	395.114 µs (29.1%)
appsec_no_iast	1.732 ms [1.708 ms, 1.756 ms]	376.962 µs (27.8%)
code_origins	1.678 ms [1.651 ms, 1.706 ms]	322.882 µs (23.8%)
iast	1.507 ms [1.483 ms, 1.531 ms]	151.803 µs (11.2%)
profiling	1.526 ms [1.503 ms, 1.55 ms]	170.668 µs (12.6%)
tracing	1.501 ms [1.476 ms, 1.526 ms]	145.643 µs (10.7%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.373 ms [1.355 ms, 1.392 ms]	-
appsec	1.735 ms [1.713 ms, 1.758 ms]	361.942 µs (26.4%)
appsec_no_iast	1.724 ms [1.701 ms, 1.748 ms]	350.629 µs (25.5%)
code_origins	1.681 ms [1.654 ms, 1.709 ms]	307.666 µs (22.4%)
iast	1.525 ms [1.5 ms, 1.55 ms]	151.392 µs (11.0%)
profiling	1.539 ms [1.515 ms, 1.563 ms]	165.661 µs (12.1%)
tracing	1.489 ms [1.464 ms, 1.514 ms]	115.964 µs (8.4%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~6783698498, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (384.012 µs) : 363, 405
.   : milestone, 384,
iast (525.768 µs) : 502, 550
.   : milestone, 526,
iast_FULL (738.264 µs) : 716, 760
.   : milestone, 738,
iast_GLOBAL (559.202 µs) : 538, 581
.   : milestone, 559,
iast_HARDCODED_SECRET_DISABLED (527.312 µs) : 504, 550
.   : milestone, 527,
iast_INACTIVE (465.266 µs) : 443, 487
.   : milestone, 465,
iast_TELEMETRY_OFF (520.058 µs) : 497, 543
.   : milestone, 520,
tracing (462.783 µs) : 441, 485
.   : milestone, 463,
section candidate
no_agent (392.834 µs) : 372, 413
.   : milestone, 393,
iast (529.939 µs) : 507, 553
.   : milestone, 530,
iast_FULL (741.448 µs) : 719, 763
.   : milestone, 741,
iast_GLOBAL (571.467 µs) : 550, 593
.   : milestone, 571,
iast_HARDCODED_SECRET_DISABLED (534.728 µs) : 512, 558
.   : milestone, 535,
iast_INACTIVE (466.517 µs) : 444, 489
.   : milestone, 467,
iast_TELEMETRY_OFF (511.491 µs) : 488, 535
.   : milestone, 511,
tracing (462.856 µs) : 441, 485
.   : milestone, 463,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	384.012 µs [362.621 µs, 405.403 µs]	-
iast	525.768 µs [501.869 µs, 549.666 µs]	141.756 µs (36.9%)
iast_FULL	738.264 µs [716.138 µs, 760.391 µs]	354.253 µs (92.3%)
iast_GLOBAL	559.202 µs [537.564 µs, 580.84 µs]	175.19 µs (45.6%)
iast_HARDCODED_SECRET_DISABLED	527.312 µs [504.345 µs, 550.279 µs]	143.3 µs (37.3%)
iast_INACTIVE	465.266 µs [443.189 µs, 487.342 µs]	81.254 µs (21.2%)
iast_TELEMETRY_OFF	520.058 µs [496.755 µs, 543.361 µs]	136.046 µs (35.4%)
tracing	462.783 µs [440.654 µs, 484.913 µs]	78.772 µs (20.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	392.834 µs [372.453 µs, 413.215 µs]	-
iast	529.939 µs [507.329 µs, 552.549 µs]	137.105 µs (34.9%)
iast_FULL	741.448 µs [719.432 µs, 763.465 µs]	348.614 µs (88.7%)
iast_GLOBAL	571.467 µs [549.536 µs, 593.399 µs]	178.633 µs (45.5%)
iast_HARDCODED_SECRET_DISABLED	534.728 µs [511.532 µs, 557.923 µs]	141.894 µs (36.1%)
iast_INACTIVE	466.517 µs [443.736 µs, 489.299 µs]	73.683 µs (18.8%)
iast_TELEMETRY_OFF	511.491 µs [488.374 µs, 534.607 µs]	118.657 µs (30.2%)
tracing	462.856 µs [440.991 µs, 484.72 µs]	70.022 µs (17.8%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mattalp/enable-zstd-profiling-compression
git_commit_date	1746789389	1748049835
git_commit_sha	`ad6d5fe`	`6783698`
release_version	1.50.0-SNAPSHOT~ad6d5fef42	1.50.0-SNAPSHOT~6783698498

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1748051850	1748051850
ci_job_id	953186228	953186228
ci_pipeline_id	66041564	66041564
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-qshkhgbg-project-304-concurrent-0-uwow46ta 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-qshkhgbg-project-304-concurrent-0-uwow46ta 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~6783698498, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.76 s) : 14760000, 14760000
.   : milestone, 14760000,
appsec (14.977 s) : 14977000, 14977000
.   : milestone, 14977000,
iast (18.702 s) : 18702000, 18702000
.   : milestone, 18702000,
iast_GLOBAL (17.997 s) : 17997000, 17997000
.   : milestone, 17997000,
profiling (15.106 s) : 15106000, 15106000
.   : milestone, 15106000,
tracing (14.914 s) : 14914000, 14914000
.   : milestone, 14914000,
section candidate
no_agent (15.375 s) : 15375000, 15375000
.   : milestone, 15375000,
appsec (15.087 s) : 15087000, 15087000
.   : milestone, 15087000,
iast (18.25 s) : 18250000, 18250000
.   : milestone, 18250000,
iast_GLOBAL (18.13 s) : 18130000, 18130000
.   : milestone, 18130000,
profiling (15.762 s) : 15762000, 15762000
.   : milestone, 15762000,
tracing (14.915 s) : 14915000, 14915000
.   : milestone, 14915000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.76 s [14.76 s, 14.76 s]	-
appsec	14.977 s [14.977 s, 14.977 s]	217.0 ms (1.5%)
iast	18.702 s [18.702 s, 18.702 s]	3.942 s (26.7%)
iast_GLOBAL	17.997 s [17.997 s, 17.997 s]	3.237 s (21.9%)
profiling	15.106 s [15.106 s, 15.106 s]	346.0 ms (2.3%)
tracing	14.914 s [14.914 s, 14.914 s]	154.0 ms (1.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.375 s [15.375 s, 15.375 s]	-
appsec	15.087 s [15.087 s, 15.087 s]	-288.0 ms (-1.9%)
iast	18.25 s [18.25 s, 18.25 s]	2.875 s (18.7%)
iast_GLOBAL	18.13 s [18.13 s, 18.13 s]	2.755 s (17.9%)
profiling	15.762 s [15.762 s, 15.762 s]	387.0 ms (2.5%)
tracing	14.915 s [14.915 s, 14.915 s]	-460.0 ms (-3.0%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~6783698498, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.481 ms) : 1469, 1493
.   : milestone, 1481,
appsec (2.406 ms) : 2357, 2454
.   : milestone, 2406,
iast (2.17 ms) : 2109, 2230
.   : milestone, 2170,
iast_GLOBAL (2.227 ms) : 2166, 2289
.   : milestone, 2227,
profiling (2.022 ms) : 1973, 2070
.   : milestone, 2022,
tracing (2.01 ms) : 1963, 2057
.   : milestone, 2010,
section candidate
no_agent (1.48 ms) : 1468, 1491
.   : milestone, 1480,
appsec (2.412 ms) : 2364, 2461
.   : milestone, 2412,
iast (2.187 ms) : 2126, 2248
.   : milestone, 2187,
iast_GLOBAL (2.221 ms) : 2160, 2282
.   : milestone, 2221,
profiling (2.033 ms) : 1984, 2083
.   : milestone, 2033,
tracing (2.016 ms) : 1968, 2063
.   : milestone, 2016,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.481 ms [1.469 ms, 1.493 ms]	-
appsec	2.406 ms [2.357 ms, 2.454 ms]	924.557 µs (62.4%)
iast	2.17 ms [2.109 ms, 2.23 ms]	688.779 µs (46.5%)
iast_GLOBAL	2.227 ms [2.166 ms, 2.289 ms]	746.53 µs (50.4%)
profiling	2.022 ms [1.973 ms, 2.07 ms]	540.792 µs (36.5%)
tracing	2.01 ms [1.963 ms, 2.057 ms]	528.746 µs (35.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.48 ms [1.468 ms, 1.491 ms]	-
appsec	2.412 ms [2.364 ms, 2.461 ms]	932.87 µs (63.0%)
iast	2.187 ms [2.126 ms, 2.248 ms]	707.255 µs (47.8%)
iast_GLOBAL	2.221 ms [2.16 ms, 2.282 ms]	741.435 µs (50.1%)
profiling	2.033 ms [1.984 ms, 2.083 ms]	553.793 µs (37.4%)
tracing	2.016 ms [1.968 ms, 2.063 ms]	535.978 µs (36.2%)

dd-java-agent/agent-profiling/profiling-uploader/build.gradle

r1viollet · 2025-05-23T12:24:33Z

Thanks for adjusting the tests!

MattAlp and others added 13 commits May 19, 2025 16:54

Enable use of zstd (using default level) for profile upload compression

58c778f

Deprecate previous profiling compression flag

83e210d

Bump max tracer size to 32 mb

b16250d

Update dd-trace-api/src/main/java/datadog/trace/api/config/ProfilingC…

89f2fb0

…onfig.java Co-authored-by: Jaroslav Bachorik <jaroslav.bachorik@datadoghq.com>

Nits

6ec4951

Merge branch 'mattalp/enable-zstd-profiling-compression' of github.co…

41cd691

…m:DataDog/dd-trace-java into mattalp/enable-zstd-profiling-compression

Nits

9590171

Merge branch 'master' into mattalp/enable-zstd-profiling-compression

4aa5300

Revert defaults briefly for org2

b48351e

Merge branch 'mattalp/enable-zstd-profiling-compression' of github.co…

4f55f9a

…m:DataDog/dd-trace-java into mattalp/enable-zstd-profiling-compression

Include ZSTD tests

d0e1566

Straggling comments and log line zstd-reversion

6e76ffb

Update ProfileUploaderTest with zstd scenario

514b467

MattAlp requested a review from jbachorik May 22, 2025 15:00

MattAlp requested review from a team as code owners May 22, 2025 15:00

MattAlp requested a review from dougqh May 22, 2025 15:00

MattAlp added type: enhancement comp: profiling Profiling labels May 22, 2025

bric3 reviewed May 23, 2025

View reviewed changes

dd-java-agent/agent-profiling/profiling-uploader/build.gradle Outdated Show resolved Hide resolved

Merge branch 'master' into mattalp/enable-zstd-profiling-compression

6783698

jbachorik approved these changes May 25, 2025

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add zstd scenario to profile uploading tests #8869

Add zstd scenario to profile uploading tests #8869

Uh oh!

MattAlp commented May 22, 2025 •

edited by jira bot

Loading

Uh oh!

github-actions bot commented May 22, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented May 22, 2025 •

edited

Loading

Uh oh!

Uh oh!

r1viollet commented May 23, 2025

Uh oh!

Uh oh!

Add zstd scenario to profile uploading tests #8869

Are you sure you want to change the base?

Add zstd scenario to profile uploading tests #8869

Uh oh!

Conversation

MattAlp commented May 22, 2025 • edited by jira bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

github-actions bot commented May 22, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter bot commented May 22, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

r1viollet commented May 23, 2025

Uh oh!

Uh oh!

MattAlp commented May 22, 2025 •

edited by jira bot

Loading

github-actions bot commented May 22, 2025 •

edited

Loading

pr-commenter bot commented May 22, 2025 •

edited

Loading