Tag profiles for serverless #8279

jbachorik · 2025-01-24T10:15:43Z

What Does This Do

Adds a tag for profiles collected on serverless

Motivation

Avoid over-billing

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: PROF-11106

pr-commenter · 2025-01-24T10:56:08Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	jb/serverless_tag
git_commit_date	1737720979	1737728239
git_commit_sha	`3bbea85`	`5328b1a`
release_version	1.46.0-SNAPSHOT~3bbea8564a	1.46.0-SNAPSHOT~5328b1ae2e

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1737730818	1737730818
ci_job_id	779520065	779520065
ci_pipeline_id	53921230	53921230
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-xugqgpm8-project-304-concurrent-3-9koyo0nq 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-xugqgpm8-project-304-concurrent-3-9koyo0nq 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 6 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.46.0-SNAPSHOT~5328b1ae2e, baseline=1.46.0-SNAPSHOT~3bbea8564a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.043 s) : 0, 1043054
Total [baseline] (8.629 s) : 0, 8628907
Agent [candidate] (1.042 s) : 0, 1042326
Total [candidate] (8.646 s) : 0, 8645966
section iast
Agent [baseline] (1.165 s) : 0, 1165283
Total [baseline] (9.215 s) : 0, 9214885
Agent [candidate] (1.181 s) : 0, 1180716
Total [candidate] (9.209 s) : 0, 9208816
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.165 s) : 0, 1164507
Total [baseline] (9.183 s) : 0, 9183212
Agent [candidate] (1.171 s) : 0, 1170934
Total [candidate] (9.234 s) : 0, 9234291
section iast_TELEMETRY_OFF
Agent [baseline] (1.16 s) : 0, 1159661
Total [baseline] (9.227 s) : 0, 9226930
Agent [candidate] (1.166 s) : 0, 1165541
Total [candidate] (9.244 s) : 0, 9243639

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.043 s	-
Agent	iast	1.165 s	122.229 ms (11.7%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.165 s	121.453 ms (11.6%)
Agent	iast_TELEMETRY_OFF	1.16 s	116.607 ms (11.2%)
Total	tracing	8.629 s	-
Total	iast	9.215 s	585.978 ms (6.8%)
Total	iast_HARDCODED_SECRET_DISABLED	9.183 s	554.305 ms (6.4%)
Total	iast_TELEMETRY_OFF	9.227 s	598.023 ms (6.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.042 s	-
Agent	iast	1.181 s	138.39 ms (13.3%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.171 s	128.609 ms (12.3%)
Agent	iast_TELEMETRY_OFF	1.166 s	123.216 ms (11.8%)
Total	tracing	8.646 s	-
Total	iast	9.209 s	562.85 ms (6.5%)
Total	iast_HARDCODED_SECRET_DISABLED	9.234 s	588.325 ms (6.8%)
Total	iast_TELEMETRY_OFF	9.244 s	597.674 ms (6.9%)

gantt
    title insecure-bank - break down per module: candidate=1.46.0-SNAPSHOT~5328b1ae2e, baseline=1.46.0-SNAPSHOT~3bbea8564a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.874 ms) : 0, 717874
BytebuddyAgent [candidate] (718.358 ms) : 0, 718358
GlobalTracer [baseline] (239.514 ms) : 0, 239514
GlobalTracer [candidate] (240.345 ms) : 0, 240345
AppSec [baseline] (55.433 ms) : 0, 55433
AppSec [candidate] (55.566 ms) : 0, 55566
Remote Config [baseline] (720.705 µs) : 0, 721
Remote Config [candidate] (719.751 µs) : 0, 720
Telemetry [baseline] (14.502 ms) : 0, 14502
Telemetry [candidate] (12.324 ms) : 0, 12324
section iast
BytebuddyAgent [baseline] (832.212 ms) : 0, 832212
BytebuddyAgent [candidate] (843.391 ms) : 0, 843391
GlobalTracer [baseline] (229.449 ms) : 0, 229449
GlobalTracer [candidate] (232.106 ms) : 0, 232106
AppSec [baseline] (58.001 ms) : 0, 58001
AppSec [candidate] (57.919 ms) : 0, 57919
IAST [baseline] (21.329 ms) : 0, 21329
IAST [candidate] (22.55 ms) : 0, 22550
Remote Config [baseline] (680.616 µs) : 0, 681
Remote Config [candidate] (671.73 µs) : 0, 672
Telemetry [baseline] (8.624 ms) : 0, 8624
Telemetry [candidate] (8.837 ms) : 0, 8837
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (831.579 ms) : 0, 831579
BytebuddyAgent [candidate] (837.215 ms) : 0, 837215
GlobalTracer [baseline] (228.895 ms) : 0, 228895
GlobalTracer [candidate] (229.526 ms) : 0, 229526
AppSec [baseline] (58.298 ms) : 0, 58298
AppSec [candidate] (58.17 ms) : 0, 58170
IAST [baseline] (21.341 ms) : 0, 21341
IAST [candidate] (21.489 ms) : 0, 21489
Remote Config [baseline] (656.389 µs) : 0, 656
Remote Config [candidate] (663.208 µs) : 0, 663
Telemetry [baseline] (8.747 ms) : 0, 8747
Telemetry [candidate] (8.722 ms) : 0, 8722
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (827.36 ms) : 0, 827360
BytebuddyAgent [candidate] (831.647 ms) : 0, 831647
GlobalTracer [baseline] (229.065 ms) : 0, 229065
GlobalTracer [candidate] (230.779 ms) : 0, 230779
AppSec [baseline] (58.145 ms) : 0, 58145
AppSec [candidate] (58.002 ms) : 0, 58002
IAST [baseline] (20.802 ms) : 0, 20802
IAST [candidate] (20.828 ms) : 0, 20828
Remote Config [baseline] (649.656 µs) : 0, 650
Remote Config [candidate] (654.639 µs) : 0, 655
Telemetry [baseline] (8.631 ms) : 0, 8631
Telemetry [candidate] (8.553 ms) : 0, 8553

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.46.0-SNAPSHOT~5328b1ae2e, baseline=1.46.0-SNAPSHOT~3bbea8564a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.043 s) : 0, 1043127
Total [baseline] (10.471 s) : 0, 10471011
Agent [candidate] (1.04 s) : 0, 1039963
Total [candidate] (10.408 s) : 0, 10408107
section appsec
Agent [baseline] (1.175 s) : 0, 1175368
Total [baseline] (10.743 s) : 0, 10742523
Agent [candidate] (1.179 s) : 0, 1179352
Total [candidate] (10.734 s) : 0, 10734105
section iast
Agent [baseline] (1.165 s) : 0, 1165386
Total [baseline] (10.988 s) : 0, 10987759
Agent [candidate] (1.164 s) : 0, 1163781
Total [candidate] (10.916 s) : 0, 10915808
section profiling
Agent [baseline] (1.251 s) : 0, 1250748
Total [baseline] (10.795 s) : 0, 10795092
Agent [candidate] (1.256 s) : 0, 1256003
Total [candidate] (10.827 s) : 0, 10826834

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.043 s	-
Agent	appsec	1.175 s	132.241 ms (12.7%)
Agent	iast	1.165 s	122.259 ms (11.7%)
Agent	profiling	1.251 s	207.62 ms (19.9%)
Total	tracing	10.471 s	-
Total	appsec	10.743 s	271.512 ms (2.6%)
Total	iast	10.988 s	516.748 ms (4.9%)
Total	profiling	10.795 s	324.081 ms (3.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.04 s	-
Agent	appsec	1.179 s	139.389 ms (13.4%)
Agent	iast	1.164 s	123.818 ms (11.9%)
Agent	profiling	1.256 s	216.04 ms (20.8%)
Total	tracing	10.408 s	-
Total	appsec	10.734 s	325.997 ms (3.1%)
Total	iast	10.916 s	507.701 ms (4.9%)
Total	profiling	10.827 s	418.727 ms (4.0%)

gantt
    title petclinic - break down per module: candidate=1.46.0-SNAPSHOT~5328b1ae2e, baseline=1.46.0-SNAPSHOT~3bbea8564a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.697 ms) : 0, 718697
BytebuddyAgent [candidate] (715.472 ms) : 0, 715472
GlobalTracer [baseline] (239.77 ms) : 0, 239770
GlobalTracer [candidate] (239.696 ms) : 0, 239696
AppSec [baseline] (55.236 ms) : 0, 55236
AppSec [candidate] (55.315 ms) : 0, 55315
Remote Config [baseline] (731.404 µs) : 0, 731
Remote Config [candidate] (710.141 µs) : 0, 710
Telemetry [baseline] (13.71 ms) : 0, 13710
Telemetry [candidate] (13.665 ms) : 0, 13665
section appsec
BytebuddyAgent [baseline] (729.797 ms) : 0, 729797
BytebuddyAgent [candidate] (732.781 ms) : 0, 732781
GlobalTracer [baseline] (235.708 ms) : 0, 235708
GlobalTracer [candidate] (236.604 ms) : 0, 236604
AppSec [baseline] (176.115 ms) : 0, 176115
AppSec [candidate] (176.453 ms) : 0, 176453
IAST [baseline] (19.251 ms) : 0, 19251
IAST [candidate] (19.269 ms) : 0, 19269
Remote Config [baseline] (679.58 µs) : 0, 680
Remote Config [candidate] (670.987 µs) : 0, 671
Telemetry [baseline] (8.513 ms) : 0, 8513
Telemetry [candidate] (8.194 ms) : 0, 8194
section iast
BytebuddyAgent [baseline] (831.005 ms) : 0, 831005
BytebuddyAgent [candidate] (831.13 ms) : 0, 831130
GlobalTracer [baseline] (230.509 ms) : 0, 230509
GlobalTracer [candidate] (228.955 ms) : 0, 228955
AppSec [baseline] (57.972 ms) : 0, 57972
AppSec [candidate] (58.145 ms) : 0, 58145
IAST [baseline] (21.562 ms) : 0, 21562
IAST [candidate] (21.244 ms) : 0, 21244
Remote Config [baseline] (660.702 µs) : 0, 661
Remote Config [candidate] (642.065 µs) : 0, 642
Telemetry [baseline] (8.675 ms) : 0, 8675
Telemetry [candidate] (8.669 ms) : 0, 8669
section profiling
BytebuddyAgent [baseline] (702.84 ms) : 0, 702840
BytebuddyAgent [candidate] (704.651 ms) : 0, 704651
GlobalTracer [baseline] (346.574 ms) : 0, 346574
GlobalTracer [candidate] (349.241 ms) : 0, 349241
AppSec [baseline] (55.036 ms) : 0, 55036
AppSec [candidate] (54.707 ms) : 0, 54707
Remote Config [baseline] (716.679 µs) : 0, 717
Remote Config [candidate] (726.132 µs) : 0, 726
Telemetry [baseline] (8.787 ms) : 0, 8787
Telemetry [candidate] (8.893 ms) : 0, 8893
ProfilingAgent [baseline] (94.878 ms) : 0, 94878
ProfilingAgent [candidate] (95.75 ms) : 0, 95750
Profiling [baseline] (94.902 ms) : 0, 94902
Profiling [candidate] (95.774 ms) : 0, 95774

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-01-24T14:32:14	2025-01-24T14:39:16
git_branch	master	jb/serverless_tag
git_commit_date	1737720979	1737728239
git_commit_sha	`3bbea85`	`5328b1a`
release_version	1.46.0-SNAPSHOT~3bbea8564a	1.46.0-SNAPSHOT~5328b1ae2e
start_time	2025-01-24T14:32:00	2025-01-24T14:39:03

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1737729913	1737729913
ci_job_id	779520066	779520066
ci_pipeline_id	53921230	53921230
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-xugqgpm8-project-304-concurrent-4-pup3rk4y 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-xugqgpm8-project-304-concurrent-4-pup3rk4y 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 18 unstable metrics.

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~5328b1ae2e, baseline=1.46.0-SNAPSHOT~3bbea8564a
    dateFormat X
    axisFormat %s
section baseline
no_agent (376.576 µs) : 357, 396
.   : milestone, 377,
iast (503.627 µs) : 481, 527
.   : milestone, 504,
iast_FULL (743.353 µs) : 720, 766
.   : milestone, 743,
iast_GLOBAL (549.002 µs) : 526, 572
.   : milestone, 549,
iast_HARDCODED_SECRET_DISABLED (505.484 µs) : 483, 528
.   : milestone, 505,
iast_INACTIVE (456.952 µs) : 435, 478
.   : milestone, 457,
iast_TELEMETRY_OFF (496.622 µs) : 473, 520
.   : milestone, 497,
tracing (452.697 µs) : 431, 474
.   : milestone, 453,
section candidate
no_agent (373.985 µs) : 354, 394
.   : milestone, 374,
iast (500.555 µs) : 478, 523
.   : milestone, 501,
iast_FULL (738.446 µs) : 716, 761
.   : milestone, 738,
iast_GLOBAL (559.365 µs) : 536, 583
.   : milestone, 559,
iast_HARDCODED_SECRET_DISABLED (506.658 µs) : 484, 530
.   : milestone, 507,
iast_INACTIVE (458.049 µs) : 436, 480
.   : milestone, 458,
iast_TELEMETRY_OFF (494.974 µs) : 472, 518
.   : milestone, 495,
tracing (455.001 µs) : 434, 476
.   : milestone, 455,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	376.576 µs [356.979 µs, 396.173 µs]	-
iast	503.627 µs [480.739 µs, 526.516 µs]	127.051 µs (33.7%)
iast_FULL	743.353 µs [720.364 µs, 766.342 µs]	366.777 µs (97.4%)
iast_GLOBAL	549.002 µs [525.774 µs, 572.229 µs]	172.426 µs (45.8%)
iast_HARDCODED_SECRET_DISABLED	505.484 µs [482.536 µs, 528.432 µs]	128.908 µs (34.2%)
iast_INACTIVE	456.952 µs [435.491 µs, 478.413 µs]	80.376 µs (21.3%)
iast_TELEMETRY_OFF	496.622 µs [473.326 µs, 519.919 µs]	120.047 µs (31.9%)
tracing	452.697 µs [431.41 µs, 473.985 µs]	76.121 µs (20.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	373.985 µs [353.535 µs, 394.434 µs]	-
iast	500.555 µs [478.237 µs, 522.873 µs]	126.57 µs (33.8%)
iast_FULL	738.446 µs [716.332 µs, 760.561 µs]	364.462 µs (97.5%)
iast_GLOBAL	559.365 µs [535.644 µs, 583.086 µs]	185.38 µs (49.6%)
iast_HARDCODED_SECRET_DISABLED	506.658 µs [483.814 µs, 529.501 µs]	132.673 µs (35.5%)
iast_INACTIVE	458.049 µs [436.451 µs, 479.647 µs]	84.064 µs (22.5%)
iast_TELEMETRY_OFF	494.974 µs [471.55 µs, 518.397 µs]	120.989 µs (32.4%)
tracing	455.001 µs [433.767 µs, 476.236 µs]	81.017 µs (21.7%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~5328b1ae2e, baseline=1.46.0-SNAPSHOT~3bbea8564a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.354 ms) : 1334, 1375
.   : milestone, 1354,
appsec (1.744 ms) : 1721, 1767
.   : milestone, 1744,
appsec_no_iast (1.735 ms) : 1709, 1761
.   : milestone, 1735,
iast (1.507 ms) : 1482, 1531
.   : milestone, 1507,
profiling (1.533 ms) : 1509, 1557
.   : milestone, 1533,
tracing (1.468 ms) : 1443, 1493
.   : milestone, 1468,
section candidate
no_agent (1.366 ms) : 1347, 1386
.   : milestone, 1366,
appsec (1.732 ms) : 1708, 1755
.   : milestone, 1732,
appsec_no_iast (1.745 ms) : 1720, 1770
.   : milestone, 1745,
iast (1.494 ms) : 1470, 1519
.   : milestone, 1494,
profiling (1.507 ms) : 1484, 1531
.   : milestone, 1507,
tracing (1.487 ms) : 1461, 1513
.   : milestone, 1487,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.354 ms [1.334 ms, 1.375 ms]	-
appsec	1.744 ms [1.721 ms, 1.767 ms]	390.219 µs (28.8%)
appsec_no_iast	1.735 ms [1.709 ms, 1.761 ms]	380.989 µs (28.1%)
iast	1.507 ms [1.482 ms, 1.531 ms]	152.415 µs (11.3%)
profiling	1.533 ms [1.509 ms, 1.557 ms]	178.89 µs (13.2%)
tracing	1.468 ms [1.443 ms, 1.493 ms]	113.872 µs (8.4%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.366 ms [1.347 ms, 1.386 ms]	-
appsec	1.732 ms [1.708 ms, 1.755 ms]	365.244 µs (26.7%)
appsec_no_iast	1.745 ms [1.72 ms, 1.77 ms]	378.468 µs (27.7%)
iast	1.494 ms [1.47 ms, 1.519 ms]	127.899 µs (9.4%)
profiling	1.507 ms [1.484 ms, 1.531 ms]	140.812 µs (10.3%)
tracing	1.487 ms [1.461 ms, 1.513 ms]	120.439 µs (8.8%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	jb/serverless_tag
git_commit_date	1737720979	1737728239
git_commit_sha	`3bbea85`	`5328b1a`
release_version	1.46.0-SNAPSHOT~3bbea8564a	1.46.0-SNAPSHOT~5328b1ae2e

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1737730485	1737730485
ci_job_id	779520067	779520067
ci_pipeline_id	53921230	53921230
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-dmnxfugi-project-304-concurrent-3-570t87tp 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-dmnxfugi-project-304-concurrent-3-570t87tp 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~5328b1ae2e, baseline=1.46.0-SNAPSHOT~3bbea8564a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.475 ms) : 1463, 1486
.   : milestone, 1475,
appsec (2.359 ms) : 2316, 2402
.   : milestone, 2359,
iast (2.11 ms) : 2056, 2164
.   : milestone, 2110,
iast_GLOBAL (2.158 ms) : 2103, 2212
.   : milestone, 2158,
profiling (2.005 ms) : 1960, 2051
.   : milestone, 2005,
tracing (1.952 ms) : 1910, 1995
.   : milestone, 1952,
section candidate
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (2.352 ms) : 2309, 2395
.   : milestone, 2352,
iast (2.109 ms) : 2055, 2164
.   : milestone, 2109,
iast_GLOBAL (2.155 ms) : 2101, 2210
.   : milestone, 2155,
profiling (2.468 ms) : 2280, 2656
.   : milestone, 2468,
tracing (1.959 ms) : 1917, 2001
.   : milestone, 1959,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.475 ms [1.463 ms, 1.486 ms]	-
appsec	2.359 ms [2.316 ms, 2.402 ms]	884.098 µs (60.0%)
iast	2.11 ms [2.056 ms, 2.164 ms]	635.232 µs (43.1%)
iast_GLOBAL	2.158 ms [2.103 ms, 2.212 ms]	682.83 µs (46.3%)
profiling	2.005 ms [1.96 ms, 2.051 ms]	530.751 µs (36.0%)
tracing	1.952 ms [1.91 ms, 1.995 ms]	477.646 µs (32.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.476 ms [1.465 ms, 1.488 ms]	-
appsec	2.352 ms [2.309 ms, 2.395 ms]	875.719 µs (59.3%)
iast	2.109 ms [2.055 ms, 2.164 ms]	633.019 µs (42.9%)
iast_GLOBAL	2.155 ms [2.101 ms, 2.21 ms]	678.889 µs (46.0%)
profiling	2.468 ms [2.28 ms, 2.656 ms]	991.673 µs (67.2%)
tracing	1.959 ms [1.917 ms, 2.001 ms]	482.675 µs (32.7%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~5328b1ae2e, baseline=1.46.0-SNAPSHOT~3bbea8564a
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.957 s) : 14957000, 14957000
.   : milestone, 14957000,
appsec (15.036 s) : 15036000, 15036000
.   : milestone, 15036000,
iast (18.545 s) : 18545000, 18545000
.   : milestone, 18545000,
iast_GLOBAL (18.205 s) : 18205000, 18205000
.   : milestone, 18205000,
profiling (15.108 s) : 15108000, 15108000
.   : milestone, 15108000,
tracing (15.367 s) : 15367000, 15367000
.   : milestone, 15367000,
section candidate
no_agent (14.936 s) : 14936000, 14936000
.   : milestone, 14936000,
appsec (15.219 s) : 15219000, 15219000
.   : milestone, 15219000,
iast (18.969 s) : 18969000, 18969000
.   : milestone, 18969000,
iast_GLOBAL (18.142 s) : 18142000, 18142000
.   : milestone, 18142000,
profiling (15.583 s) : 15583000, 15583000
.   : milestone, 15583000,
tracing (15.028 s) : 15028000, 15028000
.   : milestone, 15028000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.957 s [14.957 s, 14.957 s]	-
appsec	15.036 s [15.036 s, 15.036 s]	79.0 ms (0.5%)
iast	18.545 s [18.545 s, 18.545 s]	3.588 s (24.0%)
iast_GLOBAL	18.205 s [18.205 s, 18.205 s]	3.248 s (21.7%)
profiling	15.108 s [15.108 s, 15.108 s]	151.0 ms (1.0%)
tracing	15.367 s [15.367 s, 15.367 s]	410.0 ms (2.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.936 s [14.936 s, 14.936 s]	-
appsec	15.219 s [15.219 s, 15.219 s]	283.0 ms (1.9%)
iast	18.969 s [18.969 s, 18.969 s]	4.033 s (27.0%)
iast_GLOBAL	18.142 s [18.142 s, 18.142 s]	3.206 s (21.5%)
profiling	15.583 s [15.583 s, 15.583 s]	647.0 ms (4.3%)
tracing	15.028 s [15.028 s, 15.028 s]	92.0 ms (0.6%)

PerfectSlayer

Sounds good to me.

Nitpick: there are weird changes related to wildcard imports 🤔

...ing/profiling-uploader/src/test/java/com/datadog/profiling/uploader/ProfileUploaderTest.java

internal-api/src/main/java/datadog/trace/api/Config.java

| Package | Type | Package file | Manager | Update | Change | |---|---|---|---|---|---| | [com.google.cloud:google-cloud-datastore](https://github.com/googleapis/java-datastore) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `2.25.4` -> `2.26.0` | | [com.datadoghq:dd-trace-api](https://github.com/datadog/dd-trace-java) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `1.45.2` -> `1.46.0` | | [com.datadoghq:dd-trace-ot](https://github.com/datadog/dd-trace-java) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `1.45.2` -> `1.46.0` | | [software.amazon.awssdk:sdk-core](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.30.9` -> `2.30.10` | | [software.amazon.awssdk:dynamodb-enhanced](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.30.9` -> `2.30.10` | | [software.amazon.awssdk:dynamodb](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.30.9` -> `2.30.10` | | [software.amazon.awssdk:aws-core](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.30.9` -> `2.30.10` | | [software.amazon.awssdk:bom](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.30.9` -> `2.30.10` | | [software.amazon.awssdk:auth](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.30.9` -> `2.30.10` | --- ### Release Notes <details> <summary>googleapis/java-datastore (com.google.cloud:google-cloud-datastore)</summary> ### [`v2.26.0`](https://github.com/googleapis/java-datastore/blob/HEAD/CHANGELOG.md#2260-2025-01-29) ##### Features - Add firestoreInDatastoreMode for datastore emulator ([#1698](googleapis/java-datastore#1698)) ([50f106d](googleapis/java-datastore@50f106d)) ##### Dependencies - Update dependency com.google.cloud:sdk-platform-java-config to v3.42.0 ([#1725](googleapis/java-datastore#1725)) ([1cbaf22](googleapis/java-datastore@1cbaf22)) </details> <details> <summary>datadog/dd-trace-java (com.datadoghq:dd-trace-api)</summary> ### [`v1.46.0`](https://github.com/DataDog/dd-trace-java/releases/tag/v1.46.0): 1.46.0 ##### Breaking Changes > \[!WARNING] > jnr-unixsocket is now an external dependency of dd-trace-ot and must be included when deploying dd-trace-ot. > \[!NOTE] > The API `TracerScope.setAsync(boolean)`, used to manually control asynchronous span propagation, does no more apply to the scope instance but to the active span scope. ##### Components ##### Application Security Management (IAST) - 🐛 Fix String.replace instrumentation for IAST ([#8281](DataDog/dd-trace-java#8281) - [@Mariovido](https://github.com/Mariovido)) - ✨ Apply the standard nomenclature to the stacktrace configs ([#8244](DataDog/dd-trace-java#8244) - [@jandro996](https://github.com/jandro996)) - 🐛 Exclude false positive weak randomness ([#8232](DataDog/dd-trace-java#8232) - [@jandro996](https://github.com/jandro996)) - ✨ Propagation of translateEscapes of String class ([#8186](DataDog/dd-trace-java#8186) - [@sezen-datadog](https://github.com/sezen-datadog)) - ✨ Add security control metrics ([#8175](DataDog/dd-trace-java#8175) - [@jandro996](https://github.com/jandro996)) - ✨ Increase IAST propagation to StringBuffer setLength ([#8128](DataDog/dd-trace-java#8128) - [@Mariovido](https://github.com/Mariovido)) - ✨ Add IAST taint tracking for DB values ([#8072](DataDog/dd-trace-java#8072) - [@Mariovido](https://github.com/Mariovido)) ##### Application Security Management (WAF) - 🐛 Prevents a NPE when there is no subscriber for user events ([#8258](DataDog/dd-trace-java#8258) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - ✨ Apply the standard nomenclature to the stacktrace configs ([#8244](DataDog/dd-trace-java#8244) - [@jandro996](https://github.com/jandro996)) - 🐛 Ensure cached subscriptions are cleared on reconfiguration via RC ([#8229](DataDog/dd-trace-java#8229) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - ✨ Add support for session tracking in Vertx ([#8167](DataDog/dd-trace-java#8167) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - ✨ Create span tag: \_dd.appsec.rasp.timeout ([#8269](DataDog/dd-trace-java#8269) - [@Mariovido](https://github.com/Mariovido)) ##### Build & Tooling - 🐛 Ensure shaded helpers have unique names when injected into class-loaders ([#8192](DataDog/dd-trace-java#8192) - [@mcculls](https://github.com/mcculls)) ##### Configuration at Runtime - 🐛 Remove filtering of `DD_SERVICE` and `DD_ENV` from the tracer ([#8176](DataDog/dd-trace-java#8176) - [@mhlidd](https://github.com/mhlidd)) ##### Continuous Integration Visibility - 🧹 Generalize TestRetryPolicy to TestExecutionPolicy ([#8302](DataDog/dd-trace-java#8302) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - 🧹 Parallelize CI Visibility settings requests ([#8299](DataDog/dd-trace-java#8299) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - 🧹 Generalize test retry logic ([#8289](DataDog/dd-trace-java#8289) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - 🧹 Generalize tests skipping logic ([#8288](DataDog/dd-trace-java#8288) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - 🧹 Remove skip and shouldBeSkipped methods from TestEventsHandler in favor of isSkippable ([#8286](DataDog/dd-trace-java#8286) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - ✨⚡ Optimize Git repository information computation ([#8270](DataDog/dd-trace-java#8270) - [@dougqh](https://github.com/dougqh)) - ✨ Always request known tests from the backend ([#8268](DataDog/dd-trace-java#8268) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - ✨ Fix NPE when trying to get retry analyzer in Test NG ([#8253](DataDog/dd-trace-java#8253) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - 🐛 Set test framework and test framework version tags atomically ([#8252](DataDog/dd-trace-java#8252) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - ✨ Add debug logging to Android Gradle module layout logic ([#8251](DataDog/dd-trace-java#8251) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - 🐛 Fix source and destination folders computation for Android Gradle projects ([#8190](DataDog/dd-trace-java#8190) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - ✨ Add basic Scala Weaver sbt support ([#8189](DataDog/dd-trace-java#8189) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Implement impacted tests detection ([#8188](DataDog/dd-trace-java#8188) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) ##### Data Streams Monitoring - ✨ Change hash computation for protobuf to better represent impacting changes + save proto number in schema ([#8201](DataDog/dd-trace-java#8201) - [@vandonr](https://github.com/vandonr)) ##### Database Monitoring - Add peer service tag in dbm sql commenter ([#7913](DataDog/dd-trace-java#7913) - [@jordan-wong](https://github.com/jordan-wong)) ##### Dynamic Instrumentation - ✨ Add support for SymDB to scan directories ([#8306](DataDog/dd-trace-java#8306) - [@jpbempel](https://github.com/jpbempel)) - ✨ Add SymDB report for any jar scanning failures ([#8300](DataDog/dd-trace-java#8300) - [@jpbempel](https://github.com/jpbempel)) - ✨ Use two budgets depending on type ([#8283](DataDog/dd-trace-java#8283) - [@evanchooly](https://github.com/evanchooly)) - ✨ Institute a 10 snapshot per probe per trace budget ([#8277](DataDog/dd-trace-java#8277) - [@evanchooly](https://github.com/evanchooly)) - 🐛 Avoid double snapshots for Exception Replay ([#8273](DataDog/dd-trace-java#8273) - [@jpbempel](https://github.com/jpbempel)) - ✨ Simplify code origins. Separate out snapshot generation. ([#8263](DataDog/dd-trace-java#8263) - [@evanchooly](https://github.com/evanchooly)) - ✨ Add Exception probe custom instrumentation ([#8230](DataDog/dd-trace-java#8230) - [@jpbempel](https://github.com/jpbempel)) - ✨ Enhance log probes to honor debug session tags ([#8215](DataDog/dd-trace-java#8215) - [@evanchooly](https://github.com/evanchooly)) - 🐛 Don't redact env tokens from debugger probe snapshots ([#8211](DataDog/dd-trace-java#8211) - [@watson](https://github.com/watson)) - ✨⚡ Move Trace/SpanId capture at commit time ([#8184](DataDog/dd-trace-java#8184) - [@jpbempel](https://github.com/jpbempel)) - 🐛 Capture values at entry for method probe ([#8169](DataDog/dd-trace-java#8169) - [@jpbempel](https://github.com/jpbempel)) ##### JMX fetch - 🐛 Mute JMXFetch Shutdown in progress error ([#8068](DataDog/dd-trace-java#8068) - [@ygree](https://github.com/ygree)) ##### OpenTracing - ⚠️🧹 Make jnr-unixsocket an explicit dependency of dd-trace-ot ([#8307](DataDog/dd-trace-java#8307) - [@mcculls](https://github.com/mcculls)) ##### Profiling - 🐛 Avoid unsupported API call for creating folders on windows ([#8304](DataDog/dd-trace-java#8304) - [@jbachorik](https://github.com/jbachorik)) - ✨ Tag profiles for serverless ([#8279](DataDog/dd-trace-java#8279) - [@jbachorik](https://github.com/jbachorik)) - ✨ add queue type and length to queue events ([#8242](DataDog/dd-trace-java#8242) - [@richardstartin](https://github.com/richardstartin)) - 🐛 TempLocationManager Fixes and Improvements ([#8191](DataDog/dd-trace-java#8191) - [@jbachorik](https://github.com/jbachorik)) - ✨ Bump ddprof to 1.18.0 ([#8173](DataDog/dd-trace-java#8173) - [@jbachorik](https://github.com/jbachorik)) - ✨ Report profiler initialization and configuration errors to telemetry ([#8171](DataDog/dd-trace-java#8171) - [@jbachorik](https://github.com/jbachorik)) ##### Telemetry - ✨ Add pending traces report in tracer flares ([#8053](DataDog/dd-trace-java#8053) - [@mhlidd](https://github.com/mhlidd)) ##### Testing - ✨ Test http server requests in parallel ([#8222](DataDog/dd-trace-java#8222) - [@amarziali](https://github.com/amarziali)) ##### Trace context propagation - ✨ Add non default propagator registration ([#8310](DataDog/dd-trace-java#8310) - [@PerfectSlayer](https://github.com/PerfectSlayer)) ##### Tracer core - ✨ Probe for existence of IBMSASL or ACCP security providers ([#8276](DataDog/dd-trace-java#8276) - [@mcculls](https://github.com/mcculls)) - ✨⚡ Overhead improvement to agent feedback based sampling ([#8265](DataDog/dd-trace-java#8265) - [@dougqh](https://github.com/dougqh)) - 🧹 Move async propagation API from scope to tracer ([#8231](DataDog/dd-trace-java#8231) - [@PerfectSlayer](https://github.com/PerfectSlayer)) - ✨ Introduce context propagation API ([#8161](DataDog/dd-trace-java#8161) - [@PerfectSlayer](https://github.com/PerfectSlayer)) - ✨🧪 Use env-entry to add tags per webapp deployment ([#8138](DataDog/dd-trace-java#8138) - [@amarziali](https://github.com/amarziali)) - ✨ Introduce context helpers API ([#8134](DataDog/dd-trace-java#8134) - [@PerfectSlayer](https://github.com/PerfectSlayer)) - ✨ Support IPv6 values for `DD_AGENT_HOST` and `DD_TRACE_AGENT_URL` ([#7984](DataDog/dd-trace-java#7984) - [@mhlidd](https://github.com/mhlidd)) ##### Instrumentations ##### Apache HttpComponents - 🐛 Properly finish spans and support latest apache httpclient5 ([#8272](DataDog/dd-trace-java#8272) - [@amarziali](https://github.com/amarziali)) ##### AWS Lambda instrumentation - 🐛 Properly capture lambda payloads for all handler types. ([#8264](DataDog/dd-trace-java#8264) - [@purple4reina](https://github.com/purple4reina)) ##### AWS S3 instrumentation - 💡 Create S3 instrumentation + add span pointers ([#8075](DataDog/dd-trace-java#8075) - [@nhulston](https://github.com/nhulston)) ##### AWS SDK instrumentation - 🐛 Revert "Add avoid double instrumenting lambda non-streaming handlers." ([#8247](DataDog/dd-trace-java#8247) - [@nhulston](https://github.com/nhulston)) ##### Cassandra - ✨ Allow extracting keyspace from statement result ([#8239](DataDog/dd-trace-java#8239) - [@amarziali](https://github.com/amarziali)) ##### Core Java language instrumentation - ✨ Propagation of translateEscapes of String class ([#8186](DataDog/dd-trace-java#8186) - [@sezen-datadog](https://github.com/sezen-datadog)) ##### Eclipse Vert.x instrumentation - 🐛 Fix vertx worker propagation and error handling ([#8237](DataDog/dd-trace-java#8237) - [@amarziali](https://github.com/amarziali)) - ✨ Support vertx 5 ([#8220](DataDog/dd-trace-java#8220) - [@amarziali](https://github.com/amarziali)) - ✨ Add support for session tracking in Vertx ([#8167](DataDog/dd-trace-java#8167) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) ##### Kafka instrumentation - 🐛 Prevent possible NPE calculating Kafka record header size ([#8292](DataDog/dd-trace-java#8292) - [@ygree](https://github.com/ygree)) ##### Mule instrumentation - 🐛 Fix crash using Mule with JPMS ([#8187](DataDog/dd-trace-java#8187) - [@amarziali](https://github.com/amarziali)) ##### Protocol Buffer instrumentation - ✨ Change hash computation for protobuf to better represent impacting changes + save proto number in schema ([#8201](DataDog/dd-trace-java#8201) - [@vandonr](https://github.com/vandonr)) ##### Spring instrumentation - 🐛 Preserve getQualifier from spring scheduling runnables ([#8293](DataDog/dd-trace-java#8293) - [@amarziali](https://github.com/amarziali)) </details> --- ### Configuration 📅 **Schedule**: Branch creation - "after 6pm every weekday,before 2am every weekday" in timezone Australia/Melbourne, Automerge - At any time (no schedule defined). 🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied. ♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. 👻 **Immortal**: This PR will be recreated if closed unmerged. Get [config help](https://github.com/renovatebot/renovate/discussions) if that's undesired. --- - [ ] If you want to rebase/retry this PR, check this box --- This PR has been generated by [Renovate Bot](https://github.com/renovatebot/renovate). GitOrigin-RevId: bb09d47e4eed77a003f630273b4d0a84003eb899

Tag profiles for serverless

601469c

jbachorik added comp: profiling Profiling type:task labels Jan 24, 2025

jbachorik requested review from a team as code owners January 24, 2025 10:15

jbachorik requested a review from PerfectSlayer January 24, 2025 10:15

PerfectSlayer approved these changes Jan 24, 2025

View reviewed changes

...ing/profiling-uploader/src/test/java/com/datadog/profiling/uploader/ProfileUploaderTest.java Outdated Show resolved Hide resolved

internal-api/src/main/java/datadog/trace/api/Config.java Show resolved Hide resolved

Fix wildcard imports

5328b1a

jbachorik added type: enhancement Enhancements and improvements and removed type: enhancement Enhancements and improvements labels Jan 24, 2025

jbachorik merged commit 088b7bf into master Jan 24, 2025
176 checks passed

jbachorik deleted the jb/serverless_tag branch January 24, 2025 15:57

github-actions bot added this to the 1.46.0 milestone Jan 24, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Tag profiles for serverless #8279

Tag profiles for serverless #8279

Uh oh!

jbachorik commented Jan 24, 2025 •

edited by atlassian bot

Loading

Uh oh!

pr-commenter bot commented Jan 24, 2025 •

edited

Loading

Uh oh!

PerfectSlayer left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Tag profiles for serverless #8279

Tag profiles for serverless #8279

Uh oh!

Conversation

jbachorik commented Jan 24, 2025 • edited by atlassian bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Jan 24, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

PerfectSlayer left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

jbachorik commented Jan 24, 2025 •

edited by atlassian bot

Loading

pr-commenter bot commented Jan 24, 2025 •

edited

Loading