Implement attempt to fix v3 and v4 and bump capability version #8824

daniel-mohedano · 2025-05-14T13:44:11Z

What Does This Do

Implements versions 3 and 4 of attempt to fix, with the following changes:

@test.test_management.attempt_to_fix_passed will also now be tagged with false as value when an attempt to fix test doesn't pass all retries
The test management test settings request now also includes the commit sha to check if a fix is present or not
Bumps attempt to fix capabilities version from 2 to 4
Updates instrumentation tests fixtures adding "attempt_to_fix_passed": "false" on failed attempt to fix attempts
Updates smoke tests fixtures with the new capability version

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: SDTEST-1964 [SDTEST-1986]

pr-commenter · 2025-05-14T14:18:48Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/attempt-to-fix-v3-v4
git_commit_date	1747640407	1747645034
git_commit_sha	`45c7667`	`bde6ede`
release_version	1.50.0-SNAPSHOT~45c7667bff	1.50.0-SNAPSHOT~bde6edeb40

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1747647497	1747647497
ci_job_id	943319696	943319696
ci_pipeline_id	65448456	65448456
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-eswuofc8-project-304-concurrent-0-6jzz0wrt 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-eswuofc8-project-304-concurrent-0-6jzz0wrt 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 53 metrics, 18 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~bde6edeb40, baseline=1.50.0-SNAPSHOT~45c7667bff

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.034 s) : 0, 1033710
Total [baseline] (10.516 s) : 0, 10515976
Agent [candidate] (1.021 s) : 0, 1020840
Total [candidate] (10.514 s) : 0, 10514173
section appsec
Agent [baseline] (1.159 s) : 0, 1158831
Total [baseline] (10.703 s) : 0, 10703108
Agent [candidate] (1.162 s) : 0, 1161792
Total [candidate] (10.705 s) : 0, 10704702
section iast
Agent [baseline] (1.15 s) : 0, 1150006
Total [baseline] (10.887 s) : 0, 10886893
Agent [candidate] (1.155 s) : 0, 1154738
Total [candidate] (10.912 s) : 0, 10911939
section profiling
Agent [baseline] (1.287 s) : 0, 1286775
Total [baseline] (10.854 s) : 0, 10853710
Agent [candidate] (1.29 s) : 0, 1290398
Total [candidate] (10.847 s) : 0, 10846763

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.034 s	-
Agent	appsec	1.159 s	125.121 ms (12.1%)
Agent	iast	1.15 s	116.296 ms (11.3%)
Agent	profiling	1.287 s	253.065 ms (24.5%)
Total	tracing	10.516 s	-
Total	appsec	10.703 s	187.132 ms (1.8%)
Total	iast	10.887 s	370.917 ms (3.5%)
Total	profiling	10.854 s	337.734 ms (3.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.021 s	-
Agent	appsec	1.162 s	140.952 ms (13.8%)
Agent	iast	1.155 s	133.898 ms (13.1%)
Agent	profiling	1.29 s	269.558 ms (26.4%)
Total	tracing	10.514 s	-
Total	appsec	10.705 s	190.529 ms (1.8%)
Total	iast	10.912 s	397.766 ms (3.8%)
Total	profiling	10.847 s	332.589 ms (3.2%)

gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~bde6edeb40, baseline=1.50.0-SNAPSHOT~45c7667bff

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (692.166 ms) : 0, 692166
BytebuddyAgent [candidate] (681.645 ms) : 0, 681645
GlobalTracer [baseline] (242.957 ms) : 0, 242957
GlobalTracer [candidate] (240.226 ms) : 0, 240226
AppSec [baseline] (55.759 ms) : 0, 55759
AppSec [candidate] (55.179 ms) : 0, 55179
Debugger [baseline] (8.41 ms) : 0, 8410
Debugger [candidate] (9.803 ms) : 0, 9803
Remote Config [baseline] (717.276 µs) : 0, 717
Remote Config [candidate] (692.165 µs) : 0, 692
Telemetry [baseline] (9.969 ms) : 0, 9969
Telemetry [candidate] (9.801 ms) : 0, 9801
section appsec
BytebuddyAgent [baseline] (698.987 ms) : 0, 698987
BytebuddyAgent [candidate] (700.54 ms) : 0, 700540
GlobalTracer [baseline] (236.421 ms) : 0, 236421
GlobalTracer [candidate] (236.92 ms) : 0, 236920
IAST [baseline] (21.445 ms) : 0, 21445
IAST [candidate] (21.681 ms) : 0, 21681
AppSec [baseline] (175.371 ms) : 0, 175371
AppSec [candidate] (175.048 ms) : 0, 175048
Debugger [baseline] (5.919 ms) : 0, 5919
Debugger [candidate] (6.283 ms) : 0, 6283
Remote Config [baseline] (609.83 µs) : 0, 610
Remote Config [candidate] (622.222 µs) : 0, 622
Telemetry [baseline] (7.318 ms) : 0, 7318
Telemetry [candidate] (8.065 ms) : 0, 8065
section iast
BytebuddyAgent [baseline] (802.675 ms) : 0, 802675
BytebuddyAgent [candidate] (806.055 ms) : 0, 806055
GlobalTracer [baseline] (230.879 ms) : 0, 230879
GlobalTracer [candidate] (231.731 ms) : 0, 231731
IAST [baseline] (28.405 ms) : 0, 28405
IAST [candidate] (30.074 ms) : 0, 30074
AppSec [baseline] (50.241 ms) : 0, 50241
AppSec [candidate] (48.781 ms) : 0, 48781
Debugger [baseline] (5.871 ms) : 0, 5871
Debugger [candidate] (5.917 ms) : 0, 5917
Remote Config [baseline] (585.232 µs) : 0, 585
Remote Config [candidate] (663.415 µs) : 0, 663
Telemetry [baseline] (7.814 ms) : 0, 7814
Telemetry [candidate] (7.942 ms) : 0, 7942
section profiling
BytebuddyAgent [baseline] (678.053 ms) : 0, 678053
BytebuddyAgent [candidate] (679.519 ms) : 0, 679519
GlobalTracer [baseline] (376.303 ms) : 0, 376303
GlobalTracer [candidate] (377.614 ms) : 0, 377614
AppSec [baseline] (62.219 ms) : 0, 62219
AppSec [candidate] (62.634 ms) : 0, 62634
Debugger [baseline] (6.279 ms) : 0, 6279
Debugger [candidate] (6.354 ms) : 0, 6354
Remote Config [baseline] (659.603 µs) : 0, 660
Remote Config [candidate] (665.717 µs) : 0, 666
Telemetry [baseline] (8.204 ms) : 0, 8204
Telemetry [candidate] (8.325 ms) : 0, 8325
ProfilingAgent [baseline] (104.023 ms) : 0, 104023
ProfilingAgent [candidate] (104.039 ms) : 0, 104039
Profiling [baseline] (104.048 ms) : 0, 104048
Profiling [candidate] (104.062 ms) : 0, 104062

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~bde6edeb40, baseline=1.50.0-SNAPSHOT~45c7667bff

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.032 s) : 0, 1031961
Total [baseline] (8.677 s) : 0, 8677190
Agent [candidate] (1.017 s) : 0, 1017108
Total [candidate] (8.65 s) : 0, 8650481
section iast
Agent [baseline] (1.147 s) : 0, 1146901
Total [baseline] (9.211 s) : 0, 9210579
Agent [candidate] (1.146 s) : 0, 1146454
Total [candidate] (9.218 s) : 0, 9218201
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.148 s) : 0, 1147668
Total [baseline] (9.242 s) : 0, 9242378
Agent [candidate] (1.149 s) : 0, 1148923
Total [candidate] (9.223 s) : 0, 9222865
section iast_TELEMETRY_OFF
Agent [baseline] (1.147 s) : 0, 1147293
Total [baseline] (9.22 s) : 0, 9219870
Agent [candidate] (1.144 s) : 0, 1143844
Total [candidate] (9.267 s) : 0, 9266598

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.032 s	-
Agent	iast	1.147 s	114.94 ms (11.1%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.148 s	115.707 ms (11.2%)
Agent	iast_TELEMETRY_OFF	1.147 s	115.332 ms (11.2%)
Total	tracing	8.677 s	-
Total	iast	9.211 s	533.389 ms (6.1%)
Total	iast_HARDCODED_SECRET_DISABLED	9.242 s	565.188 ms (6.5%)
Total	iast_TELEMETRY_OFF	9.22 s	542.68 ms (6.3%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.017 s	-
Agent	iast	1.146 s	129.346 ms (12.7%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.149 s	131.814 ms (13.0%)
Agent	iast_TELEMETRY_OFF	1.144 s	126.736 ms (12.5%)
Total	tracing	8.65 s	-
Total	iast	9.218 s	567.719 ms (6.6%)
Total	iast_HARDCODED_SECRET_DISABLED	9.223 s	572.384 ms (6.6%)
Total	iast_TELEMETRY_OFF	9.267 s	616.117 ms (7.1%)

gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~bde6edeb40, baseline=1.50.0-SNAPSHOT~45c7667bff

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (690.312 ms) : 0, 690312
BytebuddyAgent [candidate] (680.792 ms) : 0, 680792
GlobalTracer [baseline] (243.184 ms) : 0, 243184
GlobalTracer [candidate] (239.556 ms) : 0, 239556
AppSec [baseline] (55.649 ms) : 0, 55649
AppSec [candidate] (55.747 ms) : 0, 55747
Debugger [baseline] (8.422 ms) : 0, 8422
Debugger [candidate] (6.959 ms) : 0, 6959
Remote Config [baseline] (716.524 µs) : 0, 717
Remote Config [candidate] (712.478 µs) : 0, 712
Telemetry [baseline] (9.857 ms) : 0, 9857
Telemetry [candidate] (9.802 ms) : 0, 9802
section iast
BytebuddyAgent [baseline] (800.859 ms) : 0, 800859
BytebuddyAgent [candidate] (799.755 ms) : 0, 799755
GlobalTracer [baseline] (229.748 ms) : 0, 229748
GlobalTracer [candidate] (230.32 ms) : 0, 230320
IAST [baseline] (28.236 ms) : 0, 28236
IAST [candidate] (28.313 ms) : 0, 28313
AppSec [baseline] (49.431 ms) : 0, 49431
AppSec [candidate] (50.319 ms) : 0, 50319
Debugger [baseline] (5.895 ms) : 0, 5895
Debugger [candidate] (5.864 ms) : 0, 5864
Remote Config [baseline] (599.312 µs) : 0, 599
Remote Config [candidate] (590.705 µs) : 0, 591
Telemetry [baseline] (7.895 ms) : 0, 7895
Telemetry [candidate] (7.833 ms) : 0, 7833
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (800.887 ms) : 0, 800887
BytebuddyAgent [candidate] (801.374 ms) : 0, 801374
GlobalTracer [baseline] (230.515 ms) : 0, 230515
GlobalTracer [candidate] (230.471 ms) : 0, 230471
IAST [baseline] (28.298 ms) : 0, 28298
IAST [candidate] (26.684 ms) : 0, 26684
AppSec [baseline] (50.078 ms) : 0, 50078
AppSec [candidate] (52.295 ms) : 0, 52295
Debugger [baseline] (5.86 ms) : 0, 5860
Debugger [candidate] (5.952 ms) : 0, 5952
Remote Config [baseline] (604.858 µs) : 0, 605
Remote Config [candidate] (609.564 µs) : 0, 610
Telemetry [baseline] (7.886 ms) : 0, 7886
Telemetry [candidate] (8.001 ms) : 0, 8001
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (801.26 ms) : 0, 801260
BytebuddyAgent [candidate] (797.514 ms) : 0, 797514
GlobalTracer [baseline] (230.4 ms) : 0, 230400
GlobalTracer [candidate] (230.583 ms) : 0, 230583
IAST [baseline] (24.392 ms) : 0, 24392
IAST [candidate] (23.774 ms) : 0, 23774
AppSec [baseline] (53.378 ms) : 0, 53378
AppSec [candidate] (54.048 ms) : 0, 54048
Debugger [baseline] (5.955 ms) : 0, 5955
Debugger [candidate] (5.948 ms) : 0, 5948
Remote Config [baseline] (600.816 µs) : 0, 601
Remote Config [candidate] (604.656 µs) : 0, 605
Telemetry [baseline] (7.738 ms) : 0, 7738
Telemetry [candidate] (7.849 ms) : 0, 7849

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-05-19T09:08:36	2025-05-19T09:16:21
git_branch	master	daniel.mohedano/attempt-to-fix-v3-v4
git_commit_date	1747640407	1747645034
git_commit_sha	`45c7667`	`bde6ede`
release_version	1.50.0-SNAPSHOT~45c7667bff	1.50.0-SNAPSHOT~bde6edeb40
start_time	2025-05-19T09:08:22	2025-05-19T09:16:07

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1747646579	1747646579
ci_job_id	943319697	943319697
ci_pipeline_id	65448456	65448456
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-eswuofc8-project-304-concurrent-1-vhf68894 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-eswuofc8-project-304-concurrent-1-vhf68894 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~bde6edeb40, baseline=1.50.0-SNAPSHOT~45c7667bff
    dateFormat X
    axisFormat %s
section baseline
no_agent (379.577 µs) : 359, 400
.   : milestone, 380,
iast (522.564 µs) : 501, 545
.   : milestone, 523,
iast_FULL (733.948 µs) : 712, 756
.   : milestone, 734,
iast_GLOBAL (582.119 µs) : 559, 605
.   : milestone, 582,
iast_HARDCODED_SECRET_DISABLED (514.765 µs) : 492, 538
.   : milestone, 515,
iast_INACTIVE (468.031 µs) : 445, 491
.   : milestone, 468,
iast_TELEMETRY_OFF (522.28 µs) : 499, 546
.   : milestone, 522,
tracing (463.935 µs) : 442, 486
.   : milestone, 464,
section candidate
no_agent (381.041 µs) : 361, 401
.   : milestone, 381,
iast (518.471 µs) : 497, 540
.   : milestone, 518,
iast_FULL (741.344 µs) : 720, 763
.   : milestone, 741,
iast_GLOBAL (563.689 µs) : 542, 586
.   : milestone, 564,
iast_HARDCODED_SECRET_DISABLED (519.301 µs) : 496, 543
.   : milestone, 519,
iast_INACTIVE (473.028 µs) : 450, 496
.   : milestone, 473,
iast_TELEMETRY_OFF (513.681 µs) : 490, 537
.   : milestone, 514,
tracing (465.52 µs) : 443, 488
.   : milestone, 466,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	379.577 µs [359.455 µs, 399.7 µs]	-
iast	522.564 µs [500.623 µs, 544.504 µs]	142.986 µs (37.7%)
iast_FULL	733.948 µs [712.005 µs, 755.89 µs]	354.37 µs (93.4%)
iast_GLOBAL	582.119 µs [559.047 µs, 605.191 µs]	202.542 µs (53.4%)
iast_HARDCODED_SECRET_DISABLED	514.765 µs [491.74 µs, 537.791 µs]	135.188 µs (35.6%)
iast_INACTIVE	468.031 µs [445.425 µs, 490.637 µs]	88.453 µs (23.3%)
iast_TELEMETRY_OFF	522.28 µs [498.869 µs, 545.691 µs]	142.703 µs (37.6%)
tracing	463.935 µs [441.751 µs, 486.12 µs]	84.358 µs (22.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	381.041 µs [361.379 µs, 400.703 µs]	-
iast	518.471 µs [496.788 µs, 540.153 µs]	137.43 µs (36.1%)
iast_FULL	741.344 µs [719.624 µs, 763.064 µs]	360.303 µs (94.6%)
iast_GLOBAL	563.689 µs [541.798 µs, 585.58 µs]	182.648 µs (47.9%)
iast_HARDCODED_SECRET_DISABLED	519.301 µs [495.695 µs, 542.907 µs]	138.26 µs (36.3%)
iast_INACTIVE	473.028 µs [449.797 µs, 496.259 µs]	91.987 µs (24.1%)
iast_TELEMETRY_OFF	513.681 µs [490.075 µs, 537.287 µs]	132.64 µs (34.8%)
tracing	465.52 µs [443.401 µs, 487.639 µs]	84.479 µs (22.2%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~bde6edeb40, baseline=1.50.0-SNAPSHOT~45c7667bff
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.359 ms) : 1339, 1379
.   : milestone, 1359,
appsec (1.75 ms) : 1726, 1774
.   : milestone, 1750,
appsec_no_iast (1.737 ms) : 1713, 1760
.   : milestone, 1737,
code_origins (1.684 ms) : 1658, 1710
.   : milestone, 1684,
iast (1.518 ms) : 1494, 1541
.   : milestone, 1518,
profiling (1.518 ms) : 1494, 1542
.   : milestone, 1518,
tracing (1.492 ms) : 1468, 1516
.   : milestone, 1492,
section candidate
no_agent (1.356 ms) : 1336, 1376
.   : milestone, 1356,
appsec (1.726 ms) : 1702, 1749
.   : milestone, 1726,
appsec_no_iast (1.733 ms) : 1710, 1756
.   : milestone, 1733,
code_origins (1.673 ms) : 1646, 1701
.   : milestone, 1673,
iast (1.533 ms) : 1509, 1556
.   : milestone, 1533,
profiling (1.51 ms) : 1486, 1534
.   : milestone, 1510,
tracing (1.497 ms) : 1473, 1522
.   : milestone, 1497,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.359 ms [1.339 ms, 1.379 ms]	-
appsec	1.75 ms [1.726 ms, 1.774 ms]	391.009 µs (28.8%)
appsec_no_iast	1.737 ms [1.713 ms, 1.76 ms]	377.639 µs (27.8%)
code_origins	1.684 ms [1.658 ms, 1.71 ms]	325.034 µs (23.9%)
iast	1.518 ms [1.494 ms, 1.541 ms]	158.698 µs (11.7%)
profiling	1.518 ms [1.494 ms, 1.542 ms]	159.14 µs (11.7%)
tracing	1.492 ms [1.468 ms, 1.516 ms]	133.303 µs (9.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.356 ms [1.336 ms, 1.376 ms]	-
appsec	1.726 ms [1.702 ms, 1.749 ms]	369.623 µs (27.3%)
appsec_no_iast	1.733 ms [1.71 ms, 1.756 ms]	377.493 µs (27.8%)
code_origins	1.673 ms [1.646 ms, 1.701 ms]	317.493 µs (23.4%)
iast	1.533 ms [1.509 ms, 1.556 ms]	176.694 µs (13.0%)
profiling	1.51 ms [1.486 ms, 1.534 ms]	154.329 µs (11.4%)
tracing	1.497 ms [1.473 ms, 1.522 ms]	141.452 µs (10.4%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/attempt-to-fix-v3-v4
git_commit_date	1747640407	1747645034
git_commit_sha	`45c7667`	`bde6ede`
release_version	1.50.0-SNAPSHOT~45c7667bff	1.50.0-SNAPSHOT~bde6edeb40

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1747647109	1747647109
ci_job_id	943319698	943319698
ci_pipeline_id	65448456	65448456
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-ucdbooq-project-304-concurrent-2-ncw1nxls 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-ucdbooq-project-304-concurrent-2-ncw1nxls 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~bde6edeb40, baseline=1.50.0-SNAPSHOT~45c7667bff
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.598 s) : 15598000, 15598000
.   : milestone, 15598000,
appsec (14.953 s) : 14953000, 14953000
.   : milestone, 14953000,
iast (18.225 s) : 18225000, 18225000
.   : milestone, 18225000,
iast_GLOBAL (18.368 s) : 18368000, 18368000
.   : milestone, 18368000,
profiling (15.028 s) : 15028000, 15028000
.   : milestone, 15028000,
tracing (15.021 s) : 15021000, 15021000
.   : milestone, 15021000,
section candidate
no_agent (14.863 s) : 14863000, 14863000
.   : milestone, 14863000,
appsec (14.757 s) : 14757000, 14757000
.   : milestone, 14757000,
iast (18.969 s) : 18969000, 18969000
.   : milestone, 18969000,
iast_GLOBAL (18.168 s) : 18168000, 18168000
.   : milestone, 18168000,
profiling (15.212 s) : 15212000, 15212000
.   : milestone, 15212000,
tracing (14.83 s) : 14830000, 14830000
.   : milestone, 14830000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.598 s [15.598 s, 15.598 s]	-
appsec	14.953 s [14.953 s, 14.953 s]	-645.0 ms (-4.1%)
iast	18.225 s [18.225 s, 18.225 s]	2.627 s (16.8%)
iast_GLOBAL	18.368 s [18.368 s, 18.368 s]	2.77 s (17.8%)
profiling	15.028 s [15.028 s, 15.028 s]	-570.0 ms (-3.7%)
tracing	15.021 s [15.021 s, 15.021 s]	-577.0 ms (-3.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.863 s [14.863 s, 14.863 s]	-
appsec	14.757 s [14.757 s, 14.757 s]	-106.0 ms (-0.7%)
iast	18.969 s [18.969 s, 18.969 s]	4.106 s (27.6%)
iast_GLOBAL	18.168 s [18.168 s, 18.168 s]	3.305 s (22.2%)
profiling	15.212 s [15.212 s, 15.212 s]	349.0 ms (2.3%)
tracing	14.83 s [14.83 s, 14.83 s]	-33.0 ms (-0.2%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~bde6edeb40, baseline=1.50.0-SNAPSHOT~45c7667bff
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.487 ms) : 1476, 1499
.   : milestone, 1487,
appsec (2.425 ms) : 2376, 2475
.   : milestone, 2425,
iast (2.198 ms) : 2136, 2260
.   : milestone, 2198,
iast_GLOBAL (2.239 ms) : 2177, 2301
.   : milestone, 2239,
profiling (2.066 ms) : 2015, 2117
.   : milestone, 2066,
tracing (2.037 ms) : 1989, 2086
.   : milestone, 2037,
section candidate
no_agent (1.478 ms) : 1466, 1489
.   : milestone, 1478,
appsec (2.419 ms) : 2369, 2469
.   : milestone, 2419,
iast (2.199 ms) : 2137, 2261
.   : milestone, 2199,
iast_GLOBAL (2.24 ms) : 2177, 2302
.   : milestone, 2240,
profiling (2.494 ms) : 2260, 2727
.   : milestone, 2494,
tracing (2.014 ms) : 1966, 2061
.   : milestone, 2014,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.487 ms [1.476 ms, 1.499 ms]	-
appsec	2.425 ms [2.376 ms, 2.475 ms]	938.112 µs (63.1%)
iast	2.198 ms [2.136 ms, 2.26 ms]	710.961 µs (47.8%)
iast_GLOBAL	2.239 ms [2.177 ms, 2.301 ms]	751.624 µs (50.5%)
profiling	2.066 ms [2.015 ms, 2.117 ms]	578.466 µs (38.9%)
tracing	2.037 ms [1.989 ms, 2.086 ms]	549.966 µs (37.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.478 ms [1.466 ms, 1.489 ms]	-
appsec	2.419 ms [2.369 ms, 2.469 ms]	941.227 µs (63.7%)
iast	2.199 ms [2.137 ms, 2.261 ms]	721.201 µs (48.8%)
iast_GLOBAL	2.24 ms [2.177 ms, 2.302 ms]	762.253 µs (51.6%)
profiling	2.494 ms [2.26 ms, 2.727 ms]	1.016 ms (68.8%)
tracing	2.014 ms [1.966 ms, 2.061 ms]	535.995 µs (36.3%)

| Package | Type | Package file | Manager | Update | Change | |---|---|---|---|---|---| | [com.datadoghq:dd-trace-api](https://github.com/datadog/dd-trace-java) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `1.49.0` -> `1.50.0` | --- ### Release Notes <details> <summary>datadog/dd-trace-java (com.datadoghq:dd-trace-api)</summary> ### [`v1.50.0`](https://github.com/DataDog/dd-trace-java/releases/tag/v1.50.0): 1.50.0 ### Deprecation Notice > \[!NOTE] > `DD_RUNTIME_ID_ENABLED` has been deprecated and will be removed in future releases. Please use `DD_RUNTIME_METRICS_RUNTIME_ID_ENABLED` instead. ### Components #### Application Security Management (WAF) - 🐛 Add String length truncation limit to ObjectIntrospector and update truncation metrics ([#8825](DataDog/dd-trace-java#8825) - [@jandro996](https://github.com/jandro996)) - 🐛 Adapt standalone ASM to support API Security ([#8804](DataDog/dd-trace-java#8804) - [@jandro996](https://github.com/jandro996)) - ✨ Add appsec.waf.input\_truncated metric ([#8791](DataDog/dd-trace-java#8791) - [@jandro996](https://github.com/jandro996)) - ✨ Extended appsec request body collection ([#8748](DataDog/dd-trace-java#8748) - [@jandro996](https://github.com/jandro996)) - ✨ Extended appsec request/response headers collection ([#8724](DataDog/dd-trace-java#8724) - [@jandro996](https://github.com/jandro996)) #### Build & Tooling - ✨ Add artifacts to public s3 bucket ([#8947](DataDog/dd-trace-java#8947) - [@randomanderson](https://github.com/randomanderson)) #### Continuous Integration Visibility - ✨ Improve PR information building ([#8908](DataDog/dd-trace-java#8908) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Truncate span stack traces when Test Optimization is enabled ([#8903](DataDog/dd-trace-java#8903) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - 🐛 Ensure auto-detected service name is the same for every process in the same build ([#8902](DataDog/dd-trace-java#8902) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - 🐛 Use tag as fallback in api requests if no branch is available ([#8876](DataDog/dd-trace-java#8876) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Add support for JUnit 5.13-RC1 ([#8865](DataDog/dd-trace-java#8865), [#8871](DataDog/dd-trace-java#8871) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Implement attempt to fix v3 and v4 and bump capability version ([#8824](DataDog/dd-trace-java#8824) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - 🧹 Align retry logic for all test framework instrumentations ([#8803](DataDog/dd-trace-java#8803) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - 🐛 Always build ci workspace without trailing separator ([#8788](DataDog/dd-trace-java#8788) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Add commit discrepancies telemetry when building repository git information ([#8763](DataDog/dd-trace-java#8763) - [@daniel-mohedano](https://github.com/daniel-mohedano)) #### Data Streams Monitoring - 💡 Surface process tags in dsm payloads and use them for base hash calculation ([#8836](DataDog/dd-trace-java#8836) - [@amarziali](https://github.com/amarziali)) #### Dynamic Instrumentation - ✨ Optimized allocations for collection filter functions ([#8896](DataDog/dd-trace-java#8896) - [@jpbempel](https://github.com/jpbempel)) - 🐛 Fix SymDB upload size check ([#8887](DataDog/dd-trace-java#8887) - [@jpbempel](https://github.com/jpbempel)) - 🐛 Add support for Set in filter function ([#8873](DataDog/dd-trace-java#8873) - [@jpbempel](https://github.com/jpbempel)) - 🐛 Add support for isDefined in log template ([#8859](DataDog/dd-trace-java#8859) - [@jpbempel](https://github.com/jpbempel)) - 🐛 Fix Max captured frames for Exception Replay ([#8856](DataDog/dd-trace-java#8856) - [@jpbempel](https://github.com/jpbempel)) - 🐛 Remove static inherited fields collection ([#8832](DataDog/dd-trace-java#8832) - [@jpbempel](https://github.com/jpbempel)) - 💡 Add process tags to dynamic instrumentation intake payload ([#8779](DataDog/dd-trace-java#8779) - [@amarziali](https://github.com/amarziali)) #### GraalVM native-image - ✨ Add support for GraalVM Native GC metrics ([#8913](DataDog/dd-trace-java#8913) - [@ygree](https://github.com/ygree)) - ✨ Add JMXFetch support for GraalVM Native ([#8569](DataDog/dd-trace-java#8569) - [@ygree](https://github.com/ygree)) #### JMX fetch - ✨ Add support for GraalVM Native GC metrics ([#8913](DataDog/dd-trace-java#8913) - [@ygree](https://github.com/ygree)) #### Library Injection - ✨ Deny oracle db jvm based tools ([#8909](DataDog/dd-trace-java#8909) - [@bric3](https://github.com/bric3)) #### OpenTracing - 🐛 Fix OT packaging for exception replay ([#8912](DataDog/dd-trace-java#8912) - [@jpbempel](https://github.com/jpbempel)) #### Profiling - ✨ Bump ddprof to 1.27.0 ([#8893](DataDog/dd-trace-java#8893) - [@jbachorik](https://github.com/jbachorik)) - Properly handle the adaptive sampling interval overflow by [@jbachorik](https://github.com/jbachorik) in DataDog/java-profiler#213 - Fix [#200](DataDog/dd-trace-java#200) Crash related to aligned\_alloc and free in context by [@yanglong1010](https://github.com/yanglong1010) in DataDog/java-profiler#208 - Explicitly initialize empty context page by [@jbachorik](https://github.com/jbachorik) in DataDog/java-profiler#210 - Re-connect crash recursion protection with VM stackwalker by [@jbachorik](https://github.com/jbachorik) in DataDog/java-profiler#214 - ✨ Enable ZSTD compression for profiling ([#8862](DataDog/dd-trace-java#8862) - [@MattAlp](https://github.com/MattAlp)) - ✨ Extend JPS re-implementation to J9 family ([#8813](DataDog/dd-trace-java#8813) - [@MattAlp](https://github.com/MattAlp)) - 💡 Collect process tags for profiling upload requests ([#8780](DataDog/dd-trace-java#8780) - [@amarziali](https://github.com/amarziali)) #### Telemetry - 💡 Surface process tags on telemetry payloads ([#8837](DataDog/dd-trace-java#8837) - [@amarziali](https://github.com/amarziali)) #### Trace context propagation - ✨ Migrating all HttpClient Instrumentations to Inject Full Context ([#8826](DataDog/dd-trace-java#8826) - [@mhlidd](https://github.com/mhlidd)) - ✨ Migrating all HttpServer Instrumentations to Extract full Context ([#8820](DataDog/dd-trace-java#8820) - [@mhlidd](https://github.com/mhlidd)) - ✨ Add context API support OTel propagators ([#8770](DataDog/dd-trace-java#8770) - [@PerfectSlayer](https://github.com/PerfectSlayer)) #### Tracer core - ✨⚡ Skip JAXB generated classes classloader ([#9003](DataDog/dd-trace-java#9003) - [@bric3](https://github.com/bric3)) - ✨ Add DD\_RUNTIME\_METRICS\_RUNTIME\_ID\_ENABLED alias for runtime id generation ([#8981](DataDog/dd-trace-java#8981) - [@amarziali](https://github.com/amarziali)) - 🐛 Use resolved address for peer.hostname when available without hitting the cache ([#8915](DataDog/dd-trace-java#8915) - [@amarziali](https://github.com/amarziali)) - 💡 Surface server name process tag for tomcat ([#8894](DataDog/dd-trace-java#8894) - [@amarziali](https://github.com/amarziali)) - 💡 Surface websphere cell and server name on process tags ([#8880](DataDog/dd-trace-java#8880) - [@amarziali](https://github.com/amarziali)) - ✨ Added special lightweight pre-main class that skips installation on incompatible JVMs. ([#8855](DataDog/dd-trace-java#8855) - [@AlexeyKuznetsov-DD](https://github.com/AlexeyKuznetsov-DD)) - 💡 Add entrypoint type to process tags ([#8839](DataDog/dd-trace-java#8839) - [@amarziali](https://github.com/amarziali)) - ✨ Extend JPS re-implementation to J9 family ([#8813](DataDog/dd-trace-java#8813) - [@MattAlp](https://github.com/MattAlp)) - ✨ Notify listeners when the scope top changes after switching scope stacks ([#8797](DataDog/dd-trace-java#8797) - [@mcculls](https://github.com/mcculls)) - ✨ Read hsperfdata for Java PIDs if jvmstat is unavailable ([#8792](DataDog/dd-trace-java#8792) - [@MattAlp](https://github.com/MattAlp)) - 🐛 Turn JDK socket support on by default ([#8752](DataDog/dd-trace-java#8752) - [@sarahchen6](https://github.com/sarahchen6)) - ✨ Simplify context propagation ([#8719](DataDog/dd-trace-java#8719) - [@PerfectSlayer](https://github.com/PerfectSlayer)) - ✨ Add JSON parsing support ([#8579](DataDog/dd-trace-java#8579) - [@PerfectSlayer](https://github.com/PerfectSlayer)) #### Tracer internal logging - ✨ Fix printing format of span identifiers ([#8897](DataDog/dd-trace-java#8897) - [@vandonr](https://github.com/vandonr)) #### Tracer public API - 💡 Track the source of installation ([#8956](DataDog/dd-trace-java#8956) - [@mabdinur](https://github.com/mabdinur)) - ✨ Enforce size limit on application\_monitoring.yaml files ([#8789](DataDog/dd-trace-java#8789) - [@mtoffl01](https://github.com/mtoffl01)) - ✨ Enabling baggage cache to support limits and non-ascii characters ([#8713](DataDog/dd-trace-java#8713) - [@mhlidd](https://github.com/mhlidd)) ### Instrumentations #### AWS Lambda instrumentation - ✨ Pass Lambda Request ID to Extension ([#8814](DataDog/dd-trace-java#8814) - [@nhulston](https://github.com/nhulston)) #### Core Java language instrumentation - ✨ Ensure ClassloadingInstrumentation is always applied even with `DD_TRACE_ENABLED=false` ([#8863](DataDog/dd-trace-java#8863) - [@mcculls](https://github.com/mcculls)) #### Eclipse Vert.x instrumentation - 🐛 Do not override route with / in vertx instrumentation ([#8881](DataDog/dd-trace-java#8881) - [@vandonr](https://github.com/vandonr)) #### IBM Liberty - 🐛 Fix error mark on http status for IBM liberty ([#8822](DataDog/dd-trace-java#8822) - [@amarziali](https://github.com/amarziali)) #### JDBC instrumentation - 🐛 Do not prepend DBM <> APM trace comment in SQLCommenter if there is a pg plan hint ([#8864](DataDog/dd-trace-java#8864) - [@edengorevoy](https://github.com/edengorevoy)) #### JMS instrumentation - ✨ Add jms as an extra integration name where there is JMS involved ([#8933](DataDog/dd-trace-java#8933) - [@vandonr](https://github.com/vandonr)) #### Kotlin instrumentation - ✨ Enable kotlin\_coroutine integration by default ([#8848](DataDog/dd-trace-java#8848) - [@mcculls](https://github.com/mcculls)) - 🧹 Rework Kotlin coroutines instrumentation around coroutine context ([#8774](DataDog/dd-trace-java#8774) - [@mcculls](https://github.com/mcculls)) #### OpenTelemetry instrumentation - 🐛 Support WithSpan inheritContext attribute ([#8858](DataDog/dd-trace-java#8858) - [@amarziali](https://github.com/amarziali)) - ✨ Add context API support OTel propagators ([#8770](DataDog/dd-trace-java#8770) - [@PerfectSlayer](https://github.com/PerfectSlayer)) #### Play Framework instrumentation - 🐛 Fix the Play Framework's span resource name priority so that the client JAX-RS 404 cannot override it ([#8591](DataDog/dd-trace-java#8591) - [@ygree](https://github.com/ygree)) #### Quarkus Instrumentation - 🐛 Ignore quarkus jaxrs stubs and cdi wrapper proxies ([#8891](DataDog/dd-trace-java#8891) - [@amarziali](https://github.com/amarziali)) #### ServiceTalk - ✨ Improve ServiceTalk Captured Context API Instrumentation for v0.42.56+ ([#8821](DataDog/dd-trace-java#8821) - [@ygree](https://github.com/ygree)) #### Spring instrumentation - ✨ Supporting Baggage for Instrumentations used in Weblog Tests ([#8773](DataDog/dd-trace-java#8773) - [@mhlidd](https://github.com/mhlidd)) #### WebSocket Instrumentation - 💡 Trace websocket for spring webflux reactive handlers ([#8831](DataDog/dd-trace-java#8831) - [@amarziali](https://github.com/amarziali)) - 💡:test\_tube: WebSocket support for Netty ([#8632](DataDog/dd-trace-java#8632) - [@ValentinZakharov](https://github.com/ValentinZakharov)) #### Zio Instrumentation - 🧹 Cleanup Zio fiber instrumentation to avoid repeated activation of continuation ([#8798](DataDog/dd-trace-java#8798) - [@mcculls](https://github.com/mcculls)) </details> --- ### Configuration 📅 **Schedule**: Branch creation - "after 6pm every weekday,before 2am every weekday" in timezone Australia/Melbourne, Automerge - At any time (no schedule defined). 🚦 **Automerge**: Enabled. ♻ **Rebasing**: Never, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about this update again. --- - [ ] If you want to rebase/retry this PR, check this box --- This PR has been generated by [Renovate Bot](https://github.com/renovatebot/renovate). GitOrigin-RevId: 9207366cdb6a1bd098082305d354a0a3c4622d7a

implement attempt to fix v3 and v4 and bump capability version

d77be4f

daniel-mohedano added comp: ci visibility Continuous Integration Visibility type: enhancement labels May 14, 2025

fix codenarc

1a875c5

nikita-tkachenko-datadog approved these changes May 15, 2025

View reviewed changes

Merge branch 'master' into daniel.mohedano/attempt-to-fix-v3-v4

bde6ede

daniel-mohedano marked this pull request as ready for review May 20, 2025 09:00

daniel-mohedano requested a review from a team as a code owner May 20, 2025 09:00

daniel-mohedano requested a review from Mariovido May 20, 2025 09:00

daniel-mohedano merged commit 4ab4ee3 into master May 20, 2025
784 of 789 checks passed

daniel-mohedano deleted the daniel.mohedano/attempt-to-fix-v3-v4 branch May 20, 2025 09:12

github-actions bot added this to the 1.50.0 milestone May 20, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Implement attempt to fix v3 and v4 and bump capability version #8824

Implement attempt to fix v3 and v4 and bump capability version #8824

Uh oh!

daniel-mohedano commented May 14, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented May 14, 2025 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

Implement attempt to fix v3 and v4 and bump capability version #8824

Implement attempt to fix v3 and v4 and bump capability version #8824

Uh oh!

Conversation

daniel-mohedano commented May 14, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Contributor Checklist

Uh oh!

pr-commenter bot commented May 14, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

Uh oh!

daniel-mohedano commented May 14, 2025 •

edited

Loading

pr-commenter bot commented May 14, 2025 •

edited

Loading