Update smoke test latest tool versions by dd-octo-sts[bot] · Pull Request #11083 · DataDog/dd-trace-java

dd-octo-sts · 2026-04-12T05:42:28Z

What Does This Do

This PR updates the pinned "latest" tool versions used by CI Visibility smoke tests:

Gradle: 9.4.1
Maven: 3.9.14
Maven Surefire: 3.5.5

Motivation

Keep smoke tests running against the latest stable versions of build tools.

Contributor Checklist

Verify smoke tests pass with the new versions

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

pr-commenter · 2026-04-12T06:30:28Z

Benchmarks

⚠️ Warning: Baseline build not found for merge-base commit. Comparing against the latest commit on master instead.

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	ci/update-smoke-test-latest-versions-20260412
git_commit_date	1775834061	1775972545
git_commit_sha	`5ab378f`	`3fb750d`
release_version	1.62.0-SNAPSHOT~5ab378f780	1.62.0-SNAPSHOT~3fb750d58e

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1775974368	1775974368
ci_job_id	1587970758	1587970758
ci_pipeline_id	107261771	107261771
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-mtuy851t 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-mtuy851t 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~3fb750d58e, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1063877
Total [baseline] (8.894 s) : 0, 8894028
Agent [candidate] (1.066 s) : 0, 1066135
Total [candidate] (8.855 s) : 0, 8855156
section iast
Agent [baseline] (1.222 s) : 0, 1221954
Total [baseline] (9.556 s) : 0, 9556035
Agent [candidate] (1.225 s) : 0, 1224829
Total [candidate] (9.55 s) : 0, 9550262

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.064 s	-
Agent	iast	1.222 s	158.077 ms (14.9%)
Total	tracing	8.894 s	-
Total	iast	9.556 s	662.007 ms (7.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.066 s	-
Agent	iast	1.225 s	158.694 ms (14.9%)
Total	tracing	8.855 s	-
Total	iast	9.55 s	695.106 ms (7.8%)

gantt
    title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~3fb750d58e, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.256 ms) : 0, 1256
crashtracking [candidate] (1.238 ms) : 0, 1238
BytebuddyAgent [baseline] (637.741 ms) : 0, 637741
BytebuddyAgent [candidate] (639.024 ms) : 0, 639024
AgentMeter [baseline] (29.605 ms) : 0, 29605
AgentMeter [candidate] (29.684 ms) : 0, 29684
GlobalTracer [baseline] (249.98 ms) : 0, 249980
GlobalTracer [candidate] (250.653 ms) : 0, 250653
AppSec [baseline] (32.322 ms) : 0, 32322
AppSec [candidate] (32.337 ms) : 0, 32337
Debugger [baseline] (59.592 ms) : 0, 59592
Debugger [candidate] (59.957 ms) : 0, 59957
Remote Config [baseline] (603.196 µs) : 0, 603
Remote Config [candidate] (608.438 µs) : 0, 608
Telemetry [baseline] (8.17 ms) : 0, 8170
Telemetry [candidate] (8.203 ms) : 0, 8203
Flare Poller [baseline] (8.193 ms) : 0, 8193
Flare Poller [candidate] (8.157 ms) : 0, 8157
section iast
crashtracking [baseline] (1.241 ms) : 0, 1241
crashtracking [candidate] (1.232 ms) : 0, 1232
BytebuddyAgent [baseline] (799.106 ms) : 0, 799106
BytebuddyAgent [candidate] (801.825 ms) : 0, 801825
AgentMeter [baseline] (11.346 ms) : 0, 11346
AgentMeter [candidate] (11.426 ms) : 0, 11426
GlobalTracer [baseline] (239.039 ms) : 0, 239039
GlobalTracer [candidate] (239.415 ms) : 0, 239415
AppSec [baseline] (32.029 ms) : 0, 32029
AppSec [candidate] (28.706 ms) : 0, 28706
Debugger [baseline] (60.595 ms) : 0, 60595
Debugger [candidate] (62.68 ms) : 0, 62680
Remote Config [baseline] (532.46 µs) : 0, 532
Remote Config [candidate] (524.526 µs) : 0, 525
Telemetry [baseline] (12.451 ms) : 0, 12451
Telemetry [candidate] (13.562 ms) : 0, 13562
Flare Poller [baseline] (3.506 ms) : 0, 3506
Flare Poller [candidate] (3.466 ms) : 0, 3466
IAST [baseline] (25.871 ms) : 0, 25871
IAST [candidate] (25.815 ms) : 0, 25815

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~3fb750d58e, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.069 s) : 0, 1069101
Total [baseline] (11.159 s) : 0, 11158711
Agent [candidate] (1.056 s) : 0, 1056351
Total [candidate] (11.037 s) : 0, 11036575
section appsec
Agent [baseline] (1.251 s) : 0, 1250540
Total [baseline] (11.12 s) : 0, 11120064
Agent [candidate] (1.247 s) : 0, 1246539
Total [candidate] (11.151 s) : 0, 11151090
section iast
Agent [baseline] (1.226 s) : 0, 1226455
Total [baseline] (11.329 s) : 0, 11328515
Agent [candidate] (1.252 s) : 0, 1252427
Total [candidate] (11.323 s) : 0, 11322611
section profiling
Agent [baseline] (1.192 s) : 0, 1191689
Total [baseline] (11.093 s) : 0, 11092645
Agent [candidate] (1.185 s) : 0, 1185343
Total [candidate] (11.161 s) : 0, 11161208

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.069 s	-
Agent	appsec	1.251 s	181.44 ms (17.0%)
Agent	iast	1.226 s	157.355 ms (14.7%)
Agent	profiling	1.192 s	122.589 ms (11.5%)
Total	tracing	11.159 s	-
Total	appsec	11.12 s	-38.647 ms (-0.3%)
Total	iast	11.329 s	169.803 ms (1.5%)
Total	profiling	11.093 s	-66.066 ms (-0.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.056 s	-
Agent	appsec	1.247 s	190.188 ms (18.0%)
Agent	iast	1.252 s	196.075 ms (18.6%)
Agent	profiling	1.185 s	128.991 ms (12.2%)
Total	tracing	11.037 s	-
Total	appsec	11.151 s	114.515 ms (1.0%)
Total	iast	11.323 s	286.036 ms (2.6%)
Total	profiling	11.161 s	124.633 ms (1.1%)

gantt
    title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~3fb750d58e, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.258 ms) : 0, 1258
crashtracking [candidate] (1.23 ms) : 0, 1230
BytebuddyAgent [baseline] (637.57 ms) : 0, 637570
BytebuddyAgent [candidate] (632.144 ms) : 0, 632144
AgentMeter [baseline] (29.844 ms) : 0, 29844
AgentMeter [candidate] (29.458 ms) : 0, 29458
GlobalTracer [baseline] (251.908 ms) : 0, 251908
GlobalTracer [candidate] (248.68 ms) : 0, 248680
AppSec [baseline] (32.482 ms) : 0, 32482
AppSec [candidate] (31.941 ms) : 0, 31941
Debugger [baseline] (60.896 ms) : 0, 60896
Debugger [candidate] (59.854 ms) : 0, 59854
Remote Config [baseline] (606.524 µs) : 0, 607
Remote Config [candidate] (600.324 µs) : 0, 600
Telemetry [baseline] (8.242 ms) : 0, 8242
Telemetry [candidate] (8.076 ms) : 0, 8076
Flare Poller [baseline] (9.952 ms) : 0, 9952
Flare Poller [candidate] (8.119 ms) : 0, 8119
section appsec
crashtracking [baseline] (1.238 ms) : 0, 1238
crashtracking [candidate] (1.212 ms) : 0, 1212
BytebuddyAgent [baseline] (662.091 ms) : 0, 662091
BytebuddyAgent [candidate] (661.079 ms) : 0, 661079
AgentMeter [baseline] (12.102 ms) : 0, 12102
AgentMeter [candidate] (12.056 ms) : 0, 12056
GlobalTracer [baseline] (249.543 ms) : 0, 249543
GlobalTracer [candidate] (248.259 ms) : 0, 248259
AppSec [baseline] (185.311 ms) : 0, 185311
AppSec [candidate] (184.27 ms) : 0, 184270
Debugger [baseline] (66.199 ms) : 0, 66199
Debugger [candidate] (66.101 ms) : 0, 66101
Remote Config [baseline] (617.873 µs) : 0, 618
Remote Config [candidate] (602.736 µs) : 0, 603
Telemetry [baseline] (8.724 ms) : 0, 8724
Telemetry [candidate] (8.445 ms) : 0, 8445
Flare Poller [baseline] (3.551 ms) : 0, 3551
Flare Poller [candidate] (3.481 ms) : 0, 3481
IAST [baseline] (24.688 ms) : 0, 24688
IAST [candidate] (24.611 ms) : 0, 24611
section iast
crashtracking [baseline] (1.217 ms) : 0, 1217
crashtracking [candidate] (1.255 ms) : 0, 1255
BytebuddyAgent [baseline] (801.823 ms) : 0, 801823
BytebuddyAgent [candidate] (820.687 ms) : 0, 820687
AgentMeter [baseline] (11.387 ms) : 0, 11387
AgentMeter [candidate] (11.742 ms) : 0, 11742
GlobalTracer [baseline] (239.96 ms) : 0, 239960
GlobalTracer [candidate] (244.564 ms) : 0, 244564
AppSec [baseline] (30.256 ms) : 0, 30256
AppSec [candidate] (30.1 ms) : 0, 30100
Debugger [baseline] (62.432 ms) : 0, 62432
Debugger [candidate] (63.582 ms) : 0, 63582
Remote Config [baseline] (539.956 µs) : 0, 540
Remote Config [candidate] (527.983 µs) : 0, 528
Telemetry [baseline] (12.554 ms) : 0, 12554
Telemetry [candidate] (12.669 ms) : 0, 12669
Flare Poller [baseline] (3.51 ms) : 0, 3510
Flare Poller [candidate] (3.504 ms) : 0, 3504
IAST [baseline] (26.097 ms) : 0, 26097
IAST [candidate] (26.642 ms) : 0, 26642
section profiling
crashtracking [baseline] (1.18 ms) : 0, 1180
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (692.819 ms) : 0, 692819
BytebuddyAgent [candidate] (691.595 ms) : 0, 691595
AgentMeter [baseline] (9.27 ms) : 0, 9270
AgentMeter [candidate] (9.163 ms) : 0, 9163
GlobalTracer [baseline] (209.59 ms) : 0, 209590
GlobalTracer [candidate] (207.134 ms) : 0, 207134
AppSec [baseline] (33.005 ms) : 0, 33005
AppSec [candidate] (32.578 ms) : 0, 32578
Debugger [baseline] (66.601 ms) : 0, 66601
Debugger [candidate] (65.483 ms) : 0, 65483
Remote Config [baseline] (583.839 µs) : 0, 584
Remote Config [candidate] (565.26 µs) : 0, 565
Telemetry [baseline] (7.964 ms) : 0, 7964
Telemetry [candidate] (7.8 ms) : 0, 7800
Flare Poller [baseline] (3.627 ms) : 0, 3627
Flare Poller [candidate] (3.569 ms) : 0, 3569
ProfilingAgent [baseline] (95.713 ms) : 0, 95713
ProfilingAgent [candidate] (94.748 ms) : 0, 94748
Profiling [baseline] (96.299 ms) : 0, 96299
Profiling [candidate] (95.312 ms) : 0, 95312

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	ci/update-smoke-test-latest-versions-20260412
git_commit_date	1775834061	1775972545
git_commit_sha	`5ab378f`	`3fb750d`
release_version	1.62.0-SNAPSHOT~5ab378f780	1.62.0-SNAPSHOT~3fb750d58e

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1775974845	1775974845
ci_job_id	1587970760	1587970760
ci_pipeline_id	107261771	107261771
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-7fdibmdb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-7fdibmdb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 5 performance regressions! Performance is the same for 13 metrics, 16 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:iast:high_load	better [-234.249µs; -113.050µs] or [-8.822%; -4.257%]	unsure [-490.530µs; -121.991µs] or [-6.357%; -1.581%]	unstable [-72.677op/s; +214.239op/s] or [-5.394%; +15.902%]	2.482ms	7.410ms	1418.062op/s	2.655ms	7.716ms	1347.281op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load	worse [+204.687µs; +343.918µs] or [+7.522%; +12.638%]	worse [+462.957µs; +899.345µs] or [+6.034%; +11.721%]	unstable [-240.019op/s; +20.456op/s] or [-18.188%; +1.550%]	2.996ms	8.354ms	1209.844op/s	2.721ms	7.673ms	1319.625op/s
scenario:load:petclinic:appsec:high_load	better [-1.397ms; -0.686ms] or [-7.222%; -3.548%]	unsure [-1.789ms; -0.585ms] or [-5.751%; -1.879%]	unstable [-12.942op/s; +38.504op/s] or [-5.441%; +16.187%]	18.299ms	29.926ms	250.656op/s	19.340ms	31.114ms	237.875op/s
scenario:load:petclinic:iast:high_load	worse [+489.858µs; +1290.292µs] or [+2.783%; +7.330%]	worse [+0.675ms; +2.277ms] or [+2.338%; +7.887%]	unstable [-39.088op/s; +14.525op/s] or [-15.019%; +5.581%]	18.493ms	30.343ms	247.969op/s	17.603ms	28.868ms	260.250op/s
scenario:load:petclinic:no_agent:high_load	worse [+0.452ms; +2.031ms] or [+2.559%; +11.484%]	unstable [+0.170ms; +3.351ms] or [+0.574%; +11.328%]	unstable [-46.231op/s; +10.418op/s] or [-17.837%; +4.020%]	18.924ms	31.340ms	241.281op/s	17.682ms	29.580ms	259.188op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~3fb750d58e, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.001 ms) : 17818, 18185
.   : milestone, 18001,
appsec (19.62 ms) : 19419, 19821
.   : milestone, 19620,
code_origins (17.893 ms) : 17718, 18067
.   : milestone, 17893,
iast (17.931 ms) : 17749, 18113
.   : milestone, 17931,
profiling (18.419 ms) : 18235, 18604
.   : milestone, 18419,
tracing (18.23 ms) : 18050, 18410
.   : milestone, 18230,
section candidate
no_agent (19.347 ms) : 19150, 19543
.   : milestone, 19347,
appsec (18.616 ms) : 18428, 18804
.   : milestone, 18616,
code_origins (18.102 ms) : 17927, 18276
.   : milestone, 18102,
iast (18.82 ms) : 18630, 19010
.   : milestone, 18820,
profiling (18.438 ms) : 18256, 18621
.   : milestone, 18438,
tracing (17.816 ms) : 17639, 17993
.   : milestone, 17816,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.001 ms [17.818 ms, 18.185 ms]	-
appsec	19.62 ms [19.419 ms, 19.821 ms]	1.619 ms (9.0%)
code_origins	17.893 ms [17.718 ms, 18.067 ms]	-108.785 µs (-0.6%)
iast	17.931 ms [17.749 ms, 18.113 ms]	-70.506 µs (-0.4%)
profiling	18.419 ms [18.235 ms, 18.604 ms]	418.019 µs (2.3%)
tracing	18.23 ms [18.05 ms, 18.41 ms]	228.376 µs (1.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.347 ms [19.15 ms, 19.543 ms]	-
appsec	18.616 ms [18.428 ms, 18.804 ms]	-730.524 µs (-3.8%)
code_origins	18.102 ms [17.927 ms, 18.276 ms]	-1.245 ms (-6.4%)
iast	18.82 ms [18.63 ms, 19.01 ms]	-526.857 µs (-2.7%)
profiling	18.438 ms [18.256 ms, 18.621 ms]	-908.297 µs (-4.7%)
tracing	17.816 ms [17.639 ms, 17.993 ms]	-1.531 ms (-7.9%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~3fb750d58e, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.332 ms) : 1318, 1347
.   : milestone, 1332,
iast (3.4 ms) : 3353, 3447
.   : milestone, 3400,
iast_FULL (5.955 ms) : 5895, 6015
.   : milestone, 5955,
iast_GLOBAL (3.472 ms) : 3416, 3528
.   : milestone, 3472,
profiling (2.146 ms) : 2125, 2166
.   : milestone, 2146,
tracing (1.94 ms) : 1923, 1957
.   : milestone, 1940,
section candidate
no_agent (1.258 ms) : 1245, 1270
.   : milestone, 1258,
iast (3.227 ms) : 3183, 3272
.   : milestone, 3227,
iast_FULL (5.955 ms) : 5896, 6015
.   : milestone, 5955,
iast_GLOBAL (3.796 ms) : 3728, 3864
.   : milestone, 3796,
profiling (2.219 ms) : 2195, 2243
.   : milestone, 2219,
tracing (1.913 ms) : 1896, 1930
.   : milestone, 1913,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.332 ms [1.318 ms, 1.347 ms]	-
iast	3.4 ms [3.353 ms, 3.447 ms]	2.068 ms (155.2%)
iast_FULL	5.955 ms [5.895 ms, 6.015 ms]	4.623 ms (346.9%)
iast_GLOBAL	3.472 ms [3.416 ms, 3.528 ms]	2.14 ms (160.6%)
profiling	2.146 ms [2.125 ms, 2.166 ms]	813.072 µs (61.0%)
tracing	1.94 ms [1.923 ms, 1.957 ms]	607.539 µs (45.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.258 ms [1.245 ms, 1.27 ms]	-
iast	3.227 ms [3.183 ms, 3.272 ms]	1.97 ms (156.6%)
iast_FULL	5.955 ms [5.896 ms, 6.015 ms]	4.698 ms (373.5%)
iast_GLOBAL	3.796 ms [3.728 ms, 3.864 ms]	2.538 ms (201.8%)
profiling	2.219 ms [2.195 ms, 2.243 ms]	961.095 µs (76.4%)
tracing	1.913 ms [1.896 ms, 1.93 ms]	655.316 µs (52.1%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	ci/update-smoke-test-latest-versions-20260412
git_commit_date	1775834061	1775972545
git_commit_sha	`5ab378f`	`3fb750d`
release_version	1.62.0-SNAPSHOT~5ab378f780	1.62.0-SNAPSHOT~3fb750d58e

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1775974609	1775974609
ci_job_id	1587970761	1587970761
ci_pipeline_id	107261771	107261771
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-q5uqjrbt 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-q5uqjrbt 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~3fb750d58e, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.662 s) : 15662000, 15662000
.   : milestone, 15662000,
appsec (15.027 s) : 15027000, 15027000
.   : milestone, 15027000,
iast (18.354 s) : 18354000, 18354000
.   : milestone, 18354000,
iast_GLOBAL (18.165 s) : 18165000, 18165000
.   : milestone, 18165000,
profiling (14.847 s) : 14847000, 14847000
.   : milestone, 14847000,
tracing (14.945 s) : 14945000, 14945000
.   : milestone, 14945000,
section candidate
no_agent (15.608 s) : 15608000, 15608000
.   : milestone, 15608000,
appsec (14.674 s) : 14674000, 14674000
.   : milestone, 14674000,
iast (18.315 s) : 18315000, 18315000
.   : milestone, 18315000,
iast_GLOBAL (17.989 s) : 17989000, 17989000
.   : milestone, 17989000,
profiling (14.872 s) : 14872000, 14872000
.   : milestone, 14872000,
tracing (14.998 s) : 14998000, 14998000
.   : milestone, 14998000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.662 s [15.662 s, 15.662 s]	-
appsec	15.027 s [15.027 s, 15.027 s]	-635.0 ms (-4.1%)
iast	18.354 s [18.354 s, 18.354 s]	2.692 s (17.2%)
iast_GLOBAL	18.165 s [18.165 s, 18.165 s]	2.503 s (16.0%)
profiling	14.847 s [14.847 s, 14.847 s]	-815.0 ms (-5.2%)
tracing	14.945 s [14.945 s, 14.945 s]	-717.0 ms (-4.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.608 s [15.608 s, 15.608 s]	-
appsec	14.674 s [14.674 s, 14.674 s]	-934.0 ms (-6.0%)
iast	18.315 s [18.315 s, 18.315 s]	2.707 s (17.3%)
iast_GLOBAL	17.989 s [17.989 s, 17.989 s]	2.381 s (15.3%)
profiling	14.872 s [14.872 s, 14.872 s]	-736.0 ms (-4.7%)
tracing	14.998 s [14.998 s, 14.998 s]	-610.0 ms (-3.9%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~3fb750d58e, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.491 ms) : 1479, 1503
.   : milestone, 1491,
appsec (2.538 ms) : 2483, 2593
.   : milestone, 2538,
iast (2.272 ms) : 2203, 2341
.   : milestone, 2272,
iast_GLOBAL (2.312 ms) : 2242, 2381
.   : milestone, 2312,
profiling (2.1 ms) : 2046, 2155
.   : milestone, 2100,
tracing (2.101 ms) : 2046, 2155
.   : milestone, 2101,
section candidate
no_agent (1.487 ms) : 1475, 1499
.   : milestone, 1487,
appsec (3.813 ms) : 3591, 4034
.   : milestone, 3813,
iast (2.278 ms) : 2209, 2347
.   : milestone, 2278,
iast_GLOBAL (2.317 ms) : 2247, 2387
.   : milestone, 2317,
profiling (2.524 ms) : 2359, 2688
.   : milestone, 2524,
tracing (2.074 ms) : 2021, 2127
.   : milestone, 2074,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.491 ms [1.479 ms, 1.503 ms]	-
appsec	2.538 ms [2.483 ms, 2.593 ms]	1.047 ms (70.2%)
iast	2.272 ms [2.203 ms, 2.341 ms]	780.847 µs (52.4%)
iast_GLOBAL	2.312 ms [2.242 ms, 2.381 ms]	820.796 µs (55.0%)
profiling	2.1 ms [2.046 ms, 2.155 ms]	609.234 µs (40.9%)
tracing	2.101 ms [2.046 ms, 2.155 ms]	609.462 µs (40.9%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.487 ms [1.475 ms, 1.499 ms]	-
appsec	3.813 ms [3.591 ms, 4.034 ms]	2.325 ms (156.4%)
iast	2.278 ms [2.209 ms, 2.347 ms]	791.086 µs (53.2%)
iast_GLOBAL	2.317 ms [2.247 ms, 2.387 ms]	830.034 µs (55.8%)
profiling	2.524 ms [2.359 ms, 2.688 ms]	1.037 ms (69.7%)
tracing	2.074 ms [2.021 ms, 2.127 ms]	586.929 µs (39.5%)

chore: Update smoke test latest tool versions

3fb750d

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

dd-octo-sts bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Apr 12, 2026

dd-octo-sts bot requested a review from a team as a code owner April 12, 2026 05:42

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update smoke test latest tool versions#11083

Update smoke test latest tool versions#11083
dd-octo-sts[bot] wants to merge 1 commit intomasterfrom
ci/update-smoke-test-latest-versions-20260412

dd-octo-sts bot commented Apr 12, 2026

Uh oh!

pr-commenter bot commented Apr 12, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

0 participants

Conversation

dd-octo-sts bot commented Apr 12, 2026

What Does This Do

Motivation

Contributor Checklist

Uh oh!

pr-commenter bot commented Apr 12, 2026

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

0 participants