Migrate OpenTelemetry instrumentation tests to JUnit by PerfectSlayer · Pull Request #11081 · DataDog/dd-trace-java

PerfectSlayer · 2026-04-10T17:53:29Z

What Does This Do

Early prototype as a heads-up. It will be split later next week…

Motivation

Additional Notes

Contributor Checklist

Format the title according to the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any other useful labels
Avoid using close, fix, or any linking keywords when referencing an issue
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, migration, or deletion
Update public documentation with any new configuration flags or behaviors

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

pr-commenter · 2026-04-10T18:43:18Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/groovy-to-java
git_commit_date	1775834061	1775843541
git_commit_sha	`5ab378f`	`2b72fff`
release_version	1.62.0-SNAPSHOT~5ab378f780	1.62.0-SNAPSHOT~2b72fff2e6

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1775845407	1775845407
ci_job_id	1586537252	1586537252
ci_pipeline_id	107170356	107170356
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-b3atd79f 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-b3atd79f 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 11 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~2b72fff2e6, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.063 s) : 0, 1063027
Total [baseline] (8.901 s) : 0, 8900771
Agent [candidate] (1.065 s) : 0, 1064584
Total [candidate] (8.862 s) : 0, 8862349
section iast
Agent [baseline] (1.224 s) : 0, 1224307
Total [baseline] (9.568 s) : 0, 9567603
Agent [candidate] (1.225 s) : 0, 1224993
Total [candidate] (9.562 s) : 0, 9562398

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.063 s	-
Agent	iast	1.224 s	161.28 ms (15.2%)
Total	tracing	8.901 s	-
Total	iast	9.568 s	666.832 ms (7.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.065 s	-
Agent	iast	1.225 s	160.409 ms (15.1%)
Total	tracing	8.862 s	-
Total	iast	9.562 s	700.049 ms (7.9%)

gantt
    title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~2b72fff2e6, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.238 ms) : 0, 1238
crashtracking [candidate] (1.233 ms) : 0, 1233
BytebuddyAgent [baseline] (635.178 ms) : 0, 635178
BytebuddyAgent [candidate] (637.484 ms) : 0, 637484
AgentMeter [baseline] (29.666 ms) : 0, 29666
AgentMeter [candidate] (29.709 ms) : 0, 29709
GlobalTracer [baseline] (251.098 ms) : 0, 251098
GlobalTracer [candidate] (250.276 ms) : 0, 250276
AppSec [baseline] (32.493 ms) : 0, 32493
AppSec [candidate] (32.269 ms) : 0, 32269
Debugger [baseline] (59.963 ms) : 0, 59963
Debugger [candidate] (59.605 ms) : 0, 59605
Remote Config [baseline] (607.658 µs) : 0, 608
Remote Config [candidate] (604.043 µs) : 0, 604
Telemetry [baseline] (8.251 ms) : 0, 8251
Telemetry [candidate] (8.1 ms) : 0, 8100
Flare Poller [baseline] (8.297 ms) : 0, 8297
Flare Poller [candidate] (8.963 ms) : 0, 8963
section iast
crashtracking [baseline] (1.23 ms) : 0, 1230
crashtracking [candidate] (1.239 ms) : 0, 1239
BytebuddyAgent [baseline] (801.752 ms) : 0, 801752
BytebuddyAgent [candidate] (802.149 ms) : 0, 802149
AgentMeter [baseline] (11.4 ms) : 0, 11400
AgentMeter [candidate] (11.402 ms) : 0, 11402
GlobalTracer [baseline] (239.374 ms) : 0, 239374
GlobalTracer [candidate] (239.146 ms) : 0, 239146
IAST [baseline] (25.747 ms) : 0, 25747
IAST [candidate] (25.858 ms) : 0, 25858
AppSec [baseline] (31.876 ms) : 0, 31876
AppSec [candidate] (31.864 ms) : 0, 31864
Debugger [baseline] (59.902 ms) : 0, 59902
Debugger [candidate] (59.543 ms) : 0, 59543
Remote Config [baseline] (526.883 µs) : 0, 527
Remote Config [candidate] (524.581 µs) : 0, 525
Telemetry [baseline] (12.438 ms) : 0, 12438
Telemetry [candidate] (13.116 ms) : 0, 13116
Flare Poller [baseline] (3.424 ms) : 0, 3424
Flare Poller [candidate] (3.769 ms) : 0, 3769

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~2b72fff2e6, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1057566
Total [baseline] (11.106 s) : 0, 11105856
Agent [candidate] (1.064 s) : 0, 1063747
Total [candidate] (11.071 s) : 0, 11070871
section appsec
Agent [baseline] (1.25 s) : 0, 1250113
Total [baseline] (11.122 s) : 0, 11121629
Agent [candidate] (1.25 s) : 0, 1250265
Total [candidate] (11.111 s) : 0, 11111032
section iast
Agent [baseline] (1.235 s) : 0, 1235475
Total [baseline] (11.273 s) : 0, 11273262
Agent [candidate] (1.229 s) : 0, 1229114
Total [candidate] (11.292 s) : 0, 11292299
section profiling
Agent [baseline] (1.184 s) : 0, 1184371
Total [baseline] (11.113 s) : 0, 11112908
Agent [candidate] (1.185 s) : 0, 1185099
Total [candidate] (11.126 s) : 0, 11125762

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.058 s	-
Agent	appsec	1.25 s	192.547 ms (18.2%)
Agent	iast	1.235 s	177.909 ms (16.8%)
Agent	profiling	1.184 s	126.805 ms (12.0%)
Total	tracing	11.106 s	-
Total	appsec	11.122 s	15.773 ms (0.1%)
Total	iast	11.273 s	167.406 ms (1.5%)
Total	profiling	11.113 s	7.052 ms (0.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.064 s	-
Agent	appsec	1.25 s	186.518 ms (17.5%)
Agent	iast	1.229 s	165.367 ms (15.5%)
Agent	profiling	1.185 s	121.352 ms (11.4%)
Total	tracing	11.071 s	-
Total	appsec	11.111 s	40.161 ms (0.4%)
Total	iast	11.292 s	221.428 ms (2.0%)
Total	profiling	11.126 s	54.891 ms (0.5%)

gantt
    title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~2b72fff2e6, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.242 ms) : 0, 1242
crashtracking [candidate] (1.226 ms) : 0, 1226
BytebuddyAgent [baseline] (634.189 ms) : 0, 634189
BytebuddyAgent [candidate] (637.055 ms) : 0, 637055
AgentMeter [baseline] (29.61 ms) : 0, 29610
AgentMeter [candidate] (29.709 ms) : 0, 29709
GlobalTracer [baseline] (249.984 ms) : 0, 249984
GlobalTracer [candidate] (250.204 ms) : 0, 250204
AppSec [baseline] (32.215 ms) : 0, 32215
AppSec [candidate] (32.246 ms) : 0, 32246
Debugger [baseline] (60.105 ms) : 0, 60105
Debugger [candidate] (60.678 ms) : 0, 60678
Remote Config [baseline] (595.235 µs) : 0, 595
Remote Config [candidate] (613.799 µs) : 0, 614
Telemetry [baseline] (8.098 ms) : 0, 8098
Telemetry [candidate] (8.182 ms) : 0, 8182
Flare Poller [baseline] (5.131 ms) : 0, 5131
Flare Poller [candidate] (7.581 ms) : 0, 7581
section appsec
crashtracking [baseline] (1.241 ms) : 0, 1241
crashtracking [candidate] (1.214 ms) : 0, 1214
BytebuddyAgent [baseline] (663.345 ms) : 0, 663345
BytebuddyAgent [candidate] (662.557 ms) : 0, 662557
AgentMeter [baseline] (12.136 ms) : 0, 12136
AgentMeter [candidate] (12.105 ms) : 0, 12105
GlobalTracer [baseline] (249.413 ms) : 0, 249413
GlobalTracer [candidate] (249.391 ms) : 0, 249391
IAST [baseline] (24.577 ms) : 0, 24577
IAST [candidate] (24.643 ms) : 0, 24643
AppSec [baseline] (184.404 ms) : 0, 184404
AppSec [candidate] (184.851 ms) : 0, 184851
Debugger [baseline] (65.813 ms) : 0, 65813
Debugger [candidate] (66.21 ms) : 0, 66210
Remote Config [baseline] (600.965 µs) : 0, 601
Remote Config [candidate] (607.457 µs) : 0, 607
Telemetry [baseline] (8.597 ms) : 0, 8597
Telemetry [candidate] (8.572 ms) : 0, 8572
Flare Poller [baseline] (3.567 ms) : 0, 3567
Flare Poller [candidate] (3.575 ms) : 0, 3575
section iast
crashtracking [baseline] (1.232 ms) : 0, 1232
crashtracking [candidate] (1.227 ms) : 0, 1227
BytebuddyAgent [baseline] (809.45 ms) : 0, 809450
BytebuddyAgent [candidate] (804.366 ms) : 0, 804366
AgentMeter [baseline] (11.553 ms) : 0, 11553
AgentMeter [candidate] (11.435 ms) : 0, 11435
GlobalTracer [baseline] (240.853 ms) : 0, 240853
GlobalTracer [candidate] (240.488 ms) : 0, 240488
IAST [baseline] (27.61 ms) : 0, 27610
IAST [candidate] (25.86 ms) : 0, 25860
AppSec [baseline] (31.129 ms) : 0, 31129
AppSec [candidate] (30.392 ms) : 0, 30392
Debugger [baseline] (59.516 ms) : 0, 59516
Debugger [candidate] (61.982 ms) : 0, 61982
Remote Config [baseline] (540.148 µs) : 0, 540
Remote Config [candidate] (527.184 µs) : 0, 527
Telemetry [baseline] (13.362 ms) : 0, 13362
Telemetry [candidate] (13.116 ms) : 0, 13116
Flare Poller [baseline] (3.712 ms) : 0, 3712
Flare Poller [candidate] (3.444 ms) : 0, 3444
section profiling
crashtracking [baseline] (1.175 ms) : 0, 1175
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (691.539 ms) : 0, 691539
BytebuddyAgent [candidate] (691.741 ms) : 0, 691741
AgentMeter [baseline] (9.165 ms) : 0, 9165
AgentMeter [candidate] (9.132 ms) : 0, 9132
GlobalTracer [baseline] (207.333 ms) : 0, 207333
GlobalTracer [candidate] (207.339 ms) : 0, 207339
AppSec [baseline] (32.516 ms) : 0, 32516
AppSec [candidate] (32.615 ms) : 0, 32615
Debugger [baseline] (65.518 ms) : 0, 65518
Debugger [candidate] (65.708 ms) : 0, 65708
Remote Config [baseline] (568.749 µs) : 0, 569
Remote Config [candidate] (581.754 µs) : 0, 582
Telemetry [baseline] (7.756 ms) : 0, 7756
Telemetry [candidate] (7.797 ms) : 0, 7797
Flare Poller [baseline] (3.541 ms) : 0, 3541
Flare Poller [candidate] (3.561 ms) : 0, 3561
ProfilingAgent [baseline] (93.865 ms) : 0, 93865
ProfilingAgent [candidate] (94.178 ms) : 0, 94178
Profiling [baseline] (94.432 ms) : 0, 94432
Profiling [candidate] (94.733 ms) : 0, 94733

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/groovy-to-java
git_commit_date	1775834061	1775843541
git_commit_sha	`5ab378f`	`2b72fff`
release_version	1.62.0-SNAPSHOT~5ab378f780	1.62.0-SNAPSHOT~2b72fff2e6

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1775846041	1775846041
ci_job_id	1586537253	1586537253
ci_pipeline_id	107170356	107170356
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-ij2k2fhy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-ij2k2fhy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 17 metrics, 16 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:iast:high_load	worse [+145.543µs; +235.401µs] or [+5.911%; +9.560%]	worse [+339.665µs; +774.151µs] or [+4.709%; +10.731%]	unstable [-236.294op/s; +40.919op/s] or [-16.411%; +2.842%]	2.653ms	7.771ms	1342.125op/s	2.462ms	7.214ms	1439.812op/s
scenario:load:insecure-bank:profiling:high_load	better [-214.416µs; -70.409µs] or [-11.415%; -3.749%]	unstable [-1308.397µs; -352.936µs] or [-22.841%; -6.161%]	unstable [+27.068op/s; +461.557op/s] or [+1.440%; +24.554%]	1.736ms	4.898ms	2124.094op/s	1.878ms	5.728ms	1879.781op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~2b72fff2e6, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.62 ms) : 19416, 19824
.   : milestone, 19620,
appsec (18.864 ms) : 18672, 19055
.   : milestone, 18864,
code_origins (17.759 ms) : 17586, 17931
.   : milestone, 17759,
iast (18.177 ms) : 17998, 18357
.   : milestone, 18177,
profiling (18.751 ms) : 18564, 18938
.   : milestone, 18751,
tracing (17.952 ms) : 17777, 18126
.   : milestone, 17952,
section candidate
no_agent (18.482 ms) : 18292, 18672
.   : milestone, 18482,
appsec (18.727 ms) : 18537, 18917
.   : milestone, 18727,
code_origins (17.821 ms) : 17647, 17995
.   : milestone, 17821,
iast (17.829 ms) : 17654, 18004
.   : milestone, 17829,
profiling (18.665 ms) : 18474, 18855
.   : milestone, 18665,
tracing (17.762 ms) : 17587, 17938
.   : milestone, 17762,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.62 ms [19.416 ms, 19.824 ms]	-
appsec	18.864 ms [18.672 ms, 19.055 ms]	-755.981 µs (-3.9%)
code_origins	17.759 ms [17.586 ms, 17.931 ms]	-1.861 ms (-9.5%)
iast	18.177 ms [17.998 ms, 18.357 ms]	-1.443 ms (-7.4%)
profiling	18.751 ms [18.564 ms, 18.938 ms]	-868.861 µs (-4.4%)
tracing	17.952 ms [17.777 ms, 18.126 ms]	-1.668 ms (-8.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.482 ms [18.292 ms, 18.672 ms]	-
appsec	18.727 ms [18.537 ms, 18.917 ms]	244.467 µs (1.3%)
code_origins	17.821 ms [17.647 ms, 17.995 ms]	-661.684 µs (-3.6%)
iast	17.829 ms [17.654 ms, 18.004 ms]	-653.549 µs (-3.5%)
profiling	18.665 ms [18.474 ms, 18.855 ms]	182.525 µs (1.0%)
tracing	17.762 ms [17.587 ms, 17.938 ms]	-719.841 µs (-3.9%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~2b72fff2e6, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.262 ms) : 1249, 1274
.   : milestone, 1262,
iast (3.176 ms) : 3131, 3221
.   : milestone, 3176,
iast_FULL (5.961 ms) : 5900, 6022
.   : milestone, 5961,
iast_GLOBAL (3.583 ms) : 3524, 3641
.   : milestone, 3583,
profiling (2.415 ms) : 2392, 2437
.   : milestone, 2415,
tracing (1.845 ms) : 1830, 1860
.   : milestone, 1845,
section candidate
no_agent (1.258 ms) : 1246, 1271
.   : milestone, 1258,
iast (3.411 ms) : 3359, 3463
.   : milestone, 3411,
iast_FULL (6.214 ms) : 6150, 6278
.   : milestone, 6214,
iast_GLOBAL (3.67 ms) : 3609, 3731
.   : milestone, 3670,
profiling (2.128 ms) : 2108, 2148
.   : milestone, 2128,
tracing (1.861 ms) : 1846, 1877
.   : milestone, 1861,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.262 ms [1.249 ms, 1.274 ms]	-
iast	3.176 ms [3.131 ms, 3.221 ms]	1.914 ms (151.7%)
iast_FULL	5.961 ms [5.9 ms, 6.022 ms]	4.699 ms (372.4%)
iast_GLOBAL	3.583 ms [3.524 ms, 3.641 ms]	2.321 ms (183.9%)
profiling	2.415 ms [2.392 ms, 2.437 ms]	1.153 ms (91.4%)
tracing	1.845 ms [1.83 ms, 1.86 ms]	582.777 µs (46.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.258 ms [1.246 ms, 1.271 ms]	-
iast	3.411 ms [3.359 ms, 3.463 ms]	2.153 ms (171.1%)
iast_FULL	6.214 ms [6.15 ms, 6.278 ms]	4.956 ms (393.8%)
iast_GLOBAL	3.67 ms [3.609 ms, 3.731 ms]	2.412 ms (191.7%)
profiling	2.128 ms [2.108 ms, 2.148 ms]	869.535 µs (69.1%)
tracing	1.861 ms [1.846 ms, 1.877 ms]	602.76 µs (47.9%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/groovy-to-java
git_commit_date	1775834061	1775843541
git_commit_sha	`5ab378f`	`2b72fff`
release_version	1.62.0-SNAPSHOT~5ab378f780	1.62.0-SNAPSHOT~2b72fff2e6

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1775845625	1775845625
ci_job_id	1586537254	1586537254
ci_pipeline_id	107170356	107170356
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-2fgizbq4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-2fgizbq4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~2b72fff2e6, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.555 s) : 15555000, 15555000
.   : milestone, 15555000,
appsec (15.106 s) : 15106000, 15106000
.   : milestone, 15106000,
iast (18.171 s) : 18171000, 18171000
.   : milestone, 18171000,
iast_GLOBAL (18.04 s) : 18040000, 18040000
.   : milestone, 18040000,
profiling (14.985 s) : 14985000, 14985000
.   : milestone, 14985000,
tracing (15.184 s) : 15184000, 15184000
.   : milestone, 15184000,
section candidate
no_agent (15.159 s) : 15159000, 15159000
.   : milestone, 15159000,
appsec (14.82 s) : 14820000, 14820000
.   : milestone, 14820000,
iast (18.584 s) : 18584000, 18584000
.   : milestone, 18584000,
iast_GLOBAL (18.204 s) : 18204000, 18204000
.   : milestone, 18204000,
profiling (14.852 s) : 14852000, 14852000
.   : milestone, 14852000,
tracing (14.789 s) : 14789000, 14789000
.   : milestone, 14789000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.555 s [15.555 s, 15.555 s]	-
appsec	15.106 s [15.106 s, 15.106 s]	-449.0 ms (-2.9%)
iast	18.171 s [18.171 s, 18.171 s]	2.616 s (16.8%)
iast_GLOBAL	18.04 s [18.04 s, 18.04 s]	2.485 s (16.0%)
profiling	14.985 s [14.985 s, 14.985 s]	-570.0 ms (-3.7%)
tracing	15.184 s [15.184 s, 15.184 s]	-371.0 ms (-2.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.159 s [15.159 s, 15.159 s]	-
appsec	14.82 s [14.82 s, 14.82 s]	-339.0 ms (-2.2%)
iast	18.584 s [18.584 s, 18.584 s]	3.425 s (22.6%)
iast_GLOBAL	18.204 s [18.204 s, 18.204 s]	3.045 s (20.1%)
profiling	14.852 s [14.852 s, 14.852 s]	-307.0 ms (-2.0%)
tracing	14.789 s [14.789 s, 14.789 s]	-370.0 ms (-2.4%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~2b72fff2e6, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.489 ms) : 1477, 1501
.   : milestone, 1489,
appsec (3.83 ms) : 3607, 4054
.   : milestone, 3830,
iast (2.272 ms) : 2203, 2341
.   : milestone, 2272,
iast_GLOBAL (2.313 ms) : 2244, 2382
.   : milestone, 2313,
profiling (2.105 ms) : 2050, 2160
.   : milestone, 2105,
tracing (2.078 ms) : 2024, 2132
.   : milestone, 2078,
section candidate
no_agent (1.487 ms) : 1475, 1498
.   : milestone, 1487,
appsec (3.841 ms) : 3617, 4064
.   : milestone, 3841,
iast (2.261 ms) : 2192, 2330
.   : milestone, 2261,
iast_GLOBAL (2.318 ms) : 2249, 2388
.   : milestone, 2318,
profiling (2.102 ms) : 2047, 2157
.   : milestone, 2102,
tracing (2.087 ms) : 2033, 2141
.   : milestone, 2087,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.489 ms [1.477 ms, 1.501 ms]	-
appsec	3.83 ms [3.607 ms, 4.054 ms]	2.342 ms (157.3%)
iast	2.272 ms [2.203 ms, 2.341 ms]	783.12 µs (52.6%)
iast_GLOBAL	2.313 ms [2.244 ms, 2.382 ms]	823.938 µs (55.3%)
profiling	2.105 ms [2.05 ms, 2.16 ms]	615.868 µs (41.4%)
tracing	2.078 ms [2.024 ms, 2.132 ms]	588.951 µs (39.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.487 ms [1.475 ms, 1.498 ms]	-
appsec	3.841 ms [3.617 ms, 4.064 ms]	2.354 ms (158.3%)
iast	2.261 ms [2.192 ms, 2.33 ms]	774.372 µs (52.1%)
iast_GLOBAL	2.318 ms [2.249 ms, 2.388 ms]	831.765 µs (55.9%)
profiling	2.102 ms [2.047 ms, 2.157 ms]	615.597 µs (41.4%)
tracing	2.087 ms [2.033 ms, 2.141 ms]	600.204 µs (40.4%)

PerfectSlayer added 6 commits April 10, 2026 19:52

feat(otel): Migrate test to JUnit

e329d69

feat(testing): Fix @WithConfig to be applied at any level

af5ff0b

feat(testing): Improve error messages

19f9839

fix(testing): Fix span links assertion

023bb75

feat(testing): Refine default tags

6631e15

feat(otel): Migrate test to JUnit

2b72fff

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Migrate OpenTelemetry instrumentation tests to JUnit#11081

Migrate OpenTelemetry instrumentation tests to JUnit#11081
PerfectSlayer wants to merge 6 commits intomasterfrom
bbujon/groovy-to-java

PerfectSlayer commented Apr 10, 2026 •

edited

Loading

Uh oh!

pr-commenter bot commented Apr 10, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

PerfectSlayer commented Apr 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Apr 10, 2026

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

PerfectSlayer commented Apr 10, 2026 •

edited

Loading