Skip to content

DRAFT#11921

Draft
jpbempel wants to merge 1 commit into
masterfrom
jpbempel/kotlin-exploration-tests
Draft

DRAFT#11921
jpbempel wants to merge 1 commit into
masterfrom
jpbempel/kotlin-exploration-tests

Conversation

@jpbempel

Copy link
Copy Markdown
Member

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@jpbempel jpbempel force-pushed the jpbempel/kotlin-exploration-tests branch from 0e750fa to 83d262a Compare July 12, 2026 17:17
@datadog-official

This comment has been minimized.

@pr-commenter

pr-commenter Bot commented Jul 12, 2026

Copy link
Copy Markdown

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1783930447 1783930796
end_time 2026-07-13T08:15:38 2026-07-13T08:21:26
git_branch master jpbempel/kotlin-exploration-tests
git_commit_sha 4f91d17 0d88809
start_time 2026-07-13T08:14:08 2026-07-13T08:19:57
See matching parameters
Baseline Candidate
ci_job_id 1852845566 1852845566
ci_pipeline_id 124246628 124246628
cpu_model Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
git_commit_date 1783929662 1783929662

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 6 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-28.335µs; +9.844µs] or [-9.081%; +3.155%]
unstable
[-37.755µs; +18.772µs] or [-10.532%; +5.237%]
unstable
[-51.005µs; +27.974µs] or [-13.531%; +7.421%]
unstable
[-47.577µs; +156.528µs] or [-3.775%; +12.421%]
same
scenario:basic same same same unstable
[-89.209µs; +47.448µs] or [-7.584%; +4.034%]
unstable
[-173.710op/s; +173.710op/s] or [-7.296%; +7.296%]
scenario:loop same same same same same
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (358.475 µs) : 327, 390
.   : milestone, 358,
basic (307.107 µs) : 299, 315
.   : milestone, 307,
loop (9.003 ms) : 8996, 9010
.   : milestone, 9003,
section candidate
noprobe (348.983 µs) : 328, 370
.   : milestone, 349,
basic (310.803 µs) : 301, 321
.   : milestone, 311,
loop (9.034 ms) : 8989, 9080
.   : milestone, 9034,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 358.475 µs [326.685 µs, 390.264 µs]
basic 307.107 µs [299.22 µs, 314.994 µs]
loop 9.003 ms [8.996 ms, 9.01 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 348.983 µs [328.255 µs, 369.711 µs]
basic 310.803 µs [300.724 µs, 320.883 µs]
loop 9.034 ms [8.989 ms, 9.08 ms]

@dd-octo-sts

dd-octo-sts Bot commented Jul 12, 2026

Copy link
Copy Markdown
Contributor

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite Status
Startup 🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results
Scenario Candidate master Δ (95% CI of mean)
startup:insecure-bank:iast:Agent 14.03 s 14.00 s [-0.9%; +1.3%] (no difference)
startup:insecure-bank:tracing:Agent 12.91 s 12.93 s [-0.7%; +0.3%] (no difference)
startup:petclinic:appsec:Agent 17.05 s 16.47 s [+2.6%; +4.3%] (significantly worse)
startup:petclinic:iast:Agent 16.96 s 16.94 s [-0.9%; +1.2%] (no difference)
startup:petclinic:profiling:Agent 16.57 s 16.73 s [-1.9%; +0.0%] (no difference)
startup:petclinic:sca:Agent 17.01 s 16.71 s [+0.8%; +2.8%] (maybe worse)
startup:petclinic:tracing:Agent 16.11 s 16.23 s [-1.4%; -0.1%] (maybe better)

Commit: 2b3a187a · CI Pipeline · Benchmarking Platform UI


Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

@jpbempel jpbempel force-pushed the jpbempel/kotlin-exploration-tests branch from 83d262a to 0d88809 Compare July 13, 2026 08:01
@jpbempel jpbempel force-pushed the jpbempel/kotlin-exploration-tests branch from 0d88809 to 2b3a187 Compare July 13, 2026 09:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant