Implement test visibility for Karate v2

[daniel-mohedano]

What Does This Do

• Adds a new karate-2.0 instrumentation module to implement test visibility for Karate 2.0+.
  • The implementation follows the same approach used for the original instrumentation in the karate-1.0 module.

Motivation

Karate v2 is a complete ground-up rewrite of the framework. Because of this, the original karate-1.0 module cannot instrument it.

Additional Notes

A following PR will contain the changes regarding execution instrumentation for Karate v2.

Contributor Checklist

• Format the title according to the contribution guidelines
• Assign the type: and (comp: or inst:) labels in addition to any other useful labels
• Avoid using close, fix, or any linking keywords when referencing an issue
  Use solves instead, and assign the PR milestone to the issue
• Update the CODEOWNERS file on source file addition, migration, or deletion
• Update public documentation with any new configuration flags or behaviors
• Once approved, use merge queue to merge the PR

Jira ticket: SDTEST-3816

[cit-pr-commenter-54b7da]

Test Environment - sbt-scalatest

Job Status: 🟢 success

Scenario	This PR (%)	7d median	Δ 7d	30d median	Δ 30d	runs (7d/30d)
agent	55.15	55.43	$\color{green}{\blacktriangledown}$ -0.28	54.33	$\color{red}{\blacktriangle}$ +0.82	66/226
agentEvpProxy	53.97	n/a	n/a	n/a	n/a	-

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

[cit-pr-commenter-54b7da]

Test Environment - reactive-streams-jvm

Job Status: 🟢 success

Scenario	This PR (%)	7d median	Δ 7d	30d median	Δ 30d	runs (7d/30d)
agent	20.52	22.09	$\color{green}{\blacktriangledown}$ -1.57	21.65	$\color{green}{\blacktriangledown}$ -1.13	32/115
agentless	18.97	18.82	$\color{red}{\blacktriangle}$ +0.15	18.82	$\color{red}{\blacktriangle}$ +0.15	31/113
agentlessCodeCoverage	19.17	20.39	$\color{green}{\blacktriangledown}$ -1.22	19.99	$\color{green}{\blacktriangledown}$ -0.82	31/112
agentlessLineCoverage	28.65	30.42	$\color{green}{\blacktriangledown}$ -1.77	29.82	$\color{green}{\blacktriangledown}$ -1.17	31/112

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

[cit-pr-commenter-54b7da]

Test Environment - nebula-release-plugin

Job Status: 🟢 success

Scenario	This PR (%)	7d median	Δ 7d	30d median	Δ 30d	runs (7d/30d)
agent	35.68	37.15	$\color{green}{\blacktriangledown}$ -1.47	36.42	$\color{green}{\blacktriangledown}$ -0.74	31/108
agentless	37.46	36.42	$\color{red}{\blacktriangle}$ +1.04	36.42	$\color{red}{\blacktriangle}$ +1.04	31/108
agentlessCodeCoverage	44.51	44.48	$\color{red}{\blacktriangle}$ +0.03	44.48	$\color{red}{\blacktriangle}$ +0.03	31/108
agentlessLineCoverage	74.08	74.82	$\color{green}{\blacktriangledown}$ -0.74	74.82	$\color{green}{\blacktriangledown}$ -0.74	31/108

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

[cit-pr-commenter-54b7da]

Test Environment - pass4s

Job Status: 🟢 success

Scenario	This PR (%)	7d median	Δ 7d	30d median	Δ 30d	runs (7d/30d)
agent	9.26	9.35	$\color{green}{\blacktriangledown}$ -0.09	10.33	$\color{green}{\blacktriangledown}$ -1.07	32/109
agentless	9.20	9.92	$\color{green}{\blacktriangledown}$ -0.72	10.13	$\color{green}{\blacktriangledown}$ -0.93	32/109
agentlessCodeCoverage	15.01	16.69	$\color{green}{\blacktriangledown}$ -1.68	17.38	$\color{green}{\blacktriangledown}$ -2.37	31/107

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

[cit-pr-commenter-54b7da]

Test Environment - heliboard

Job Status: 🟢 success

Scenario	This PR (%)	7d median	Δ 7d	30d median	Δ 30d	runs (7d/30d)
agent	7.80	9.54	$\color{green}{\blacktriangledown}$ -1.74	9.54	$\color{green}{\blacktriangledown}$ -1.74	29/29

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

[cit-pr-commenter-54b7da]

Test Environment - sonar-kotlin

Job Status: 🟢 success

Scenario	This PR (%)	7d median	Δ 7d	30d median	Δ 30d	runs (7d/30d)
agent	13.27	12.87	$\color{red}{\blacktriangle}$ +0.40	13.13	$\color{red}{\blacktriangle}$ +0.14	29/109
agentless	11.85	12.12	$\color{green}{\blacktriangledown}$ -0.27	12.12	$\color{green}{\blacktriangledown}$ -0.27	29/108
agentlessCodeCoverage	15.89	15.11	$\color{red}{\blacktriangle}$ +0.78	15.11	$\color{red}{\blacktriangle}$ +0.78	29/108
agentlessLineCoverage	19.36	18.82	$\color{red}{\blacktriangle}$ +0.54	18.82	$\color{red}{\blacktriangle}$ +0.54	28/108

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

[datadog-official]

🎯 Code Coverage (details)
• Patch Coverage: 100.00%
• Overall Coverage: 41.38% (-15.67%)

_{This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 294d720 | Docs | Datadog PR Page | Give us feedback!}

[cit-pr-commenter-54b7da]

Test Environment - jolokia

Job Status: 🟢 success

Scenario	This PR (%)	7d median	Δ 7d	30d median	Δ 30d	runs (7d/30d)
agent	94.93	95.12	$\color{green}{\blacktriangledown}$ -0.19	93.23	$\color{red}{\blacktriangle}$ +1.70	35/118
agentless	91.25	89.58	$\color{red}{\blacktriangle}$ +1.67	89.58	$\color{red}{\blacktriangle}$ +1.67	32/114
agentlessCodeCoverage	99.37	99.00	$\color{red}{\blacktriangle}$ +0.37	99.00	$\color{red}{\blacktriangle}$ +0.37	34/113
agentlessLineCoverage	101.92	99.00	$\color{red}{\blacktriangle}$ +2.92	99.00	$\color{red}{\blacktriangle}$ +2.92	31/111

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

[cit-pr-commenter-54b7da]

Test Environment - netflix-zuul

Job Status: 🟢 success

Scenario	This PR (%)	7d median	Δ 7d	30d median	Δ 30d	runs (7d/30d)
agent	89.86	87.80	$\color{red}{\blacktriangle}$ +2.06	87.80	$\color{red}{\blacktriangle}$ +2.06	32/114
agentless	82.77	81.05	$\color{red}{\blacktriangle}$ +1.72	81.05	$\color{red}{\blacktriangle}$ +1.72	32/113
agentlessCodeCoverage	98.24	97.04	$\color{red}{\blacktriangle}$ +1.20	95.12	$\color{red}{\blacktriangle}$ +3.12	32/111
agentlessLineCoverage	114.36	111.62	$\color{red}{\blacktriangle}$ +2.74	111.62	$\color{red}{\blacktriangle}$ +2.74	31/110

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

[cit-pr-commenter-54b7da]

Test Environment - okhttp

Job Status: 🟢 success

Scenario	This PR (%)	7d median	Δ 7d	30d median	Δ 30d	runs (7d/30d)
agent	21.54	19.20	$\color{red}{\blacktriangle}$ +2.34	19.20	$\color{red}{\blacktriangle}$ +2.34	34/120
agentless	18.16	19.59	$\color{green}{\blacktriangledown}$ -1.43	19.20	$\color{green}{\blacktriangledown}$ -1.04	33/118
agentlessCodeCoverage	23.41	22.99	$\color{red}{\blacktriangle}$ +0.42	22.09	$\color{red}{\blacktriangle}$ +1.32	33/116
agentlessLineCoverage	44.76	44.48	$\color{red}{\blacktriangle}$ +0.28	44.48	$\color{red}{\blacktriangle}$ +0.28	32/121

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

[cit-pr-commenter-54b7da]

Test Environment - spring_boot

Job Status: 🟢 success

Scenario	This PR (%)	7d median	Δ 7d	30d median	Δ 30d	runs (7d/30d)
agent	16.48	16.36	$\color{red}{\blacktriangle}$ +0.12	16.04	$\color{red}{\blacktriangle}$ +0.44	31/107
agentless	9.76	9.73	$\color{red}{\blacktriangle}$ +0.03	9.73	$\color{red}{\blacktriangle}$ +0.03	31/108
agentlessCodeCoverage	13.88	13.67	$\color{red}{\blacktriangle}$ +0.21	13.13	$\color{red}{\blacktriangle}$ +0.75	31/106
agentlessLineCoverage	32.87	32.95	$\color{green}{\blacktriangledown}$ -0.08	32.30	$\color{red}{\blacktriangle}$ +0.57	30/106

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

[dd-octo-sts]

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite	Status
Startup	🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results

Scenario	Candidate	master	Δ (95% CI of mean)
startup:insecure-bank:iast:Agent	13.99 s	14.00 s	[-0.9%; +0.8%] (no difference)
startup:insecure-bank:tracing:Agent	12.92 s	13.07 s	[-1.7%; -0.6%] (maybe better)
startup:petclinic:appsec:Agent	16.93 s	16.77 s	[-0.1%; +1.9%] (no difference)
startup:petclinic:iast:Agent	16.97 s	16.98 s	[-0.7%; +0.6%] (no difference)
startup:petclinic:profiling:Agent	16.70 s	16.85 s	[-2.1%; +0.3%] (no difference)
startup:petclinic:sca:Agent	16.95 s	16.78 s	[+0.1%; +1.9%] (maybe worse)
startup:petclinic:tracing:Agent	16.09 s	16.12 s	[-1.1%; +0.7%] (no difference)

Commit: 36148cda · CI Pipeline · Benchmarking Platform UI

---

Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

[cit-pr-commenter-54b7da]

Test Environment - sonar-java

Job Status: 🟢 success

Scenario	This PR (%)	7d median	Δ 7d	30d median	Δ 30d	runs (7d/30d)
agent	25.09	13.67	$\color{red}{\blacktriangle}$ +11.42	15.72	$\color{red}{\blacktriangle}$ +9.37	29/113
agentless	12.23	13.94	$\color{green}{\blacktriangledown}$ -1.71	17.38	$\color{green}{\blacktriangledown}$ -5.15	29/112
agentlessCodeCoverage	96.85	82.69	$\color{red}{\blacktriangle}$ +14.16	86.07	$\color{red}{\blacktriangle}$ +10.78	29/112
agentlessLineCoverage	125.62	136.34	$\color{green}{\blacktriangledown}$ -10.72	144.77	$\color{green}{\blacktriangledown}$ -19.15	28/111

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.