CAMEL-24051: Add observability test-infra module

[Croway]

Summary

Claude Code on behalf of Croway

New camel-test-infra-observability module providing a local Apache-2.0-only observability stack via camel infra run observability.

Composes 4 containers on a shared Docker network:

• Prometheus (:9090) — scrapes Camel metrics at :9876/observe/metrics
• VictoriaTraces (:10428) — receives OTLP traces
• VictoriaLogs (:9428) — receives OTLP logs
• Perses (:3000) — dashboard UI, auto-provisioned with Camel project and overview dashboard

Changes

• New module: test-infra/camel-test-infra-observability/ with 4 container classes, service interface, multi-container orchestrator
• New export target: --open-telemetry-agent-export=observability enables traces + logs export to the stack
• Deprecated: --open-telemetry-agent-export=jaeger in favor of otlp (backward compatible)
• Generalized: OpenTelemetryTracer.exportTarget check accepts any non-empty value instead of hardcoded "jaeger"
• Fixed: Fork version propagation in Run.java — forked JBang processes now inherit the CLI's catalog version
• OOB dashboard: Perses auto-provisioned with Camel Overview dashboard (exchanges, throughput, failure rate, processing time, JVM memory/threads/GC, CPU, load average)

Usage

# Start the observability stack
camel infra run observability

# Run a Camel app with full observability (metrics + traces + logs)
camel run MyRoute.java --observe \
  --open-telemetry-agent --open-telemetry-agent-export=observability

Verified

• Prometheus scrapes Camel metrics (zero-config with --observe)
• VictoriaTraces receives OTel agent spans (Kafka, JDBC, HTTP auto-instrumented)
• VictoriaLogs receives logs with trace_id/span_id correlation
• Perses dashboard shows exchanges, throughput, processing time, JVM metrics
• Multiple Camel instances supported via --management-port

Test plan

• camel infra run observability starts all 4 containers
• camel infra get observability returns JSON with all endpoint URLs
• camel run --observe sends metrics to Prometheus
• camel run --observe --open-telemetry-agent --open-telemetry-agent-export=observability sends traces and logs
• Perses dashboard at :3000/projects/camel/dashboards/overview shows data
• camel infra stop observability stops all containers
• --open-telemetry-agent-export=jaeger still works (backward compatible)
• --open-telemetry-agent-export=otlp works as new generic external export

[github-actions]

🌟 Thank you for your contribution to the Apache Camel project! 🌟
🤖 CI automation will test this PR automatically.

🐫 Apache Camel Committers, please review the following items:

• First-time contributors require MANUAL approval for the GitHub Actions to run
• You can use the command /component-test (camel-)component-name1 (camel-)component-name2.. to request a test from the test bot although they are normally detected and executed by CI.
• You can label PRs using skip-tests and test-dependents to fine-tune the checks executed by this PR.
• Build and test logs are available in the summary page. Only Apache Camel committers have access to the summary.

⚠️ Be careful when sharing logs. Review their contents before sharing them publicly.

[github-actions]

🧪 CI tested the following changed modules:

• catalog/camel-catalog
• components/camel-opentelemetry2
• docs
• dsl/camel-jbang/camel-jbang-core
• test-infra
• test-infra/camel-test-infra-all
• test-infra/camel-test-infra-observability

---

🔬 Scalpel shadow comparison — Scalpel: 15 tested, 26 compile-only — current: 12 all tested

Maveniverse Scalpel detected 41 affected modules (current approach: 12).

⚠️ Modules only in Scalpel (29)

• apache-camel
• camel-allcomponents
• camel-catalog
• camel-catalog-console
• camel-catalog-lucene
• camel-catalog-maven
• camel-catalog-suggest
• camel-componentdsl
• camel-csimple-maven-plugin
• camel-endpointdsl
• camel-endpointdsl-support
• camel-itest
• camel-jbang-core
• camel-jbang-it
• camel-jbang-main
• camel-jbang-plugin-edit
• camel-jbang-plugin-generate
• camel-jbang-plugin-kubernetes
• camel-jbang-plugin-test
• camel-kamelet-main
• camel-launcher
• camel-report-maven-plugin
• camel-route-parser
• camel-yaml-dsl
• camel-yaml-dsl-deserializers
• camel-yaml-dsl-maven-plugin
• coverage
• docs
• dummy-component

Skip-tests mode would test 15 modules (6 direct + 9 downstream), skip tests for 26 (generated code, meta-modules)

Modules Scalpel would test (15)

• camel-catalog
• camel-jbang-core
• camel-jbang-mcp
• camel-jbang-plugin-mcp
• camel-jbang-plugin-route-parser
• camel-jbang-plugin-tui
• camel-jbang-plugin-validate
• camel-launcher-container
• camel-observability-services
• camel-opentelemetry2
• camel-test-infra-all
• camel-test-infra-observability
• camel-yaml-dsl-validator
• camel-yaml-dsl-validator-maven-plugin
• docs

Modules with tests skipped (26)

• apache-camel
• camel-allcomponents
• camel-catalog-console
• camel-catalog-lucene
• camel-catalog-maven
• camel-catalog-suggest
• camel-componentdsl
• camel-csimple-maven-plugin
• camel-endpointdsl
• camel-endpointdsl-support
• camel-itest
• camel-jbang-it
• camel-jbang-main
• camel-jbang-plugin-edit
• camel-jbang-plugin-generate
• camel-jbang-plugin-kubernetes
• camel-jbang-plugin-test
• camel-kamelet-main
• camel-launcher
• camel-report-maven-plugin
• camel-route-parser
• camel-yaml-dsl
• camel-yaml-dsl-deserializers
• camel-yaml-dsl-maven-plugin
• coverage
• dummy-component

ℹ️ Shadow mode — Scalpel observes but does not affect test execution. Learn more

⚠️ Some tests are disabled on GitHub Actions (@DisabledIfSystemProperty(named = "ci.env.name")) and require manual verification:

• dsl/camel-jbang/camel-jbang-core: 1 test(s) disabled on GitHub Actions

💡 Manual integration tests recommended:

You modified dsl/camel-jbang/camel-jbang-core. The related integration tests in dsl/camel-jbang/camel-jbang-it are excluded from CI. Consider running them manually:

mvn verify -f dsl/camel-jbang/camel-jbang-it -Djbang-it-test

All tested modules (41 modules)

• Camel :: All Components Sync point
• Camel :: Assembly
• Camel :: Catalog :: CSimple Maven Plugin (deprecated)
• Camel :: Catalog :: Camel Catalog
• Camel :: Catalog :: Camel Report Maven Plugin
• Camel :: Catalog :: Camel Route Parser
• Camel :: Catalog :: Console
• Camel :: Catalog :: Dummy Component
• Camel :: Catalog :: Lucene (deprecated)
• Camel :: Catalog :: Maven
• Camel :: Catalog :: Suggest
• Camel :: Component DSL
• Camel :: Coverage
• Camel :: Docs
• Camel :: Endpoint DSL
• Camel :: Endpoint DSL :: Support
• Camel :: Integration Tests
• Camel :: JBang :: Core
• Camel :: JBang :: Integration tests
• Camel :: JBang :: MCP
• Camel :: JBang :: Main
• Camel :: JBang :: Plugin :: Edit
• Camel :: JBang :: Plugin :: Generate
• Camel :: JBang :: Plugin :: Kubernetes
• Camel :: JBang :: Plugin :: MCP
• Camel :: JBang :: Plugin :: Route Parser
• Camel :: JBang :: Plugin :: TUI
• Camel :: JBang :: Plugin :: Testing
• Camel :: JBang :: Plugin :: Validate
• Camel :: Kamelet Main
• Camel :: Launcher
• Camel :: Launcher :: Container
• Camel :: Observability Services
• Camel :: Opentelemetry 2
• Camel :: Test Infra :: All test services
• Camel :: Test Infra :: Observability
• Camel :: YAML DSL
• Camel :: YAML DSL :: Deserializers
• Camel :: YAML DSL :: Maven Plugins
• Camel :: YAML DSL :: Validator
• Camel :: YAML DSL :: Validator Maven Plugin

---

⚙️ View full build and test results