Skip to content

feat(connectors): add BSON payload support to connectors runtime#3299

Draft
Standing-Man wants to merge 2 commits into
apache:masterfrom
Standing-Man:bson-payload
Draft

feat(connectors): add BSON payload support to connectors runtime#3299
Standing-Man wants to merge 2 commits into
apache:masterfrom
Standing-Man:bson-payload

Conversation

@Standing-Man
Copy link
Copy Markdown
Contributor

Which issue does this PR close?

Closes #1847.

Rationale

What changed?

Local Execution

  • Passed / not passed
  • Pre-commit hooks ran / not ran

AI Usage

@github-actions
Copy link
Copy Markdown

Thanks for the pull request. It is now waiting for review, labeled S-waiting-on-review.

You can update that label as the review goes back and forth, with slash commands - each on its own line, in a regular PR comment (not an inline review reply):

  • /ready - mark it S-waiting-on-review again, after addressing feedback
  • /author - mark it S-waiting-on-author (maintainers, or anyone who has had a PR merged before)
  • /request-review @user ... - request reviewers (@user or @org/team)

Commands take up to ~90s to apply. If no reaction (👍 or 😕) appears on your comment, the apply step likely failed - check the repo's Actions tab for the PR Triage Apply run. Commands posted inside a review body (rather than a normal comment) cannot be reacted to, so they stay log-only.

See CONTRIBUTING.md for details.

@github-actions github-actions Bot added the S-waiting-on-review PR is waiting on a reviewer label May 22, 2026
@Standing-Man Standing-Man marked this pull request as draft May 22, 2026 12:15
@github-actions github-actions Bot removed the S-waiting-on-review PR is waiting on a reviewer label May 22, 2026
@codecov
Copy link
Copy Markdown

codecov Bot commented May 22, 2026

Codecov Report

❌ Patch coverage is 75.18519% with 134 lines in your changes missing coverage. Please review.
✅ Project coverage is 55.34%. Comparing base (e7b2d7e) to head (d4c1036).

Files with missing lines Patch % Lines
core/connectors/sdk/src/encoders/avro.rs 82.18% 70 Missing and 18 partials ⚠️
core/connectors/sdk/src/encoders/proto.rs 0.00% 16 Missing ⚠️
core/connectors/sdk/src/lib.rs 0.00% 10 Missing ⚠️
...ore/connectors/sdk/src/transforms/proto_convert.rs 0.00% 6 Missing ⚠️
core/connectors/sdk/src/decoders/bson.rs 0.00% 5 Missing ⚠️
core/connectors/sdk/src/encoders/bson.rs 0.00% 5 Missing ⚠️
core/connectors/sdk/src/encoders/flatbuffer.rs 0.00% 3 Missing ⚠️
core/connectors/sinks/http_sink/src/lib.rs 0.00% 1 Missing ⚠️
Additional details and impacted files
@@              Coverage Diff              @@
##             master    #3299       +/-   ##
=============================================
- Coverage     73.71%   55.34%   -18.37%     
  Complexity      943      943               
=============================================
  Files          1223     1224        +1     
  Lines        115755   103199    -12556     
  Branches      92491    79962    -12529     
=============================================
- Hits          85329    57118    -28211     
- Misses        27556    43393    +15837     
+ Partials       2870     2688      -182     
Components Coverage Δ
Rust Core 50.92% <75.18%> (-23.80%) ⬇️
Java SDK 58.44% <ø> (ø)
C# SDK 69.43% <ø> (-0.52%) ⬇️
Python SDK 81.06% <ø> (ø)
Node SDK 91.44% <ø> (-0.10%) ⬇️
Go SDK 40.20% <ø> (ø)
Files with missing lines Coverage Δ
core/connectors/sinks/http_sink/src/lib.rs 85.63% <0.00%> (-0.16%) ⬇️
core/connectors/sdk/src/encoders/flatbuffer.rs 79.67% <0.00%> (-0.99%) ⬇️
core/connectors/sdk/src/decoders/bson.rs 0.00% <0.00%> (ø)
core/connectors/sdk/src/encoders/bson.rs 0.00% <0.00%> (ø)
...ore/connectors/sdk/src/transforms/proto_convert.rs 71.76% <0.00%> (-0.58%) ⬇️
core/connectors/sdk/src/lib.rs 50.50% <0.00%> (-5.68%) ⬇️
core/connectors/sdk/src/encoders/proto.rs 69.03% <0.00%> (-1.52%) ⬇️
core/connectors/sdk/src/encoders/avro.rs 77.85% <82.18%> (+5.23%) ⬆️

... and 308 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@hubcio
Copy link
Copy Markdown
Contributor

hubcio commented May 29, 2026

@Standing-Man what's the status for this one? I see that it's a draft, do you have plans to continue?

@Standing-Man
Copy link
Copy Markdown
Contributor Author

@Standing-Man what's the status for this one? I see that it's a draft, do you have plans to continue?

My schedule has been a bit tight recently. If time permits, I’ll continue working on this PR and move it forward.

That said, if the PR remains inactive for an extended period, other contributors are more than welcome to pick up the issue and continue the work.

Signed-off-by: StandingMan <jmtangcs@gmail.com>
Signed-off-by: StandingMan <jmtangcs@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add support for BSON payload to connectors runtime

2 participants