Skip to content

[FLINK-39795][connect/mongodb] Fix MongoDB sharded chunk lookup to keep index-backed reads#4417

Open
yuxiqian wants to merge 2 commits into
apache:masterfrom
yuxiqian:FLINK-39795
Open

[FLINK-39795][connect/mongodb] Fix MongoDB sharded chunk lookup to keep index-backed reads#4417
yuxiqian wants to merge 2 commits into
apache:masterfrom
yuxiqian:FLINK-39795

Conversation

@yuxiqian
Copy link
Copy Markdown
Member

This closes FLINK-39795.

The previous $or filter (ns or uuid) could prevent index-backed sorting on config.chunks, leading to in-memory sort and failures like “Sort operation used more than the maximum XXXX bytes of RAM”. Instead we choose the filter by MongoDB server version (with fallback handling) to ensure query read is in IXSCAN.


Was generative AI tooling used to co-author this PR?
  • Yes (please specify the tool below)

Generated-by: Claude 1.9255.2 (Claude Opus 4.7)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant