Skip to content

fix(parquet): coalesce push decoder retained buffers - #10832

Open
cakeni wants to merge 2 commits into
apache:mainfrom
cakeni:fix/push-buffers-9695
Open

fix(parquet): coalesce push decoder retained buffers#10832
cakeni wants to merge 2 commits into
apache:mainfrom
cakeni:fix/push-buffers-9695

Conversation

@cakeni

@cakeni cakeni commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

Which issue does this PR close?

Closes #9695.

Summary

  • replace quadratic exact-range clearing with indexed push-buffer ownership
  • split coalesced pushed ranges into independently releasable row-group buffers
  • release staged bytes after constructing each row-group reader
  • preserve forward, reverse, duplicate, and incremental row-group decoding

Validation

  • cargo test -p parquet push_buffers
  • cargo test -p parquet push_decoder
  • cargo fmt --all -- --check
  • cargo clippy -p parquet --all-targets --all-features -- -D warnings

@github-actions github-actions Bot added the parquet Changes to the parquet crate label Aug 25, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

parquet Changes to the parquet crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

PushBuffers::clear_ranges is quadratic and leaks

1 participant