perf: replace CometBatchIterator FFI input path with the Arrow C Stream Interface#4572

Draft

mbutrovich wants to merge 62 commits into

apache:mainfrom

mbutrovich:arrow-stream-reader

Commits on May 21, 2026

enable CometLocalTableScanExec by default
mbutrovich
committed

Commits on May 26, 2026

Commits on May 27, 2026

Replace Comet's bespoke CometBatchIterator JNI input path with the canonical Arrow C Stream Interface (JVM Data.exportArrayStream <-> native ArrowArrayStreamReader), eliminating the per-batch FFI d…
mbutrovich
committed
Merge branch 'main' into enable_localtablescan
mbutrovich
committed
Merge branch 'main' into enable_localtablescan
mbutrovich
authored
Unpack dictionaries.
mbutrovich
committed
Merge branch 'main' into enable_localtablescan
mbutrovich
authored
Fix shading issue.
mbutrovich
committed
Merge remote-tracking branch 'origin/enable_localtablescan' into enable_localtablescan
mbutrovich
committed
Try again to fix shading issue.
mbutrovich
committed
Fix alignment issue for FFI Decimal128 with ArrowArrayStreamReader
mbutrovich
committed

Commits on May 29, 2026

Commits on May 30, 2026

Merge remote-tracking branch 'apache/main' into opt_native_shuffle
mbutrovich
committed

Commits on Jun 2, 2026

Commits on Jun 3, 2026

Merge branch 'main' into arrow-stream-reader
mbutrovich
authored

Commits on Jun 4, 2026

Commits on Jun 5, 2026

Move SchemaAlignExec under shuffle.
mbutrovich
committed