feat(contrib): Native Delta Lake scan via delta-kernel-rs (Iceberg-style contrib)#4366

Draft

schenksj wants to merge 37 commits into

apache:mainfrom

schenksj:contrib-delta-direct

Commits on May 30, 2026

fix: propagate parent struct null mask in GetStructField

schenksj
and
claude
committed
fix(shuffle): get_string tolerates non-UTF-8 bytes (lossy decode)

schenksj
and
claude
committed
fix: decline native V1 scans on object_store-unsupported filesystem schemes

schenksj
and
claude
committed
Merge branch 'main' into fix/get-struct-field-null-mask
schenksj
authored
Merge branch 'main' into fix/get-string-lossy-utf8
schenksj
authored
Merge branch 'main' into fix/scheme-gate-object-store
schenksj
authored
fix: rebalance deep AND/OR chains to avoid protobuf recursion limit

schenksj
and
claude
committed
fix: materialize ConstantColumnVector on Comet's serialize/export paths

schenksj
and
claude
committed
fix: decline CreateArray with struct-nullability-divergent children

schenksj
and
claude
committed
perf: O(1) PlanDataInjector lookup by op kind

schenksj
and
claude
committed
feat: surface native parquet read failures as FAILED_READ_FILE

schenksj
and
claude
committed
ci: register PlanDataInjectorSuite in PR build workflows

schenksj
and
claude
committed
ci: register CometScanSchemeFallbackSuite in PR build workflows

schenksj
and
claude
committed
test: make CometScanSchemeFallbackSuite compile under Spark 3.5 / Scala 2.12

schenksj
and
claude
committed
refactor: use imports instead of fully-qualified names in CometScanRule

schenksj
and
claude
committed
refactor: flatten AND/OR chains iteratively; test null operands and OR WHERE

schenksj
and
claude
committed
test: add end-to-end shuffle test for non-UTF-8 StringType bytes (#4521)

schenksj
and
claude
committed
fix: use withFallbackReason in scheme gate (leftover from #4508 rename)

schenksj
and
claude
committed

Commits on May 31, 2026