[core] Parallelize per-partition file listing for catalog-managed format tables - #8845

Merged

JingsongLi merged 15 commits into

apache:masterfrom

XiaoHongbo-Hope:format_table_parallel_scan

Jul 26, 2026

Commits on Jul 25, 2026

[docs] Regenerate core config docs for format-table.scan.list-parallelism
XiaoHongbo-Hope
committed
[core] Clamp format-table list parallelism to at least 1
XiaoHongbo-Hope
committed
[core] Refactor format table split enumeration
XiaoHongbo-Hope
committed
[core] Split format table enumerator into catalog and filesystem impls
XiaoHongbo-Hope
committed
[core] Reuse the shared manifest-read pool for format table listing
XiaoHongbo-Hope
committed
[core] Bound the format table listing pool and preserve the caller's filesystem context
XiaoHongbo-Hope
committed
[test] Guard that format table listing establishes the filesystem on the caller thread
XiaoHongbo-Hope
committed
[core] Restore Trino-style listing pool: max 1000, 64 per scan, reusing workers
XiaoHongbo-Hope
committed
[core] Name the enumerator SplitEnumerator with Catalog/FileSystem impls per review
XiaoHongbo-Hope
committed