Skip to content

Fix for merge_offset_ranges becoming quadratic - #2091

Open
BrianMichell wants to merge 5 commits into
fsspec:masterfrom
BrianMichell:fix/merge-offset-ranges-quadratic
Open

Fix for merge_offset_ranges becoming quadratic#2091
BrianMichell wants to merge 5 commits into
fsspec:masterfrom
BrianMichell:fix/merge-offset-ranges-quadratic

Conversation

@BrianMichell

@BrianMichell BrianMichell commented Jul 29, 2026

Copy link
Copy Markdown

#1982 introduced a performance regression that was raised as an issue here: TGSAI/segy#343

This PR seeks to restore the original O(n log n) algorithm while retaining the fixes for Parquet.

@BrianMichell BrianMichell changed the title Fix for merge_offset_ranges becoming non-linear time Fix for merge_offset_ranges becoming quadratic Jul 29, 2026
@BrianMichell
BrianMichell marked this pull request as ready for review July 29, 2026 21:18
Comment thread fsspec/utils.py Outdated
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants