Skip to content

Core, Spark: Fix row lineage last updated sequence inheritance#17264

Open
manuzhang wants to merge 1 commit into
1.11.xfrom
backport-17039-1.11.x
Open

Core, Spark: Fix row lineage last updated sequence inheritance#17264
manuzhang wants to merge 1 commit into
1.11.xfrom
backport-17039-1.11.x

Conversation

@manuzhang

@manuzhang manuzhang commented Jul 17, 2026

Copy link
Copy Markdown
Member

Summary

Backports #17039 to 1.11.x.

  • Fixes _last_updated_sequence_number inheritance to use a data file's data_sequence_number in scan constants.
  • Adds regression coverage for a v2 rewrite/compaction followed by a v3 upgrade and row ID assignment.
  • Applies the Spark regression to the versions supported on this branch: 3.4, 3.5, 4.0, and 4.1.

AI Disclosure

@manuzhang
manuzhang marked this pull request as ready for review July 17, 2026 04:33
@manuzhang manuzhang changed the title [1.11.x] Core, Spark: Fix row lineage last updated sequence inheritance Core, Spark: Fix row lineage last updated sequence inheritance Jul 17, 2026
@manuzhang manuzhang added this to the Iceberg 1.11.1 milestone Jul 17, 2026
Backport #17039 to 1.11.x by inheriting _last_updated_sequence_number from a data file data sequence number. Add core and Spark regression coverage for v2 compaction followed by a v3 upgrade.

Co-authored-by: Codex <codex@openai.com>
@manuzhang

Copy link
Copy Markdown
Member Author

I removed [1.11.x] from PR title since it fails PR title check, and opened #17265 to fix that.

@manuzhang
manuzhang force-pushed the backport-17039-1.11.x branch from 5cc6d2e to 570c54b Compare July 17, 2026 05:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants