Skip to content

Optimize local load TsFile piece dispatch#17851

Open
Caideyipi wants to merge 1 commit into
apache:masterfrom
Caideyipi:optimize-load-piece-dispatch
Open

Optimize local load TsFile piece dispatch#17851
Caideyipi wants to merge 1 commit into
apache:masterfrom
Caideyipi:optimize-load-piece-dispatch

Conversation

@Caideyipi
Copy link
Copy Markdown
Collaborator

Summary

  • avoid the serialize/deserialize round trip when dispatching LoadTsFilePieceNode to the local DataNode
  • allow aligned and non-aligned ChunkData produced by the splitter to write directly by lazily materializing their write state
  • add unit coverage for local dispatch identity and direct ChunkData writing without a serde round trip

Tests

  • mvn -pl iotdb-core/datanode spotless:apply
  • javac --release 8 for changed main classes
  • javac --release 8 for added test classes
  • git diff --check

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant