Skip to content

V0 spilling MergeQueue#789

Open
frankmcsherry wants to merge 1 commit intoTimelyDataflow:masterfrom
frankmcsherry:byte_slab_spill
Open

V0 spilling MergeQueue#789
frankmcsherry wants to merge 1 commit intoTimelyDataflow:masterfrom
frankmcsherry:byte_slab_spill

Conversation

@frankmcsherry
Copy link
Copy Markdown
Member

@frankmcsherry frankmcsherry commented Apr 15, 2026

Draft version of a spill-friendly MergeQueue, which is TD's unbounded byte stream.

frankmcsherry
frankmcsherry commented Apr 15, 2026
View reviewed changes
Comment thread communication/src/allocator/zero_copy/bytes_exchange.rs Outdated
@frankmcsherry frankmcsherry force-pushed the byte_slab_spill branch 8 times, most recently from 4dbc97d to b71b052 Compare April 15, 2026 19:57
@frankmcsherry frankmcsherry marked this pull request as ready for review April 15, 2026 20:13
@frankmcsherry frankmcsherry requested a review from antiguru April 15, 2026 20:15
@frankmcsherry
Copy link
Copy Markdown
Member Author

frankmcsherry commented Apr 16, 2026

Caveat: I haven't read spill.rs other than the traits, and the "starter implementations" may be bonkers. Potentially right in spirit, but the main goal is the abstraction that allows one to rock up with their own implementation. I'll try and sort them out more tomorrow.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@antiguru antiguru Awaiting requested review from antiguru

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@frankmcsherry