feat: support PD disaggregation#440

Merged

wooway777 merged 11 commits into

mainfrom

Jun 17, 2026

Commits on Jun 15, 2026

issue/340 - add the pybind interface of kv cache
wangpengcheng
committed
issue/340 - add mooncake connector scheduler

ma-hang
authored and
wangpengcheng
committed
issue/340 - add mooncake connector worker
wangpengcheng
committed
add model runner

spike-zhu
authored and
wangpengcheng
committed
issue/340 - pybind: document GIL release in forward()

ma-hang
authored and
wangpengcheng
committed
issue/340 - Add PD disaggregation support across inference pipeline

ma-hang
authored and
wangpengcheng
committed
issue/340- fix bug of rdma kv flag
wangpengcheng
committed

Commits on Jun 16, 2026