Optimizes Native FSDP memory_efficient_init weight loading for multi-node EP/FSDP jobs & add mutlti-node scripts#207

Merged

tpx818 merged 7 commits into

modelscope:mainfrom

meichangsu1:ep_memory_eff_init

Jun 2, 2026

Commits on May 29, 2026

fix(native-fsdp): use node-local rank0 for memory efficient init
qq_30035749
committed
delete deprecated code
qq_30035749
committed
lint fix
qq_30035749
committed

Commits on Jun 1, 2026

feat: add LoRA adapter state dict extraction with EP support
qq_30035749
committed
fix: replace point-to-point send/recv with broadcast in FSDP state dict
qq_30035749
committed
fix(dist): use send/recv fallback for HCCL local broadcast
qq_30035749
committed
feat:add multi node script
qq_30035749
committed