[NV] minimaxm3-fp8-gb200-dynamo-vllm-mtp: - #2432

Closed

xinli-sw wants to merge 16 commits into

mainfrom

feat/minimaxm3-fp8-gb200-dynamo-vllm-mtp-dayzero

Commits on Aug 1, 2026

redesign GB200 MTP sweep: 1P DEP4 prefill, 1D x TP4/TP8/DEP4/DEP8/DEP16/DEP32 decode, conc 1-1024
xinli-sw
committed

Commits on Aug 2, 2026

bump dynamo to 1.3.0.dev20260713
xinli-sw
committed
bump prefill gpu-memory-utilization to 0.95 in GB200 MTP recipes
xinli-sw
committed
add max-num-seqs: 256 to GB200 MTP prefill to free KV cache memory
xinli-sw
committed
enforce-eager on prefill to free CUDA graph memory
xinli-sw
committed
Merge remote-tracking branch 'origin/main' into feat/minimaxm3-fp8-gb200-dynamo-vllm-mtp-dayzero
xinli-sw
committed
set decode max-num-seqs and max-cudagraph = conc/total_decode_gpus
xinli-sw
committed
Merge remote-tracking branch 'origin/main' into feat/minimaxm3-fp8-gb200-dynamo-vllm-mtp-dayzero
xinli-sw
committed
remove max-cudagraph-capture-size from prefill (using enforce-eager)
xinli-sw
committed
GB200 MTP: replace 1×DEP32 decode with 2×DEP16
xinli-sw
committed
Merge branch 'main' into feat/minimaxm3-fp8-gb200-dynamo-vllm-mtp-dayzero
xinli-sw
authored