Issues

• Effect of Inflight batching or Continous batching on the Results?

  Infini-AI-Lab/MagicDec#8 · Filter by author ekagra-ranjan opened on Aug 19, 2025

• No Speedup across bsz: 1 --> 48

  Infini-AI-Lab/MagicDec#7 · Filter by author ZepinLi opened on Feb 26, 2025

• Confusion about the results

  Infini-AI-Lab/MagicDec#6 · Filter by author wutong4012 opened on Nov 28, 2024
  4

• Question about the draft/target memory ratio

  Infini-AI-Lab/MagicDec#5 · Filter by author zhuzhui-2000 opened on Nov 20, 2024

• Handling Prefill Lengths Exceeding 2k in TinyLlama_v1.1

  Infini-AI-Lab/MagicDec#4 · Filter by author bettybaii opened on Oct 24, 2024
  4

• Question regarding the termination condition.

  Infini-AI-Lab/MagicDec#3 · Filter by author saeyoon17 opened on Sep 12, 2024

• Hanging on multiple GPU clusters

  Infini-AI-Lab/MagicDec#2 · Filter by author YJHMITWEB opened on Sep 6, 2024
  4

• KV Loading Time

  Infini-AI-Lab/MagicDec#1 · Filter by author wutong4012 opened on Sep 3, 2024
  2