Hybrid CUDA library tasks for single-token decode: parity, not a win — measured findings + llama.logitsLib switch#131

Open

mikepapadim wants to merge 1 commit into

beehive-lab:feat/mma_cudafrom

mikepapadim:feat/hybrid-decode-libs

Commits on Jul 14, 2026

Hybrid-library logits matvec experiment (llama.logitsLib=jit|gemmEx|lt) + findings: cuBLAS/cuBLASLt at parity with JIT on n=1 decode (bandwidth wall, launch-bound regime); CUDA graphs remain the si…
mikepapadim
committed