Skip to content

Add Experts4bit for 4-bit quantization of fused MoE experts#1965

Draft
pjordanandrsn wants to merge 2 commits into
bitsandbytes-foundation:mainfrom
pjordanandrsn:feature/experts-4bit
Draft

Add Experts4bit for 4-bit quantization of fused MoE experts#1965
pjordanandrsn wants to merge 2 commits into
bitsandbytes-foundation:mainfrom
pjordanandrsn:feature/experts-4bit

Add Experts4bit reference docs

5a0c73a
Select commit
Loading
Failed to load commit list.