Skip to content

ADFA-5188 | Enable KV cache quantization and flash attention - #76

Open
jatezzz wants to merge 4 commits into
fix/ADFA-5187-dynamic-n-ctxfrom
fix/ADFA-5188-kv-cache-quantization
Open

ADFA-5188 | Enable KV cache quantization and flash attention#76
jatezzz wants to merge 4 commits into
fix/ADFA-5187-dynamic-n-ctxfrom
fix/ADFA-5188-kv-cache-quantization

merge: bring ADFA-5187 single-parse header into the q8_0 KV cache

5d1f91c
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar