Prebuilt: pin the IQ1_XS, IQ1_XXS and IQ1_XXXS quant types - #92
Merged
Conversation
Adds IQ1_XS at 1.4375 bpw, IQ1_XXS at 1.3125 and IQ1_XXXS at 1.1875 to the nightly. Pins #91 rather than #61: same commit content, but on an upstream base, so it merges onto the base tag instead of dragging two months of squash-synced master in behind it. Replayed resolve on b10356 with this set: all four pins merge, tag b10356-mix-1c79028, and the resulting tree hash matches the tree that was built and tested (cdc8f949).
danielhanchen
added a commit
that referenced
this pull request
Aug 11, 2026
#92 merged into its stacked base branch rather than master, so the pin landed on prset-drop-merged-26841 and never reached the file the nightly reads. Same one-line addition, on top of master. #91 is merged now, into iq1-narrow-upstream-base rather than master, so the tree resolve builds still does not contain it and the pin is still what puts it in. A merged required pin keeps being mixed in, with a warning, which is the intended path here.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds the three sub-IQ1_S quantization types to the nightly mix:
IQ1_XSat 1.4375 bpw,IQ1_XXSat 1.3125 andIQ1_XXXSat 1.1875.Stacked on #90, so it targets that branch rather than master. #90 drops the merged
26841pin, which currently fails the merge before anything after it is reached. Merge #90 first and this retargets to master on its own.Pinning #91, not #61
The code is #61. The pin points at #91 because #61 branches off master past the squash sync
53fd974b4, and master shares history with upstream only up to 2026-06-10.resolvemerges pins onto the upstream base tag, so #61 arrives 765 commits stale and conflicts acrosstools/ui/,vendor/cpp-httplib/andvendor/sheredom/, files it never touches. #91 is the same commit on ab10356base, the same arrangement #70 uses. #61 stays open for design review.Resolve replay on b10356
Only #70 needs
additive_merge.py, and only for pure add/add hunks, same as today. Thecmake/build-info.cmakestamping step still finds its three anchor lines inb10356.Build and tests
Full mix built with CUDA
sm_100on a B200. The treeresolveproduced hashes tocdc8f9490e4e33bc0dc87c94842455f6a8e5e189, identical to the tree these numbers come from.test-backend-opshitting the 1500s ctest timeout, run separately belowtest-backend-ops -o MUL_MAT -b CUDA0test-backend-ops -o MUL_MAT_ID -b CUDA0Sizes come out in the order the bpw table predicts: IQ1_S 393551840, IQ1_XS 380182496, IQ1_XXS 366813152, IQ1_XXXS 353443808.
Nothing else in the mix regresses
Built the same tree without the new commit and requantized from the same imatrix with both binaries. Byte-identical output:
DiffusionGemma, Inkling, Kimi-K3 and Muse Glimmer all still land. Every arch registers in
llama-arch.cpp,test-llama-archspasses, the fourllama-diffusion-*binaries link, and the libraries export what they should (libllama.so: diffusion_gemma 17, inkling 24, kimi_k3 23, muse_glimmer 17;libmtmd.so: kimivl 7, muse_glimmer 14). Muse Glimmer comes from the base tag now that its pin is gone, at upstream's final state.