v2.0 Model & Documentation Release

[magiccodingman]

First demo model of v2.0 MagicQuant released:
https://huggingface.co/magiccodingman/Qwen3-4B-Instruct-2507-Unsloth-MagicQuant-v2-GGUF

I am baking up Qwen3.6 35B A3B and 27B right now. Models will be dropped here:
https://huggingface.co/collections/magiccodingman/magic-quant

Example

The following is the 4B example from above:

Name	Provider	Quant Family	KLD	Size (GB)
LM-Q8_0	llama.cpp	Q8_0	0.001339	3.99
MQ-Q6_K_1	MagicQuant	Q6_K	0.001817	3.58
UD-Q6_K_XL	Unsloth	UD-Q6_K_XL	0.002111	3.41
LM-Q6_K	llama.cpp	Q6_K	0.004640	3.08
MQ-Q5_K_1	MagicQuant	Q5_K	0.006632	2.88
UD-Q5_K_XL	Unsloth	UD-Q5_K_XL	0.009839	2.73
MQ-Q4_K_M_1	MagicQuant	Q4_K_M	0.020346	2.44
LM-Q4_K_S	llama.cpp	Q4_K_S	0.029803	2.22
LM-IQ4_XS	llama.cpp	IQ4_XS	0.031300	2.11
UD-Q3_K_XL	Unsloth	UD-Q3_K_XL	0.072278	1.98

• LM - Llama.cpp quantized
• UD - Unsloth Dynamic
• MQ - MagicQuant hybrid