Quantization-Aware Healing: a compressed, 4-bit model that outperforms its full-precision original
Hugging Face proposes Quantization-Aware Healing (QAH), compressing GPT-OSS 120B to a 60B-parameter structure and quantizing it to MXFP4, then distilling directly from the original pre-compression model rather than from a recovered bfloat16 checkpoint.