arXiv:2609.06161cs.LGcs.AI2026-09

提出真正1比特的LLM量化方法,实现存储与速度双重突破。

All for 1-Bit: Towards Genuine 1-Bit Post-Training Quantization for LLMs

论文配图:All for 1-Bit: Towards Genuine 1-Bit Post-Training Quantization for LLMs
图 1 · 摘自论文原文
  • 通过感知零空间的二值分解与分层敏感度分配,精准控制模型压缩
  • 在1.0-BPW下保持高精度,平均推理速度提升2.5倍,内存减少90%以上
  • 适合追求极致部署效率的工业级大模型应用

大语言模型虽取得显著进展,但其巨大的存储和内存带宽需求仍制约高效部署。权重二值化是潜在解决方案,但现有基于二值化的后训练量化(PTQ)方法常因隐含开销而远超名义1比特存储目标。为此,我们提出真正的1比特后训练量化框架All for 1-Bit(AF1)。AF1包含两个互补组件:(1) 零空间感知二值分解(NABF),通过海森感知代理重参数化、零空间感知二值分解及仅缩放全局重建提升二值重构质量;(2) 分层谢尔利分配(HiSA),利用分层谢尔利敏感度分配结构容量。二者协同使模型在严格1.0-BPW预算下保持精度。在LLaMA、Qwen和Gemma系列上的实验表明,AF1在困惑度和零样本准确率上持续优于现有二值化基PTQ方法。相较于BF16,AF1在各模型上平均实现2.5倍推理加速和超过90%内存压缩,为可部署的真实1比特压缩提供了可行路径。代码已开源:https://github.com/Kishon-zzx/AF1。

原文摘要 · Abstract (English)

Large language models (LLMs) have achieved remarkable progress, yet their massive storage and memory-bandwidth demands still hinder efficient deployment. Weight binarization is a promising solution, but existing binarization-based post-training quantization (PTQ) methods usually far exceed the nominal 1-bit storage target due to hidden overhead. To address this gap, we propose All for 1-Bit (AF1), a genuine 1-bit PTQ framework for LLMs. AF1 comprises two complementary components: (1) Null-space-Aware Binary Factorization (NABF) for improving binary reconstruction through Hessian-aware surrogate reparameterization, null-space-aware binary factorization, and scale-only global reconstruction; and (2) Hierarchical Shapley Allocation (HiSA) for assigning structural capacity using hierarchical Shapley sensitivity. Together, they preserve model accuracy under a strict 1.0-BPW budget in the PTQ setting. Experiments on LLaMA, Qwen, and Gemma families show that AF1 consistently outperforms existing binarization-based PTQ methods in perplexity and zero-shot accuracy. Compared with BF16, AF1 achieves an average 2.5 times inference speedup and over 90% memory reduction across evaluated models, providing a practical path toward deployable genuine 1-bit compression for LLMs. The code for reproducibility is available at https://github.com/Kishon-zzx/AF1.

大模型压缩1比特量化后训练量化高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。