arXiv:2608.07019cs.AI2026-08

ReQuant让量化模型在生成后仍可优化,提升精度且不改变格式。

ReQuant: Fixed-Grid Discrete Refinement for Post-Training Quantization

论文配图:ReQuant: Fixed-Grid Discrete Refinement for Post-Training Quantization
图 1 · 摘自论文原文
  • 基于固定网格的迭代修正,无需反向传播
  • 低比特下效果显著,可超越复杂初始化方法
  • 适合作为现有量化流程的通用后处理模块

后训练量化(PTQ)广泛用于降低大语言模型的内存与计算开销。现有方法通常通过启发式规则或贪心优化获得初始量化模型,一旦完成便固定权重分配。为此,我们提出ReQuant,一种无需反向传播的固定网格精炼方法,可在生成可执行量化模型后继续优化。ReQuant以现有量化模型为起点,在固定量化网格上迭代调整离散权重,仅接受能降低均方重构误差且保持在原网格上的更新。该过程将原本固定的量化结果转化为可迭代优化的离散解,可无缝集成至现有PTQ流程中。跨多种模型家族、比特位宽和下游任务的实验表明,ReQuant能持续改进来自不同初始器的量化模型,尤其在简单初始化和低比特场景下增益明显。值得注意的是,经多轮精炼,简单的四舍五入初始化可逼近甚至超越同格式下的GPTAQ。结果证明ReQuant是提升现有PTQ流程的有效补充阶段。

原文摘要 · Abstract (English)

Post-training quantization (PTQ) is widely used to reduce the memory and computational cost of large language models. Existing PTQ methods typically obtain an initial quantized model through heuristic rules or greedy optimization, and once quantization is completed the resulting integer assignments are usually treated as final. This observation motivates a complementary optimization stage within PTQ that keeps quantized weights improvable after an executable quantized model has been produced, while preserving the quantized format. We introduce ReQuant, a backpropagation-free fixed-grid refinement procedure for this stage. Agnostic to the PTQ initializer, ReQuant takes an existing quantized model as a feasible starting point and iteratively revisits its discrete weight assignments on the fixed quantization grid. Accepted updates strictly reduce the mean squared reconstruction error and remain on the original grid. In this way, ReQuant turns the initially fixed PTQ output into an iteratively optimizable discrete solution and serves as a plug-and-play post-processing stage for existing PTQ pipelines. Experiments across diverse model families, bit-widths, and downstream tasks show that ReQuant consistently improves quantized models from heterogeneous PTQ initializers, with especially large gains on simple initializers and lower bit-widths. Notably, ReQuant can refine a simple round-to-nearest initialization across multiple sweeps until it approaches or surpasses GPTAQ under the same quantization format. These results establish ReQuant as a practical complementary stage for further improving existing PTQ pipelines.

量化模型压缩后训练精炼

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。