提出简单高效的量化方法,无需调参即可快速提升模型精度。
Quantization without Tears

- 引入轻量线性结构缓解量化信息损失,方法极简
- 2分钟内实现精度提升,闭式解无需迭代优化
- 跨视觉、语言、多模态任务通用,适合工程落地
深度神经网络虽在各类任务中表现卓越,但需大量计算资源。网络量化通过将权值和激活离散化为整数,降低存储成本并加速推理。然而现有方法复杂且敏感,依赖大量任务特定超参数,微小配置错误即影响性能,限制了模型与任务的通用性。本文提出无需操心的量化方法(QwT),通过在量化网络中加入轻量级线性结构,有效缓解量化过程中的信息损失。该结构仅包含少量线性层,保持方法简洁高效,并提供闭式解,可在2分钟内无痛提升精度。在多种视觉、语言及多模态任务上的实验表明,QwT兼具高效性与通用性,为新型量化范式设计提供了新思路。代码已开源:https://github.com/wujx2001/QwT
原文摘要 · Abstract (English)
Deep neural networks, while achieving remarkable success across diverse tasks, demand significant resources, including computation, GPU memory, bandwidth, storage, and energy. Network quantization, as a standard compression and acceleration technique, reduces storage costs and enables potential inference acceleration by discretizing network weights and activations into a finite set of integer values. However, current quantization methods are often complex and sensitive, requiring extensive task-specific hyperparameters, where even a single misconfiguration can impair model performance, limiting generality across different models and tasks. In this paper, we propose Quantization without Tears (QwT), a method that simultaneously achieves quantization speed, accuracy, simplicity, and generality. The key insight of QwT is to incorporate a lightweight additional structure into the quantized network to mitigate information loss during quantization. This structure consists solely of a small set of linear layers, keeping the method simple and efficient. More importantly, it provides a closed-form solution, allowing us to improve accuracy effortlessly under 2 minutes. Extensive experiments across various vision, language, and multimodal tasks demonstrate that QwT is both highly effective and versatile. In fact, our approach offers a robust solution for network quantization that combines simplicity, accuracy, and adaptability, which provides new insights for the design of novel quantization paradigms. The code is publicly available at https://github.com/wujx2001/QwT
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。