arXiv:2511.05868eess.IVcs.CV2025-11AAAI

提出统一量化框架,提升超分辨率模型压缩后的图像质量。

HarmoQ: Harmonized Post-Training Quantization for High-Fidelity Image

  • 通过协同优化权重与激活量化,缓解细节损失。
  • 2比特压缩下比现有方法高0.46 dB,速度提升3.2倍,内存减少4倍。
  • 适合追求高效高保真图像重建的工程师和研究者。

后训练量化为部署超分辨率模型提供了高效途径,但现有方法独立处理权重与激活量化,忽略了二者关键关联。在SwinIR上的控制实验揭示显著不对称性:权重量化主要降低结构相似性,而激活量化则严重损害像素级精度。这源于两者不同角色——权重编码纹理与边缘的先验知识,激活承载输入特异性强度信息。基于此,我们提出HarmoQ,一个通过三个协同步骤统一量化过程的框架:结构残差校准主动补偿激活导致的细节损失,谐振尺度优化通过闭式解分析平衡量化难度,自适应边界精炼在优化中迭代维持平衡。实验表明,HarmoQ在激进压缩下表现优异,在Set5数据集上2比特时领先0.46 dB,同时在A100 GPU上实现3.2倍加速与4倍内存缩减。本工作首次系统分析了超分辨率量化中的权-活耦合机制,并提出了高效高保真图像重建的原理性解决方案。

原文摘要 · Abstract (English)

Post-training quantization offers an efficient pathway to deploy super-resolution models, yet existing methods treat weight and activation quantization independently, missing their critical interplay. Through controlled experiments on SwinIR, we uncover a striking asymmetry: weight quantization primarily degrades structural similarity, while activation quantization disproportionately affects pixel-level accuracy. This stems from their distinct roles--weights encode learned restoration priors for textures and edges, whereas activations carry input-specific intensity information. Building on this insight, we propose HarmoQ, a unified framework that harmonizes quantization across components through three synergistic steps: structural residual calibration proactively adjusts weights to compensate for activation-induced detail loss, harmonized scale optimization analytically balances quantization difficulty via closed-form solutions, and adaptive boundary refinement iteratively maintains this balance during optimization. Experiments show HarmoQ achieves substantial gains under aggressive compression, outperforming prior art by 0.46 dB on Set5 at 2-bit while delivering 3.2x speedup and 4x memory reduction on A100 GPUs. This work provides the first systematic analysis of weight-activation coupling in super-resolution quantization and establishes a principled solution for efficient high-quality image restoration.

超分辨率量化图像重建高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。