arXiv:2511.00682cs.CV2025-11ICCV被引 4

针对图像超分量化中的异常值问题,提出分区域量化与敏感度感知微调策略。

Outlier-Aware Post-Training Quantization for Image Super-Resolution

论文配图:Outlier-Aware Post-Training Quantization for Image Super-Resolution
图 1 · 摘自论文原文
  • 将激活值分为异常区和密集区,分别独立量化以优化比特分配。
  • 在多个模型和数据集上优于现有后训练量化方法,性能接近量化感知训练。
  • 适合需要高速推理且资源受限的图像超分部署场景。

量化技术(包括量化感知训练QAT和后训练量化PTQ)已成为加速图像超分网络推理的关键手段。相比QAT,PTQ因无需真实标签和重新训练而受到广泛关注。然而,现有SR领域的PTQ方法常因忽视激活值中的异常值影响而导致性能不佳。我们实证分析发现,这些常见激活异常值与图像颜色信息强相关,直接剔除会导致性能显著下降。为此,我们提出双区域量化策略,将激活值划分为异常区域和密集区域,分别独立应用均匀量化,以更优地平衡比特分配。此外,观察到不同网络层对量化敏感度不同,由此导致不同程度的性能退化。为此,我们引入敏感度感知微调,促使模型更关注高敏感层,进一步提升量化性能。大量实验表明,该方法在多种超分网络和数据集上均优于现有PTQ方法,在多数场景下性能接近QAT,且至少实现75倍加速。

原文摘要 · Abstract (English)

Quantization techniques, including quantization-aware training (QAT) and post-training quantization (PTQ), have become essential for inference acceleration of image super-resolution (SR) networks. Compared to QAT, PTQ has garnered significant attention as it eliminates the need for ground truth and model retraining. However, existing PTQ methods for SR often fail to achieve satisfactory performance as they overlook the impact of outliers in activation. Our empirical analysis reveals that these prevalent activation outliers are strongly correlated with image color information, and directly removing them leads to significant performance degradation. Motivated by this, we propose a dual-region quantization strategy that partitions activations into an outlier region and a dense region, applying uniform quantization to each region independently to better balance bit-width allocation. Furthermore, we observe that different network layers exhibit varying sensitivities to quantization, leading to different levels of performance degradation. To address this, we introduce sensitivity-aware finetuning that encourages the model to focus more on highly sensitive layers, further enhancing quantization performance. Extensive experiments demonstrate that our method outperforms existing PTQ approaches across various SR networks and datasets, while achieving performance comparable to QAT methods in most scenarios with at least a 75 speedup.

图像超分量化后训练异常值

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。