arXiv:2503.21970cs.CV2025-03被引 7

提出高效图像修复量化模型,解决低比特下性能下降问题。

Q-MambaIR: Accurate Quantized Mamba for Efficient Image Restoration

  • 动态标量调整量化范围,缓解极端值带来的误差
  • 自适应阈值灵活舍入,保留高频细节与特征提取能力
  • 支持部署前权重量化,兼顾效率与精度,适合边缘设备

状态空间模型(SSMs)因能线性扩展序列长度并有效捕捉长距离依赖,在图像修复(IR)中受到广泛关注。然而,受限于内存、算力和功耗,将SSM部署到边缘设备仍具挑战,亟需高效压缩策略。尽管低比特量化可减小模型尺寸并加速推理,但SSM在超低比特(2-4位)下性能显著下降,主要源于异常值加剧量化误差。为此,我们提出Q-MambaIR,一种精确、高效且灵活的量化图像修复模型。具体地,引入统计动态平衡可学习标量(DLS),动态调整量化映射范围,缓解极端值导致的截断损失;同时设计范围浮动灵活分配器(RFA),结合自适应阈值实现灵活舍入,有效保留高频细节并维持SSM特征提取能力。值得注意的是,RFA支持部署前权重量化,在计算效率与模型精度间取得良好平衡。大量实验表明,Q-MambaIR持续优于现有量化SSM,在仅带来微小训练开销增加的前提下,实现更高水平的准确率,同时显著节省存储空间。

原文摘要 · Abstract (English)

State-Space Models (SSMs) have attracted considerable attention in Image Restoration (IR) due to their ability to scale linearly sequence length while effectively capturing long-distance dependencies. However, deploying SSMs to edge devices is challenging due to the constraints in memory, computing capacity, and power consumption, underscoring the need for efficient compression strategies. While low-bit quantization is an efficient model compression strategy for reducing size and accelerating IR tasks, SSM suffers substantial performance drops at ultra-low bit-widths (2-4 bits), primarily due to outliers that exacerbate quantization error. To address this challenge, we propose Q-MambaIR, an accurate, efficient, and flexible Quantized Mamba for IR tasks. Specifically, we introduce a Statistical Dynamic-balancing Learnable Scalar (DLS) to dynamically adjust the quantization mapping range, thereby mitigating the peak truncation loss caused by extreme values. Furthermore, we design a Range-floating Flexible Allocator (RFA) with an adaptive threshold to flexibly round values. This approach preserves high-frequency details and maintains the SSM's feature extraction capability. Notably, RFA also enables pre-deployment weight quantization, striking a balance between computational efficiency and model accuracy. Extensive experiments on IR tasks demonstrate that Q-MambaIR consistently outperforms existing quantized SSMs, achieving much higher state-of-the-art (SOTA) accuracy results with only a negligible increase in training computation and storage saving.

图像修复量化Mamba边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。