arXiv:2502.13988eess.IV2025-02被引 6

用隐式语义先验实现轻量级感知图像压缩,适合移动端部署。

A Lightweight Model for Perceptual Image Compression via Implicit Priors

  • 通过隐式语义先验和频域调节模块减少冗余,提升压缩效率。
  • 参数量和浮点运算量远低于现有最优方法,性能仍具竞争力。
  • 适合资源受限设备,兼顾视觉质量与计算开销。

感知图像压缩在低比特率下可生成视觉效果优异的图像,超越传统标准和基于像素级失真的神经方法。然而,现有方法通常引入显式语义先验(如分割图、文本特征)以提升性能,导致模型复杂度上升,增加参数量和浮点运算量,限制了其在资源受限移动设备上的应用。为此,我们提出一种基于隐式语义先验的轻量级感知图像压缩方法(ICISP)。首先设计增强型视觉状态空间块,捕捉局部与全局空间依赖以降低冗余;针对不同频率信息对压缩贡献不均的问题,引入频域分解调制块,自适应保留或抑制高低频信息。上述模块构成编码器-解码器核心结构,并进一步构建基于预训练DINOv2编码器的语义感知判别器,利用隐式语义先验提升重建图像的感知质量。在主流基准测试中,该方法达到与当前最优水平相当的压缩性能,且网络参数量和浮点运算量显著更低。

原文摘要 · Abstract (English)

Perceptual image compression has shown strong potential for producing visually appealing results at low bitrates, surpassing classical standards and pixel-wise distortion-oriented neural methods. However, existing methods typically improve compression performance by incorporating explicit semantic priors, such as segmentation maps and textual features, into the encoder or decoder, which increases model complexity by adding parameters and floating-point operations. This limits the model's practicality, as image compression often occurs on resource-limited mobile devices. To alleviate this problem, we propose a lightweight perceptual Image Compression method using Implicit Semantic Priors (ICISP). We first develop an enhanced visual state space block that exploits local and global spatial dependencies to reduce redundancy. Since different frequency information contributes unequally to compression, we develop a frequency decomposition modulation block to adaptively preserve or reduce the low-frequency and high-frequency information. We establish the above blocks as the main modules of the encoder-decoder, and to further improve the perceptual quality of the reconstructed images, we develop a semantic-informed discriminator that uses implicit semantic priors from a pretrained DINOv2 encoder. Experiments on popular benchmarks show that our method achieves competitive compression performance and has significantly fewer network parameters and floating point operations than the existing state-of-the-art.

图像压缩轻量模型感知质量隐式先验

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。