arXiv:2502.04988eess.IVcs.CV2025-02被引 6

用状态空间模型提升图像压缩,兼顾效果与效率

CMamba: Learned Image Compression with State Space Models

  • 融合CNN与状态空间模型,动态结合全局与局部特征
  • 在相同复杂度下,率失真性能优于现有方法
  • 适合追求高效压缩的视觉系统开发者

学习型图像压缩(LIC)已尝试使用卷积神经网络(CNN)和Transformer等架构来建模图像内容分布以实现高效压缩。然而,在保持低计算复杂度(参数量、浮点运算量和延迟)的同时达到高率失真性能仍具挑战。本文提出一种基于卷积与状态空间模型(SSM)的混合压缩框架CMamba,实现优异的率失真性能且计算开销低。具体包含两个核心组件:内容自适应状态空间模块(CA-SSM)和上下文感知熵模型(CAE)。首先,观察到SSM擅长建模整体内容但易丢失高频细节,而CNN擅长捕捉局部细节。因此,提出CA-SSM模块,在编码和解码阶段动态融合由SSM提取的全局内容与由CNN捕获的局部细节,有效保留重要图像信息。其次,提出的CAE模块通过SSM参数化潜在表示中的空间内容,显著提升空间压缩效率并减少冗余;同时,沿通道维度采用自回归方式减少通道间冗余,充分利用前序通道先验知识而不增加计算负担。实验表明,CMamba在保持低复杂度的前提下实现了领先的率失真性能。

原文摘要 · Abstract (English)

Learned Image Compression (LIC) has explored various architectures, such as Convolutional Neural Networks (CNNs) and transformers, in modeling image content distributions in order to achieve compression effectiveness. However, achieving high rate-distortion performance while maintaining low computational complexity (\ie, parameters, FLOPs, and latency) remains challenging. In this paper, we propose a hybrid Convolution and State Space Models (SSMs) based image compression framework, termed \textit{CMamba}, to achieve superior rate-distortion performance with low computational complexity. Specifically, CMamba introduces two key components: a Content-Adaptive SSM (CA-SSM) module and a Context-Aware Entropy (CAE) module. First, we observed that SSMs excel in modeling overall content but tend to lose high-frequency details. In contrast, CNNs are proficient at capturing local details. Motivated by this, we propose the CA-SSM module that can dynamically fuse global content extracted by SSM blocks and local details captured by CNN blocks in both encoding and decoding stages. As a result, important image content is well preserved during compression. Second, our proposed CAE module is designed to reduce spatial and channel redundancies in latent representations after encoding. Specifically, our CAE leverages SSMs to parameterize the spatial content in latent representations. Benefiting from SSMs, CAE significantly improves spatial compression efficiency while reducing spatial content redundancies. Moreover, along the channel dimension, CAE reduces inter-channel redundancies of latent representations via an autoregressive manner, which can fully exploit prior knowledge from previous channels without sacrificing efficiency. Experimental results demonstrate that CMamba achieves superior rate-distortion performance.

图像压缩状态空间模型深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。