arXiv:2511.20151cs.CV2025-11

融合卷积与频域状态空间网络,提升图像压缩的细节与长程建模能力。

A Compact Hybrid Convolution--Frequency State Space Network for Learned Image Compression

  • 用卷积处理局部细节,用频域状态空间块捕捉全局上下文。
  • 在CLIC基准上达到当前最优率失真性能,压缩效率优于同类模型。
  • 适合关注高效图像压缩与视觉建模的开发者与研究者。

学习型图像压缩(LIC)近期受益于基于Transformer和状态空间模型(SSM)的骨干网络,用于建模长距离依赖关系。然而,前者通常具有二次复杂度,后者常因将二维特征展平为一维序列而破坏邻域连续性。为此,我们提出一种紧凑的混合卷积-频域状态空间网络(HCFSSNet)用于图像压缩。HCFSSNet结合卷积层对局部细节建模,以及视觉频域状态空间(VFSS)块进行互补的长距离上下文聚合。具体而言,VFSS块包含视觉全向邻域状态空间(VONSS)模块,沿水平、垂直和对角方向扫描特征以更好地保持二维邻域关系;以及自适应频率调制模块(AFMM),通过离散余弦变换实现频率分量的自适应重加权。此外,在超先验路径中引入频域Swin Transformer注意力模块(FSTAM),以增强频率感知的辅助信息建模。在基准数据集上的实验表明,所提HCFSSNet在率失真性能上达到与近期主流编码器相当的水平。源代码与模型将公开发布。

原文摘要 · Abstract (English)

Learned image compression (LIC) has recently benefited from Transformer- and state space models (SSM)- based backbones for modeling long-range dependencies. However, the former typically incurs quadratic complexity, whereas the latter often disrupts neighborhood continuity by flattening 2D features into 1D sequences. To address these issues, we propose a compact Hybrid Convolution and Frequency State Space Network (HCFSSNet) for LIC. HCFSSNet combines convolutional layers for local detail modeling with a Vision Frequency State Space (VFSS) block for complementary long-range contextual aggregation. Specifically, the VFSS block consists of a Vision Omni-directional Neighborhood State Space (VONSS) module, which scans features along horizontal, vertical, and diagonal directions to better preserve 2D neighborhood relations, and an Adaptive Frequency Modulation Module (AFMM), which performs discrete cosine transform-based adaptive reweighting of frequency components. In addition, we introduce a Frequency Swin Transformer Attention Module (FSTAM) in the hyperprior path to enhance frequency-aware side information modeling. Experiments on the benchmark datasets show that the proposed HCFSSNet achieves a competitive rate-distortion performance against recent LIC codecs. The source code and models will be made publicly available.

图像压缩状态空间频域建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。