arXiv:2511.06717cs.CV2025-11AAAI被引 3

用1维紧凑表示提升极端图像压缩效率,比现有方法快43%以上。

MRT: Learning Compact Representations with Mixed RWKV-Transformer for Extreme Image Compression

  • 混合RWKV与Transformer,分窗处理全局与局部冗余
  • 在0.02 bpp以下比特率下重建质量领先,节省43.75%码率
  • 适合低码率图像压缩场景,尤其对资源受限系统友好

近期极端图像压缩研究发现,将像素数据映射到高度紧凑的潜在表示可显著提升编码效率。然而,现有方法多通过卷积神经网络或Swin Transformer将图像压缩至二维潜在空间,易保留大量空间冗余,限制整体压缩性能。本文提出一种新型混合RWKV-Transformer(MRT)架构,通过融合线性注意力的RWKV与自注意力的Transformer优势,将图像编码为更紧凑的一维潜在表示。MRT将图像划分为固定大小窗口,利用RWKV模块捕捉窗口间全局依赖,同时用Transformer块建模每个窗口内的局部冗余。层级注意力机制使一维域中的表示学习更加高效紧凑。为进一步提升压缩效率,我们设计了针对MRT中间一维潜在特征结构的专用RWKV压缩模型(RCM)。在标准图像压缩基准上的大量实验验证了该方法的有效性。所提MRT框架在低于0.02比特每像素(bpp)的比特率下始终实现更优重建质量。基于DISTS指标的定量结果表明,MRT显著优于当前最优的二维架构GLC,在Kodak和CLIC2020测试集上分别实现43.75%和30.59%的码率节省。

原文摘要 · Abstract (English)

Recent advances in extreme image compression have revealed that mapping pixel data into highly compact latent representations can significantly improve coding efficiency. However, most existing methods compress images into 2-D latent spaces via convolutional neural networks (CNNs) or Swin Transformers, which tend to retain substantial spatial redundancy, thereby limiting overall compression performance. In this paper, we propose a novel Mixed RWKV-Transformer (MRT) architecture that encodes images into more compact 1-D latent representations by synergistically integrating the complementary strengths of linear-attention-based RWKV and self-attention-based Transformer models. Specifically, MRT partitions each image into fixed-size windows, utilizing RWKV modules to capture global dependencies across windows and Transformer blocks to model local redundancies within each window. The hierarchical attention mechanism enables more efficient and compact representation learning in the 1-D domain. To further enhance compression efficiency, we introduce a dedicated RWKV Compression Model (RCM) tailored to the structure characteristics of the intermediate 1-D latent features in MRT. Extensive experiments on standard image compression benchmarks validate the effectiveness of our approach. The proposed MRT framework consistently achieves superior reconstruction quality at bitrates below 0.02 bits per pixel (bpp). Quantitative results based on the DISTS metric show that MRT significantly outperforms the state-of-the-art 2-D architecture GLC, achieving bitrate savings of 43.75%, 30.59% on the Kodak and CLIC2020 test datasets, respectively.

图像压缩RWKV一维表示低码率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。