arXiv:2512.00744cs.CV2025-12

提出新型网络结构,提升图像压缩的细节保留与效率。

Joint Multi-scale Gated Transformer and Prior-guided Convolutional Network for Learned Image Compression

  • 引入先验引导卷积和多尺度门控注意力机制
  • 在相同复杂度下比特率降低3.2%,重建质量更高
  • 适合追求高压缩比与高质量图像的应用场景

近年来,学习型图像压缩方法取得了显著进展,部分已超越传统图像编码标准VVC。其优势主要源于强大的非线性变换编码能力。卷积层与移位窗口变压器(Swin-T)块是神经网络的基本单元,其表征能力对非线性变换编码至关重要。本文为增强原始卷积提取局部特征的能力,提出一种新型先验引导卷积(PGConv),引入非对称卷积(AConvs)强化骨架元素,差异卷积(DConvs)提取高频信息,并采用重参数化策略降低计算复杂度。同时,为提升Swin-T块提取非局部特征的能力,提出多尺度门控变压器(MGT),通过不同膨胀率的膨胀窗口多头自注意力模块与不同核大小的深度卷积层实现多尺度特征提取,并引入门控机制增强非线性。最终,提出联合多尺度门控变压器与先验引导卷积网络(MGTPCN)用于学习型图像压缩。实验结果表明,所提方法在性能与复杂度之间取得更优平衡,优于现有先进算法。

原文摘要 · Abstract (English)

Recently, learned image compression methods have made remarkable achievements, some of which have outperformed the traditional image codec VVC. The advantages of learned image compression methods over traditional image codecs can be largely attributed to their powerful nonlinear transform coding. Convolutional layers and shifted window transformer (Swin-T) blocks are the basic units of neural networks, and their representation capabilities play an important role in nonlinear transform coding. In this paper, to improve the ability of the vanilla convolution to extract local features, we propose a novel prior-guided convolution (PGConv), where asymmetric convolutions (AConvs) and difference convolutions (DConvs) are introduced to strengthen skeleton elements and extract high-frequency information, respectively. A re-parameterization strategy is also used to reduce the computational complexity of PGConv. Moreover, to improve the ability of the Swin-T block to extract non-local features, we propose a novel multi-scale gated transformer (MGT), where dilated window-based multi-head self-attention blocks with different dilation rates and depth-wise convolution layers with different kernel sizes are used to extract multi-scale features, and a gate mechanism is introduced to enhance non-linearity. Finally, we propose a novel joint Multi-scale Gated Transformer and Prior-guided Convolutional Network (MGTPCN) for learned image compression. Experimental results show that our MGTPCN surpasses state-of-the-art algorithms with a better trade-off between performance and complexity.

图像压缩神经网络Transformer卷积网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。