用图神经网络让图像压缩自动适应内容,提升效率
Adaptive Learned Image Compression with Graph Neural Networks
- 构建双尺度图结构,实现可变感受野的自适应建模
- 根据局部内容复杂度动态调整节点连接数,提升冗余捕捉精度
- 在多个数据集上比现有方法压缩率提升近20%,适合追求高效压缩的研究者
高效图像压缩依赖于对局部与全局冗余的建模。当前最先进的学习型图像压缩(LIC)方法主要基于卷积神经网络(CNN)或Transformer,但其固有的刚性限制了灵活性:标准卷积核和基于窗口的注意力机制具有固定的感受野和静态连接模式,可能因像素在欧氏空间中的邻近关系而错误关联非冗余信息,从而限制了模型对图像中空间变化冗余的自适应能力,尤其在全局层面表现不足。为克服这一问题,我们提出一种基于图神经网络(GNN)的内容自适应图像压缩框架。具体而言,该方法构建双尺度图结构,实现灵活、数据驱动的感受野;同时引入自适应连接机制,根据每个节点的局部内容复杂度动态调整邻居数量。这些创新使我们的图学习图像压缩(GLIC)模型能够有效建模图像中多样的冗余模式,从而实现更高效、更自适应的压缩。实验表明,GLIC在Kodak、Tecnick、CLIC三个数据集上相对于VTM-9.1分别实现了19.29%、21.69%和18.71%的BD-rate降低,达到当前最优性能。代码将发布于https://github.com/UnoC-727/GLIC。
原文摘要 · Abstract (English)
Efficient image compression relies on modeling both local and global redundancy. Most state-of-the-art (SOTA) learned image compression (LIC) methods are based on CNNs or Transformers, which are inherently rigid. Standard CNN kernels and window-based attention mechanisms impose fixed receptive fields and static connectivity patterns, which potentially couple non-redundant pixels simply due to their proximity in Euclidean space. This rigidity limits the model's ability to adaptively capture spatially varying redundancy across the image, particularly at the global level. To overcome these limitations, we propose a content-adaptive image compression framework based on Graph Neural Networks (GNNs). Specifically, our approach constructs dual-scale graphs that enable flexible, data-driven receptive fields. Furthermore, we introduce adaptive connectivity by dynamically adjusting the number of neighbors for each node based on local content complexity. These innovations empower our Graph-based Learned Image Compression (GLIC) model to effectively model diverse redundancy patterns across images, leading to more efficient and adaptive compression. Experiments demonstrate that GLIC achieves state-of-the-art performance, achieving BD-rate reductions of 19.29%, 21.69%, and 18.71% relative to VTM-9.1 on Kodak, Tecnick, and CLIC, respectively. Code will be released at https://github.com/UnoC-727/GLIC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。