用移位操作替代大卷积核,显著降低图像压缩模型的计算开销。
ShiftLIC: Lightweight Learned Image Compression with Spatial-Channel Shift Operations
- 用无参数移位操作替换大卷积核,减少计算量和参数量。
- 在相同质量下,计算成本比VVC Intra低,每像素每乘加操作的率失真收益达-102.6%。
- 适合移动端、嵌入式等资源受限场景部署。
学习型图像压缩(LIC)因其优异的率失真性能和灵活性受到广泛关注,但其高计算成本限制了实际应用。现有方法很少关注LIC骨干网络中的特征冗余问题。本文发现,许多特征具有相似性。为此提出ShiftLIC,一种新型高效LIC框架,通过无参数的移位操作替代大卷积核,显著降低模型计算负担与参数量。具体提出空间移位块(SSB),结合移位操作与小卷积核,既保持特征提取效率,又降低复杂度。为增强通道维度表达能力,设计基于递归特征融合的通道注意力模块,在最小化开销前提下提升特征交互。同时引入改进的熵模型,与SSB模块集成,使熵估计更轻量,全面降低计算成本。实验表明,ShiftLIC在计算成本、参数量和解码延迟上优于主流方法如VVC Intra与GMM。在每像素每乘加操作的率失真增益上达到-102.6%,刷新该指标的最新纪录,具备在资源受限环境下的部署潜力。代码已开源:https://github.com/baoyu2020/ShiftLIC。
原文摘要 · Abstract (English)
Learned Image Compression (LIC) has attracted considerable attention due to their outstanding rate-distortion (R-D) performance and flexibility. However, the substantial computational cost poses challenges for practical deployment. The issue of feature redundancy in LIC is rarely addressed. Our findings indicate that many features within the LIC backbone network exhibit similarities. This paper introduces ShiftLIC, a novel and efficient LIC framework that employs parameter-free shift operations to replace large-kernel convolutions, significantly reducing the model's computational burden and parameter count. Specifically, we propose the Spatial Shift Block (SSB), which combines shift operations with small-kernel convolutions to replace large-kernel. This approach maintains feature extraction efficiency while reducing both computational complexity and model size. To further enhance the representation capability in the channel dimension, we propose a channel attention module based on recursive feature fusion. This module enhances feature interaction while minimizing computational overhead. Additionally, we introduce an improved entropy model integrated with the SSB module, making the entropy estimation process more lightweight and thereby comprehensively reducing computational costs. Experimental results demonstrate that ShiftLIC outperforms leading compression methods, such as VVC Intra and GMM, in terms of computational cost, parameter count, and decoding latency. Additionally, ShiftLIC sets a new SOTA benchmark with a BD-rate gain per MACs/pixel of -102.6\%, showcasing its potential for practical deployment in resource-constrained environments. The code is released at https://github.com/baoyu2020/ShiftLIC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。