arXiv:2412.17464cs.CVeess.IV2024-12AAAI被引 12

针对图像压缩中概率估计不准问题,提出自适应优化方法,提升编码效率。

CALLIC: Content Adaptive Learning for Lossless Image Compression

  • 基于内容自适应的注意力机制,动态调整编码参数。
  • 在多个数据集上达到当前最优压缩率,显著优于已有方法。
  • 适合需要高精度压缩的图像处理场景,如医学影像、文档存档。

近年来,学习型无损图像压缩取得了显著进展。然而,现有方法通常依赖在大规模数据集上训练近似生成模型,导致在编码特定测试图像时概率分布估计不佳。为此,本文探索最小描述长度(MDL)原理与参数高效迁移学习(PETL)之间的联系,提出一种新型内容自适应学习型无损图像压缩方法——CALLIC。具体而言,首先设计一种基于卷积门控操作的内容感知自回归注意力机制,称为掩码门控卷积形式(MGCF),并在训练数据集上预训练。提出缓存裁剪推理(CCI)以加速编码过程。编码时,将预训练层(包括深度可分离卷积)分解为低秩矩阵,并通过速率引导渐进微调(RPFT)在测试图像上自适应更新增量权重。RPFT按熵值降序排列逐渐增加的图像块进行微调,优化学习过程并减少适配时间。大量实验表明,CALLIC在多种数据集上均达到学习型无损图像压缩的新基准(SOTA)。

原文摘要 · Abstract (English)

Learned lossless image compression has achieved significant advancements in recent years. However, existing methods often rely on training amortized generative models on massive datasets, resulting in sub-optimal probability distribution estimation for specific testing images during encoding process. To address this challenge, we explore the connection between the Minimum Description Length (MDL) principle and Parameter-Efficient Transfer Learning (PETL), leading to the development of a novel content-adaptive approach for learned lossless image compression, dubbed CALLIC. Specifically, we first propose a content-aware autoregressive self-attention mechanism by leveraging convolutional gating operations, termed Masked Gated ConvFormer (MGCF), and pretrain MGCF on training dataset. Cache then Crop Inference (CCI) is proposed to accelerate the coding process. During encoding, we decompose pre-trained layers, including depth-wise convolutions, using low-rank matrices and then adapt the incremental weights on testing image by Rate-guided Progressive Fine-Tuning (RPFT). RPFT fine-tunes with gradually increasing patches that are sorted in descending order by estimated entropy, optimizing learning process and reducing adaptation time. Extensive experiments across diverse datasets demonstrate that CALLIC sets a new state-of-the-art (SOTA) for learned lossless image compression.

无损压缩自适应编码图像压缩深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。