提出四模块协同压缩框架,显著提升图像压缩的清晰度与效率。
Interleaved Block-based Learned Image Compression with Feature Enhancement and Quantization Error Compensation
- 通过分块像素打乱与多尺度特征提取,生成更紧凑的图像表示。
- 在Kodak和CLIC数据集上,PSNR与MS-SSIM均超越现有方法与标准。
- 适合追求高保真图像压缩的开发者与研究者使用。
近年来,学习型图像压缩(LIC)方法取得了显著性能提升。然而,如何获得更紧凑的潜在表示并降低量化误差的影响,仍是该领域关键挑战。为此,本文提出特征提取、特征精炼、特征增强及量化误差补偿四个模块。特征提取模块对图像像素进行打乱,分割为子图像,并从中提取粗粒度特征;特征精炼模块堆叠粗特征,利用由三组3D卷积残差块构成的注意力精炼块,挖掘通道间、子图像内及子图像间的相关性,学习更紧凑的潜在特征;特征增强模块减少量化后解码特征的信息损失;量化误差补偿模块缓解训练与测试阶段的量化不匹配问题。上述模块可无缝集成至当前主流LIC方法中。实验表明,将本方法与Tiny-LIC结合,在Kodak与CLIC数据集上,于峰值信噪比(PSNR)与多尺度结构相似性(MS-SSIM)指标上均优于现有LIC方法及传统图像压缩标准。
原文摘要 · Abstract (English)
In recent years, learned image compression (LIC) methods have achieved significant performance improvements. However, obtaining a more compact latent representation and reducing the impact of quantization errors remain key challenges in the field of LIC. To address these challenges, we propose a feature extraction module, a feature refinement module, and a feature enhancement module. Our feature extraction module shuffles the pixels in the image, splits the resulting image into sub-images, and extracts coarse features from the sub-images. Our feature refinement module stacks the coarse features and uses an attention refinement block composed of concatenated three-dimensional convolution residual blocks to learn more compact latent features by exploiting correlations across channels, within sub-images (intra-sub-image correlations), and across sub-images (inter-sub-image correlations). Our feature enhancement module reduces information loss in the decoded features following quantization. We also propose a quantization error compensation module that mitigates the quantization mismatch between training and testing. Our four modules can be readily integrated into state-of-the-art LIC methods. Experiments show that combining our modules with Tiny-LIC outperforms existing LIC methods and image compression standards in terms of peak signal-to-noise ratio (PSNR) and multi-scale structural similarity (MS-SSIM) on the Kodak dataset and the CLIC dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。