arXiv:2512.12229cs.CV2025-12被引 2

用浅层编码器实现超低比特率图像压缩,兼顾高效编码与高质量解码。

Ultra-Low Bitrate Perceptual Image Compression with Shallow Encoder

  • 采用浅层编码器结合一步扩散解码器,实现极低比特率下的高效压缩。
  • 在低于0.05 bpp下,重建图像保真度和真实感显著优于现有方法。
  • 适合边缘设备部署,1080P图像编码达35.8帧/秒,效率突出。

超低比特率图像压缩(低于0.05比特/像素)在带宽受限、计算资源有限的边缘设备场景中日益重要。现有框架通常依赖大型预训练编码器(如VAEs或基于分词器的模型),并在其生成潜空间内进行变换编码。尽管这些方法在感知质量上表现优异,但对重型编码网络的依赖使其难以在弱发送端设备上部署。本文探索了使用浅层编码器实现超低比特率压缩的可行性,提出一种新型非对称极端图像压缩(AEIC)框架,同时追求编码简单性与解码高质量。具体而言,AEIC采用中等甚至浅层编码器,并借助一步扩散解码器,在极端比特率下仍可实现高保真、高真实感的重构。为提升浅层编码器效率,设计了一种双向特征蒸馏方案,将中等编码器的知识迁移至浅层变体。实验表明,AEIC不仅在超低比特率下优于现有方法的率-失真-感知性能,且在1080P图像上实现35.8帧/秒的编码速度,同时保持与现有方法相当的解码速度。代码已开源:https://github.com/LuizScarlet/AEIC。

原文摘要 · Abstract (English)

Ultra-low bitrate image compression (below 0.05 bits per pixel) is increasingly critical for bandwidth-constrained and computation-limited encoding scenarios such as edge devices. Existing frameworks typically rely on large pretrained encoders (e.g., VAEs or tokenizer-based models) and perform transform coding within their generative latent space. While these approaches achieve impressive perceptual fidelity, their reliance on heavy encoder networks makes them unsuitable for deployment on weak sender devices. In this work, we explore the feasibility of applying shallow encoders for ultra-low bitrate compression and propose a novel Asymmetric Extreme Image Compression (AEIC) framework that pursues simultaneously encoding simplicity and decoding quality. Specifically, AEIC employs moderate or even shallow encoder networks, while leveraging an one-step diffusion decoder to maintain high-fidelity and high-realism reconstructions under extreme bitrates. To further enhance the efficiency of shallow encoders, we design a dual-side feature distillation scheme that transfers knowledge from AEIC with moderate encoders to its shallow encoder variants. Experiments show that AEIC not only outperforms existing methods on rate-distortion-perception performance at ultra-low bitrates, but also delivers exceptional encoding efficiency for 35.8 FPS on 1080P images, while maintaining competitive decoding speed compared to existing methods. Code is available at https://github.com/LuizScarlet/AEIC.

图像压缩浅层网络扩散模型边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。