arXiv:2412.08210cs.CVeess.IV2024-12被引 5

用一个数字就能还原图像,实现高效统一的神经图像压缩。

Unicorn: Unified Neural Image Compression with One Number Reconstruction

  • 将图像抽象为索引-噪声对,通过统一神经解码器重建。
  • 相比传统方法,压缩率显著提升,且支持海量图像扩展增益。
  • 适合追求极低码率与可扩展性的图像压缩应用。

现有有损图像压缩方法可分为显式图像压缩(EIC)和基于隐式神经表示(INR)的隐式图像压缩(IIC)。前者在降低码率时面临复杂度剧增的瓶颈,后者则存在过度平滑和解码模型过长的问题。本文提出一种新范式——Unicorn(统一神经图像压缩,仅用一个数字重建),将图像视为索引-图像对,通过精巧设计的神经网络学习其内在分布,仅需一个随机噪声和一个索引数即可重建出视觉上令人满意的图像。该神经模型作为统一解码器,噪声与索引构成显式表示。作为概念验证,我们基于潜在扩散模型设计了高效原型,实验表明其在定量与定性结果上均显著优于EIC与IIC方法。更令人振奋的是,得益于统一解码器,压缩比随图像数量增加而提升。我们将在https://github.com/uniqzheng/Unicorn-Laduree发布代码。

原文摘要 · Abstract (English)

Prevalent lossy image compression schemes can be divided into: 1) explicit image compression (EIC), including traditional standards and neural end-to-end algorithms; 2) implicit image compression (IIC) based on implicit neural representations (INR). The former is encountering impasses of either leveling off bitrate reduction at a cost of tremendous complexity while the latter suffers from excessive smoothing quality as well as lengthy decoder models. In this paper, we propose an innovative paradigm, which we dub \textbf{Unicorn} (\textbf{U}nified \textbf{N}eural \textbf{I}mage \textbf{C}ompression with \textbf{O}ne \textbf{N}number \textbf{R}econstruction). By conceptualizing the images as index-image pairs and learning the inherent distribution of pairs in a subtle neural network model, Unicorn can reconstruct a visually pleasing image from a randomly generated noise with only one index number. The neural model serves as the unified decoder of images while the noises and indexes corresponds to explicit representations. As a proof of concept, we propose an effective and efficient prototype of Unicorn based on latent diffusion models with tailored model designs. Quantitive and qualitative experimental results demonstrate that our prototype achieves significant bitrates reduction compared with EIC and IIC algorithms. More impressively, benefitting from the unified decoder, our compression ratio escalates as the quantity of images increases. We envision that more advanced model designs will endow Unicorn with greater potential in image compression. We will release our codes in \url{https://github.com/uniqzheng/Unicorn-Laduree}.

图像压缩扩散模型统一编码低码率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。