用单个网络压缩多张图像,实现低比特率下的高保真重建。
Breaking the Barriers of One-to-One Usage of Implicit Neural Representation in Image Compression: A Linear Combination Approach with Performance Guarantees
- 通过线性组合权重,让一个小型网络同时表示多张图像。
- 在Kodak数据集上以0.2比特/像素实现26.5dB的峰值信噪比。
- 适用于需要高分辨率重建和高效存储的图像压缩场景。
在物联网驱动的图像数据爆炸式增长背景下,本文探索并推进了隐式神经表示(INR)在图像压缩中的潜力。传统方法利用小规模神经网络重建大图像,而本文提出新方法:用单个网络表示多张图像。通过调整训练损失函数,使少量权重可表征大量差异较大的图像。本文还对新训练方法的收敛性进行分析,建立了上界,不仅验证方法有效性,还为超参数设计提供指导。在Kodak、ImageNet和CIFAR-10数据集上的实验表明,24张Kodak图像可由两组权重的线性组合表示,仅需0.2比特/像素即可达到26.5 dB的峰值信噪比;在CIFAR-10上性能媲美当前最优编码器如BPG。该方法保持了INR任意分辨率重建的核心优势。
原文摘要 · Abstract (English)
In an era where the exponential growth of image data driven by the Internet of Things (IoT) is outpacing traditional storage solutions, this work explores and advances the potential of Implicit Neural Representation (INR) as a transformative approach to image compression. INR leverages the function approximation capabilities of neural networks to represent various types of data. While previous research has employed INR to achieve compression by training small networks to reconstruct large images, this work proposes a novel advancement: representing multiple images with a single network. By modifying the loss function during training, the proposed approach allows a small number of weights to represent a large number of images, even those significantly different from each other. A thorough analytical study of the convergence of this new training method is also carried out, establishing upper bounds that not only confirm the validity of the method but also offer insights into optimal hyperparameter design. The proposed method is evaluated on the Kodak, ImageNet, and CIFAR-10 datasets. Experimental results demonstrate that all 24 images in the Kodak dataset can be represented by linear combinations of two sets of weights, achieving a peak signal-to-noise ratio (PSNR) of 26.5 dB with as low as 0.2 bits per pixel (BPP). The proposed method matches the rate-distortion performance of state-of-the-art image codecs, such as BPG, on the CIFAR-10 dataset. Additionally, the proposed method maintains the fundamental properties of INR, such as arbitrary resolution reconstruction of images.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。