用超网络加速过拟合图像编码,压缩率更高且成本更低。
HyperCool: Reducing Encoding Cost in Overfitted Codecs with Hypernetworks
- 通过超网络在单次前向传播中生成适配图像的解码器参数
- 相比非过拟合版本压缩率提升4.9%,编码成本仅为全过拟合模型的60.4%
- 适合计算资源有限但需高压缩率的实时图像编码场景
过拟合图像编码器如Cool-chic通过为每张图像定制轻量模型实现强压缩,但编码过程缓慢且计算开销大。为加速编码,非过拟合(N-O)Cool-chic改用学习的推理模型替代逐图像优化,以牺牲压缩性能换取速度。本文提出HyperCool,一种基于超网络的架构,在N-O Cool-chic框架上实现单次前向传播生成内容自适应的解码器参数,无需逐图像微调即可适配输入图像。该方法在仅增加极小计算开销下,相较N-O Cool-chic实现4.9%的码率降低。此外,超网络输出可作为后续优化的良好初始化,显著减少达到全过拟合模型性能所需的迭代步数。经微调后,可在仅60.4%于全过拟合Cool-chic的编码成本下达成HEVC级压缩效果。本工作为过拟合编码器提供了实用的编码加速方案,提升了其在严苛算力预算场景下的可行性。
原文摘要 · Abstract (English)
Overfitted image codecs like Cool-chic achieve strong compression by tailoring lightweight models to individual images, but their encoding is slow and computationally expensive. To accelerate encoding, Non-Overfitted (N-O) Cool-chic replaces the per-image optimization with a learned inference model, trading compression performance for encoding speed. We introduce HyperCool, a hypernetwork architecture that mitigates this trade-off. Building upon the N-O Cool-chic framework, HyperCool generates content-adaptive parameters for a Cool-chic decoder in a single forward pass, tailoring the decoder to the input image without requiring per-image fine-tuning. Our method achieves a 4.9% rate reduction over N-O Cool-chic with minimal computational overhead. Furthermore, the output of our hypernetwork provides a strong initialization for further optimization, reducing the number of steps needed to approach fully overfitted model performance. With fine-tuning, HEVC-level compression is achieved with 60.4% of the encoding cost of the fully overfitted Cool-chic. This work proposes a practical method to accelerate encoding in overfitted image codecs, improving their viability in scenarios with tight compute budgets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。