arXiv:2410.12191cs.CVcs.MM2024-10ICLR被引 5

提升图像压缩跨域性能,通过分布正则化优化隐变量重构

Test-time adaptation for image compression with distribution regularization

  • 引入分布正则化修复跨域场景下隐变量与先验分布的不匹配
  • 在6个数据集上实现更优率失真性能,且压缩成本未增加
  • 可无缝集成到现有测试时压缩适应方法中,适合作为通用增强模块

当前测试时图像压缩(TTA-IC)方法通过隐变量与解码器的两阶段自适应,显著提升了学习型图像压缩模型在跨域任务(如自然图像到屏幕内容)上的率失真(R-D)性能。然而,尽管解码器重构方法不断演进,隐变量重构仍缺乏针对跨域场景的优化。本文针对原有的混合隐变量重构(HLR)方法在跨域任务中出现率开销上升的问题,从边缘化近似角度进行理论分析,揭示其根源在于重构后的高斯条件分布与超先验分布之间存在潜在不匹配,导致联合概率逼近失效、率成本增加。为此,提出一种简单而有效的贝叶斯近似驱动的分布正则化机制,以端到端方式增强联合分布建模能力。在六个跨域与同域数据集上的大量实验表明,该方法不仅优于其他隐变量重构方案,还能灵活融入现有TTA-IC框架,带来增量收益。

原文摘要 · Abstract (English)

Current test- or compression-time adaptation image compression (TTA-IC) approaches, which leverage both latent and decoder refinements as a two-step adaptation scheme, have potentially enhanced the rate-distortion (R-D) performance of learned image compression models on cross-domain compression tasks, \textit{e.g.,} from natural to screen content images. However, compared with the emergence of various decoder refinement variants, the latent refinement, as an inseparable ingredient, is barely tailored to cross-domain scenarios. To this end, we aim to develop an advanced latent refinement method by extending the effective hybrid latent refinement (HLR) method, which is designed for \textit{in-domain} inference improvement but shows noticeable degradation of the rate cost in \textit{cross-domain} tasks. Specifically, we first provide theoretical analyses, in a cue of marginalization approximation from in- to cross-domain scenarios, to uncover that the vanilla HLR suffers from an underlying mismatch between refined Gaussian conditional and hyperprior distributions, leading to deteriorated joint probability approximation of marginal distribution with increased rate consumption. To remedy this issue, we introduce a simple Bayesian approximation-endowed \textit{distribution regularization} to encourage learning a better joint probability approximation in a plug-and-play manner. Extensive experiments on six in- and cross-domain datasets demonstrate that our proposed method not only improves the R-D performance compared with other latent refinement counterparts, but also can be flexibly integrated into existing TTA-IC methods with incremental benefits.

图像压缩测试时适应分布正则化隐变量优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。