arXiv:2510.00728cs.CVcs.AI2025-10

通过信息瓶颈理论分步修复极端模糊图像,提升恢复质量。

Extreme Blind Image Restoration via Prompt-Conditioned Information Bottleneck

  • 将极端低质图像先映射到中间低质空间,再用现成模型恢复。
  • 在严重退化下保持细节,避免伪影,效果优于直接端到端方法。
  • 无需微调即可增强现有修复模型,适合快速部署和提示调整。

盲图像恢复(BIR)方法虽取得显著进展,但在极端盲图像恢复(EBIR)场景下表现不佳,因输入退化严重且复合,超出训练范围。直接学习从极低质量(ELQ)到高质量(HQ)的映射面临巨大域差距,常导致不自然伪影与细节丢失。为此,我们提出新框架,将不可行的ELQ到HQ恢复过程分解:首先训练一个投影器,将ELQ图像映射至中间、降级程度较低的低质(LQ)流形;随后利用冻结的现成BIR模型对中间图像进行恢复。该方法基于信息论,将图像恢复视为信息瓶颈问题,推导出理论驱动的目标函数,其损失函数通过平衡低质重建项与高质量先验匹配项,有效稳定训练。框架支持推理时一次前向(LFO)提示精炼,并可无须微调地即插即用强化现有恢复模型。在严重退化条件下的大量实验充分验证了方法的有效性。

原文摘要 · Abstract (English)

Blind Image Restoration (BIR) methods have achieved remarkable success but falter when faced with Extreme Blind Image Restoration (EBIR), where inputs suffer from severe, compounded degradations beyond their training scope. Directly learning a mapping from extremely low-quality (ELQ) to high-quality (HQ) images is challenging due to the massive domain gap, often leading to unnatural artifacts and loss of detail. To address this, we propose a novel framework that decomposes the intractable ELQ-to-HQ restoration process. We first learn a projector that maps an ELQ image onto an intermediate, less-degraded LQ manifold. This intermediate image is then restored to HQ using a frozen, off-the-shelf BIR model. Our approach is grounded in information theory; we provide a novel perspective of image restoration as an Information Bottleneck problem and derive a theoretically-driven objective to train our projector. This loss function effectively stabilizes training by balancing a low-quality reconstruction term with a high-quality prior-matching term. Our framework enables Look Forward Once (LFO) for inference-time prompt refinement, and supports plug-and-play strengthening of existing image restoration models without need for finetuning. Extensive experiments under severe degradation regimes provide a thorough analysis of the effectiveness of our work.

图像恢复信息瓶颈极端退化零样本增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。