提出一种自适应图像修复方法,能统一处理多种退化类型。
Degradation-Aware Residual-Conditioned Optimal Transport for Unified Image Restoration
- 将图像修复建模为最优传输问题,用残差特征作为退化线索。
- 在五种退化场景下性能超越现有方法,尤其在多退化时更鲁棒。
- 适合需要统一处理复杂真实退化的实际应用开发者。
全功能图像修复已成为实际低层视觉任务的可行且有前景方向。核心挑战在于如何同时处理多种退化图像。本文提出一种退化感知残差条件最优传输(DA-RCOT)方法,将(全功能)图像修复建模为无配对和配对设置下的最优传输(OT)问题,引入传输残差作为退化特异性线索,用于传输成本与传输映射。具体地,通过利用傅里叶残差中退化特异性模式,构建残差引导的OT目标函数。更重要的是,设计了双通路的DA-RCOT映射:第一阶段计算传输残差,并将其编码为多尺度残差嵌入;第二阶段以这些嵌入条件化恢复过程。该条件机制将内在退化知识(如退化类型与程度)及结构信息注入到OT映射中,使其能够动态调整行为,实现全功能修复。在五种退化类型上的大量实验表明,相比现有最佳方法,DA-RCOT在失真度量、感知质量与图像结构保持方面表现更优。特别地,即使在多重退化情况下,该方法仍展现出卓越的适应性与对退化程度及退化数量的强鲁棒性。
原文摘要 · Abstract (English)
All-in-one image restoration has emerged as a practical and promising low-level vision task for real-world applications. In this context, the key issue lies in how to deal with different types of degraded images simultaneously. In this work, we present a Degradation-Aware Residual-Conditioned Optimal Transport (DA-RCOT) approach that models (all-in-one) image restoration as an optimal transport (OT) problem for unpaired and paired settings, introducing the transport residual as a degradation-specific cue for both the transport cost and the transport map. Specifically, we formalize image restoration with a residual-guided OT objective by exploiting the degradation-specific patterns of the Fourier residual in the transport cost. More crucially, we design the transport map for restoration as a two-pass DA-RCOT map, in which the transport residual is computed in the first pass and then encoded as multi-scale residual embeddings to condition the second-pass restoration. This conditioning process injects intrinsic degradation knowledge (e.g., degradation type and level) and structural information from the multi-scale residual embeddings into the OT map, which thereby can dynamically adjust its behaviors for all-in-one restoration. Extensive experiments across five degradations demonstrate the favorable performance of DA-RCOT as compared to state-of-the-art methods, in terms of distortion measures, perceptual quality, and image structure preservation. Notably, DA-RCOT delivers superior adaptability to real-world scenarios even with multiple degradations and shows distinctive robustness to both degradation levels and the number of degradations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。