arXiv:2502.19068cs.CV2025-02被引 1

一个网络搞定多种图像退化,动态分解更精准。

Dynamic Degradation Decomposition Network for All-in-One Image Restoration

  • 通过跨域分析识别退化类型,生成引导修复的提示
  • 在SOTS-Outdoor和GoPro上分别提升5.47dB和3.30dB的PSNR
  • 适合需要统一处理复杂退化的实际图像修复场景

当前使用单一模型恢复多种退化类型的图像仍具挑战性,现有全功能修复方法难以应对复杂且定义模糊的退化类型。本文提出一种面向全功能图像修复的动态退化分解网络D³Net,通过跨域交互与动态退化分解实现退化自适应修复。具体而言,提出的跨域退化分析器(CDDA)在频域退化特征与空域图像特征间深度交互,识别并建模图像流形上不同退化类型的差异,生成退化修正提示与策略提示,引导后续分解过程。此外,基于提示的动态分解机制(DDM)实现分步退化分解,促使网络自适应选择修复策略,利用CDDA生成的双级提示。得益于CDDA与DDM的协同作用,D³Net在处理未知退化时表现出更强灵活性与可扩展性,同时有效降低冗余计算开销。大量实验表明,D³Net显著优于现有最优方法,在SOTS-Outdoor和GoPro数据集上分别提升PSNR 5.47dB和3.30dB。

原文摘要 · Abstract (English)

Currently, restoring clean images from a variety of degradation types using a single model is still a challenging task. Existing all-in-one image restoration approaches struggle with addressing complex and ambiguously defined degradation types. In this paper, we introduce a dynamic degradation decomposition network for all-in-one image restoration, named D$^3$Net. D$^3$Net achieves degradation-adaptive image restoration with guided prompt through cross-domain interaction and dynamic degradation decomposition. Concretely, in D$^3$Net, the proposed Cross-Domain Degradation Analyzer (CDDA) engages in deep interaction between frequency domain degradation characteristics and spatial domain image features to identify and model variations of different degradation types on the image manifold, generating degradation correction prompt and strategy prompt, which guide the following decomposition process. Furthermore, the prompt-based Dynamic Decomposition Mechanism (DDM) for progressive degradation decomposition, that encourages the network to adaptively select restoration strategies utilizing the two-level prompt generated by CDDA. Thanks to the synergistic cooperation between CDDA and DDM, D$^3$Net achieves superior flexibility and scalability in handling unknown degradation, while effectively reducing unnecessary computational overhead. Extensive experiments on multiple image restoration tasks demonstrate that D$^3$Net significantly outperforms the state-of-the-art approaches, especially improving PSNR by 5.47dB and 3.30dB on the SOTS-Outdoor and GoPro datasets, respectively.

图像修复动态分解退化建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。