通过解耦退化成分实现多退化图像修复,自适应选择最优恢复路径。
Learning to Restore Multi-Degraded Images via Ingredient Decoupling and Task-Aware Path Adaptation
- 解耦退化成分:融合空域与频域信息分离雨、噪、雾等多重退化特征
- 动态路径选择:根据退化类型自动激活最优修复分支,提升泛化能力
- 适合真实场景:在多退化图像上表现优异,兼顾单退化任务性能
图像修复旨在从退化观测中恢复清晰图像。尽管进展显著,现有方法大多聚焦单一退化类型,而真实图像常同时存在多种退化(如雨、噪声、雾霾共存),限制了实际应用效果。本文提出一种自适应多退化图像修复网络IMDNet,通过解耦退化成分引导路径选择。设计退化成分解耦模块(DIDBlock)在编码器中融合空域与频域信息,统计分离多种退化成分,增强多退化类型识别并使特征独立。引入融合模块(FBlock)使用可学习矩阵整合各层级退化信息。在解码器中加入任务适配模块(TABlock),根据多退化表示动态激活或融合功能分支,灵活选择最优修复路径。实验表明,IMDNet在多退化修复任务中表现卓越,同时保持对单退化任务的强竞争力。
原文摘要 · Abstract (English)
Image restoration (IR) aims to recover clean images from degraded observations. Despite remarkable progress, most existing methods focus on a single degradation type, whereas real-world images often suffer from multiple coexisting degradations, such as rain, noise, and haze coexisting in a single image, which limits their practical effectiveness. In this paper, we propose an adaptive multi-degradation image restoration network that reconstructs images by leveraging decoupled representations of degradation ingredients to guide path selection. Specifically, we design a degradation ingredient decoupling block (DIDBlock) in the encoder to separate degradation ingredients statistically by integrating spatial and frequency domain information, enhancing the recognition of multiple degradation types and making their feature representations independent. In addition, we present fusion block (FBlock) to integrate degradation information across all levels using learnable matrices. In the decoder, we further introduce a task adaptation block (TABlock) that dynamically activates or fuses functional branches based on the multi-degradation representation, flexibly selecting optimal restoration paths under diverse degradation conditions. The resulting tightly integrated architecture, termed IMDNet, is extensively validated through experiments, showing superior performance on multi-degradation restoration while maintaining strong competitiveness on single-degradation tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。