用语义与视觉先验协同修复图像,解决模糊、噪声等多重退化问题。
DPC-Net: Dual-Prior Collaborative Network for All-in-One Image Restoration

- 融合退化语义耦合特征与低层视觉先验,提升修复一致性。
- 在多个基准上优于当前最优方法,结构与语义更保真。
- 适合需要统一处理多种图像退化的实际应用。
全功能图像修复(AiOIR)旨在统一模型处理多种退化问题。现有方法常忽略退化建模中的图像语义,并在重建中缺乏低层视觉先验,导致结构失真和语义不一致。为此,本文提出双先验协同网络(DPC-Net),通过联合利用退化-语义耦合先验与低层视觉先验,实现高质量修复。具体地,退化感知网络(DAN)接收退化图像,提取退化-语义耦合特征;通过视觉-语言模型(VLM)约束其特征分布,将图像语义引入退化模式编码。退化-语义调制模块(DSMM)进一步生成耦合表示并传递至解码器。解码阶段,知识库提供低层视觉先验,双先验协同重建模块(DPCR)整合双重信息,指导去退化同时保留结构与语义,生成高保真图像。大量实验表明,DPC-Net 在多个修复基准上均超越现有最优方法。
原文摘要 · Abstract (English)
All-in-One Image Restoration (AiOIR) aims to handle diverse degradations within a unified model. However, existing methods often overlook image semantics in degradation modeling and lack low-level visual priors during reconstruction, leading to structural distortions and semantic inconsistencies. To address these issues, we propose a novel Dual-Prior Collaborative Network (DPC-Net), which achieves high-quality restoration by jointly exploiting degradation-semantic coupled priors and low-level visual priors. Specifically, degraded images are fed into a Degradation-Aware Network (DAN) to extract degradation-semantic coupled features. To this end, a Vision-Language Model (VLM) supervises DAN by constraining its features distribution, introducing image semantics into the encoding of degradation patterns. A Degradation-Semantic Modulation Module (DSMM) further translates this guidance into degradation-semantic coupling and propagates coupled representations to the decoder. During decoding, knowledge bases provide low-level visual priors, and the Dual-Prior Collaborative Reconstruction Module (DPCR) integrates dual-prior information to guide degradation removal while preserving structure and semantics, producing high-fidelity restored images. Extensive experiments on multiple restoration benchmarks demonstrate that DPC-Net achieves superior performance against state-of-the-art AiOIR methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。