arXiv:2511.05873eess.IVcs.AI2025-11AAAI被引 2

一个模型搞定内窥镜图像多种退化问题,无需提前知道具体退化类型。

EndoIR: Degradation-Agnostic All-in-One Endoscopic Image Restoration via Noise-Aware Routing Diffusion

  • 用双域提示器提取空间频域联合特征,自适应编码共性与任务特异性信息。
  • 在多个数据集上达到顶尖效果,参数量比强基线更少,且能提升下游分割性能。
  • 适合临床场景,动态路由噪声相关特征,提升修复效率与鲁棒性。

内窥镜图像常因光照不足、烟雾和出血等多重共现退化而模糊关键临床细节。现有方法多为特定任务设计,通常需提前知晓退化类型,限制了真实临床应用的鲁棒性。本文提出 EndoIR,一种基于扩散模型的全功能、退化无关框架,仅用单一模型即可恢复多种退化类型。EndoIR 引入双域提示器(Dual-Domain Prompter)提取联合空间-频率特征,并设计自适应嵌入编码共享与任务特异性线索作为去噪条件。为避免传统拼接式条件导致的特征混淆,提出双流扩散架构(Dual-Stream Diffusion),分别处理干净与退化输入,通过修正融合块以退化感知方式结构化整合信息。此外,噪声感知路由模块(Noise-Aware Routing Block)在去噪过程中动态选择仅与噪声相关的特征,提升效率。在 SegSTRONG-C 与 CEC 数据集上的实验表明,EndoIR 在多种退化场景下均达当前最优性能,且参数量低于强基线;下游分割实验进一步验证其临床实用性。

原文摘要 · Abstract (English)

Endoscopic images often suffer from diverse and co-occurring degradations such as low lighting, smoke, and bleeding, which obscure critical clinical details. Existing restoration methods are typically task-specific and often require prior knowledge of the degradation type, limiting their robustness in real-world clinical use. We propose EndoIR, an all-in-one, degradation-agnostic diffusion-based framework that restores multiple degradation types using a single model. EndoIR introduces a Dual-Domain Prompter that extracts joint spatial-frequency features, coupled with an adaptive embedding that encodes both shared and task-specific cues as conditioning for denoising. To mitigate feature confusion in conventional concatenation-based conditioning, we design a Dual-Stream Diffusion architecture that processes clean and degraded inputs separately, with a Rectified Fusion Block integrating them in a structured, degradation-aware manner. Furthermore, Noise-Aware Routing Block improves efficiency by dynamically selecting only noise-relevant features during denoising. Experiments on SegSTRONG-C and CEC datasets demonstrate that EndoIR achieves state-of-the-art performance across multiple degradation scenarios while using fewer parameters than strong baselines, and downstream segmentation experiments confirm its clinical utility.

图像修复扩散模型内窥镜多退化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。