arXiv:2409.07862eess.IVcs.CV2024-09被引 19

用上下文感知的最优传输方法提升眼底图像质量,减少伪影并保留细节。

Context-Aware Optimal Transport Learning for Retinal Fundus Image Enhancement

  • 基于地球移动距离构建上下文感知的最优传输框架
  • 在大规模数据集上显著提升信噪比与结构相似性
  • 适合医学图像增强及眼科自动化诊断研究者

眼底照相为多种视网膜疾病的无创诊断与监测提供了途径,但易受系统缺陷或操作/患者因素影响而出现固有质量问题。高质量眼底图像对准确诊断和自动化分析至关重要。图像增强通常被建模为分布对齐问题,通过寻找低质图像与其高质对应图像之间的一一映射来实现。本文提出一种上下文感知的最优传输(OT)学习框架,用于处理未配对的眼底图像增强任务。与传统生成式增强方法相比,该方法能更好地保留局部结构并减少不必要伪影。通过利用深层上下文特征,基于地球移动距离推导出上下文感知的最优传输,并证明其具有坚实的理论保障。在大规模数据集上的实验表明,所提方法在信噪比(SNR)、结构相似性指数(SSIM)以及两个下游任务中均优于多个前沿的监督与非监督方法。代码已公开于 https://github.com/Retinal-Research/Contextual-OT。

原文摘要 · Abstract (English)

Retinal fundus photography offers a non-invasive way to diagnose and monitor a variety of retinal diseases, but is prone to inherent quality glitches arising from systemic imperfections or operator/patient-related factors. However, high-quality retinal images are crucial for carrying out accurate diagnoses and automated analyses. The fundus image enhancement is typically formulated as a distribution alignment problem, by finding a one-to-one mapping between a low-quality image and its high-quality counterpart. This paper proposes a context-informed optimal transport (OT) learning framework for tackling unpaired fundus image enhancement. In contrast to standard generative image enhancement methods, which struggle with handling contextual information (e.g., over-tampered local structures and unwanted artifacts), the proposed context-aware OT learning paradigm better preserves local structures and minimizes unwanted artifacts. Leveraging deep contextual features, we derive the proposed context-aware OT using the earth mover's distance and show that the proposed context-OT has a solid theoretical guarantee. Experimental results on a large-scale dataset demonstrate the superiority of the proposed method over several state-of-the-art supervised and unsupervised methods in terms of signal-to-noise ratio, structural similarity index, as well as two downstream tasks. The code is available at \url{https://github.com/Retinal-Research/Contextual-OT}.

图像增强医学影像最优传输

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。