用最优传输理论提升眼底图像质量,更好保留血管细节。
CUNSB-RFIE: Context-aware Unpaired Neural Schrödinger Bridge in Retinal Fundus Image Enhancement
- 基于随机微分方程的薛定谔桥框架,实现无配对图像增强。
- 在大规模数据集上优于现有监督与非监督方法,结构保真度更高。
- 引入动态蛇形卷积,有效增强血管等细长结构的重建能力。
眼底照相在视网膜疾病诊断与监测中具有重要意义。然而,系统性缺陷及操作者/患者相关因素常导致低质量图像。以往工作多依赖GAN,受限于训练稳定性与输出多样性之间的权衡。相比之下,薛定谔桥(Schrödinger Bridge, SB)利用最优传输(OT)理论建模两个分布间的随机微分方程(SDE),提供更稳定的图像转换机制。本文提出基于SB框架的眼底图像增强图像到图像翻译管道,并引入动态蛇形卷积(Dynamic Snake Convolution),其曲折感受野可更好地保留管状结构(如血管)。所提方法命名为上下文感知无配对神经薛定谔桥(CUNSB-RFIE)。据我们所知,这是首个将SB应用于眼底图像增强的工作。在大规模数据集上的实验表明,该方法在图像质量及下游任务性能上均优于多个先进监督与非监督方法。代码已开源。
原文摘要 · Abstract (English)
Retinal fundus photography is significant in diagnosing and monitoring retinal diseases. However, systemic imperfections and operator/patient-related factors can hinder the acquisition of high-quality retinal images. Previous efforts in retinal image enhancement primarily relied on GANs, which are limited by the trade-off between training stability and output diversity. In contrast, the Schrödinger Bridge (SB), offers a more stable solution by utilizing Optimal Transport (OT) theory to model a stochastic differential equation (SDE) between two arbitrary distributions. This allows SB to effectively transform low-quality retinal images into their high-quality counterparts. In this work, we leverage the SB framework to propose an image-to-image translation pipeline for retinal image enhancement. Additionally, previous methods often fail to capture fine structural details, such as blood vessels. To address this, we enhance our pipeline by introducing Dynamic Snake Convolution, whose tortuous receptive field can better preserve tubular structures. We name the resulting retinal fundus image enhancement framework the Context-aware Unpaired Neural Schrödinger Bridge (CUNSB-RFIE). To the best of our knowledge, this is the first endeavor to use the SB approach for retinal image enhancement. Experimental results on a large-scale dataset demonstrate the advantage of the proposed method compared to several state-of-the-art supervised and unsupervised methods in terms of image quality and performance on downstream tasks.The code is available at https://github.com/Retinal-Research/CUNSB-RFIE .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。