跨设备多模态眼底图像分割新方法,提升模型泛化能力
GrInAdapt: Scaling Retinal Vessel Structural Map Segmentation Through Grounding, Integrating and Adapting Multi-device, Multi-site, and Multi-modal Fundus Domains
- 通过图像配准、多视角融合与无源域适应三步策略提升分割精度
- 在多设备多站点数据上实现更高准确率与鲁棒性,优于现有方法
- 适用于眼科临床辅助诊断,尤其适合异构数据环境下的应用
视网膜血管分割对眼部疾病诊断至关重要,但当前深度学习方法受限于模态特异性挑战及成像设备、分辨率和解剖区域间的显著分布偏移。本文提出GrInAdapt,一种无需源域信息的多目标域适应框架,利用多视角眼底光学相干断层扫描(OCTA)图像精炼分割标签,增强模型在多种目标域上的泛化能力。该方法遵循三步策略:(i) 通过配准将图像映射至统一锚点空间;(ii) 融合多视角预测以获得更优标签共识;(iii) 将源模型适配至多样目标域。此外,GrInAdapt可灵活引入彩色眼底照相等辅助模态,提供互补线索以增强分割鲁棒性。在多设备、多站点、多模态视网膜数据集上的大量实验表明,GrInAdapt显著优于现有域适应方法,在多个域上均实现更高的分割准确率与鲁棒性,展现出推动自动化视网膜血管分析和支撑临床决策的潜力。
原文摘要 · Abstract (English)
Retinal vessel segmentation is critical for diagnosing ocular conditions, yet current deep learning methods are limited by modality-specific challenges and significant distribution shifts across imaging devices, resolutions, and anatomical regions. In this paper, we propose GrInAdapt, a novel framework for source-free multi-target domain adaptation that leverages multi-view images to refine segmentation labels and enhance model generalizability for optical coherence tomography angiography (OCTA) of the fundus of the eye. GrInAdapt follows an intuitive three-step approach: (i) grounding images to a common anchor space via registration, (ii) integrating predictions from multiple views to achieve improved label consensus, and (iii) adapting the source model to diverse target domains. Furthermore, GrInAdapt is flexible enough to incorporate auxiliary modalities such as color fundus photography, to provide complementary cues for robust vessel segmentation. Extensive experiments on a multi-device, multi-site, and multi-modal retinal dataset demonstrate that GrInAdapt significantly outperforms existing domain adaptation methods, achieving higher segmentation accuracy and robustness across multiple domains. These results highlight the potential of GrInAdapt to advance automated retinal vessel analysis and support robust clinical decision-making.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。