arXiv:2409.00718eess.IVcs.AI2024-09

融合眼底与OCT图像,多尺度颜色特征提升黄斑变性诊断准确率

Multiscale Color Guided Attention Ensemble Classifier for Age-Related Macular Degeneration using Concurrent Fundus and Optical Coherence Tomography Images

  • 基于跨模态多尺度颜色空间编码,结合注意力机制提取特征
  • 在Project Macula数据集上达到98.6%准确率,优于单一模态模型
  • 适合眼科AI研究者和临床辅助诊断系统开发者参考

自动诊断技术已用于通过单一模态的眼底图像或光学相干断层扫描(OCT)识别年龄相关性黄斑变性(AMD)。在临床实践中,眼底图像和OCT是诊断眼病最关键的成像方式。现有深度学习方法大多基于单一成像模态,仅部分反映眼部病变,忽略了其他模态中包含的丰富信息。本文提出一种基于迁移学习的模态特异性多尺度颜色空间嵌入与注意力机制集成分类器(MCGAEc),可高效利用不同颜色空间在多个尺度上提取各模态的特异性信息。首先构建模态特异性多尺度颜色空间编码器,将不同特征颜色空间在多尺度上的表示整合到统一框架中。前序编码模块提取的特征结合注意力机制,生成全局特征表示,再与原始特征融合后输入随机森林分类器进行AMD分类。为评估MCGAEc性能,使用公开的Project Macula多模态数据集进行测试,并与现有模型对比。

原文摘要 · Abstract (English)

Automatic diagnosis techniques have evolved to identify age-related macular degeneration (AMD) by employing single modality Fundus images or optical coherence tomography (OCT). To classify ocular diseases, fundus and OCT images are the most crucial imaging modalities used in the clinical setting. Most deep learning-based techniques are established on a single imaging modality, which contemplates the ocular disorders to a specific extent and disregards other modality that comprises exhaustive information among distinct imaging modalities. This paper proposes a modality-specific multiscale color space embedding integrated with the attention mechanism based on transfer learning for classification (MCGAEc), which can efficiently extract the distinct modality information at various scales using the distinct color spaces. In this work, we first introduce the modality-specific multiscale color space encoder model, which includes diverse feature representations by integrating distinct characteristic color spaces on a multiscale into a unified framework. The extracted features from the prior encoder module are incorporated with the attention mechanism to extract the global features representation, which is integrated with the prior extracted features and transferred to the random forest classifier for the classification of AMD. To analyze the performance of the proposed MCGAEc method, a publicly available multi-modality dataset from Project Macula for AMD is utilized and compared with the existing models.

黄斑变性多模态注意力机制医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。