arXiv:2504.09354cs.CVcs.AI2025-04被引 1

用可解释的检索机制,让AI在少量数据下也能像医生一样诊断阿尔茨海默病。

REMEMBER: Retrieval-based Explainable Multimodal Evidence-guided Modeling for Brain Evaluation and Reasoning in Zero- and Few-shot Neurodegenerative Diagnosis

  • 基于参考案例检索,结合影像与文本证据进行推理
  • 零样本和少样本场景下诊断准确率显著优于传统模型
  • 输出结果附带可读报告,适合临床医生信任使用

阿尔茨海默病等神经退行性疾病的及时准确诊断对疾病管理至关重要。现有深度学习模型依赖大规模标注数据,且常为黑箱,而临床数据往往规模小或无标签,限制了模型应用。本文提出REMEMBER——一种基于检索的可解释多模态证据引导建模框架,通过参考案例驱动的推理过程,实现基于脑部MRI的零样本和少样本阿尔茨海默病诊断。该框架首先利用专家标注的参考数据训练对比对齐的视觉-文本模型,并扩展伪文本模态以编码异常类型、诊断标签及综合临床描述。推理时,REMEMBER从精选数据集中检索相似且经验证的病例,通过专用证据编码模块和注意力推理头整合上下文信息。这种证据引导设计使模型预测可追溯至检索到的影像与文本,模仿真实临床决策流程。实验表明,REMEMBER在零样本和少样本条件下均表现稳健,为真实世界中神经影像诊断提供了强大且可解释的解决方案,尤其适用于数据稀缺场景。

原文摘要 · Abstract (English)

Timely and accurate diagnosis of neurodegenerative disorders, such as Alzheimer's disease, is central to disease management. Existing deep learning models require large-scale annotated datasets and often function as "black boxes". Additionally, datasets in clinical practice are frequently small or unlabeled, restricting the full potential of deep learning methods. Here, we introduce REMEMBER -- Retrieval-based Explainable Multimodal Evidence-guided Modeling for Brain Evaluation and Reasoning -- a new machine learning framework that facilitates zero- and few-shot Alzheimer's diagnosis using brain MRI scans through a reference-based reasoning process. Specifically, REMEMBER first trains a contrastively aligned vision-text model using expert-annotated reference data and extends pseudo-text modalities that encode abnormality types, diagnosis labels, and composite clinical descriptions. Then, at inference time, REMEMBER retrieves similar, human-validated cases from a curated dataset and integrates their contextual information through a dedicated evidence encoding module and attention-based inference head. Such an evidence-guided design enables REMEMBER to imitate real-world clinical decision-making process by grounding predictions in retrieved imaging and textual context. Specifically, REMEMBER outputs diagnostic predictions alongside an interpretable report, including reference images and explanations aligned with clinical workflows. Experimental results demonstrate that REMEMBER achieves robust zero- and few-shot performance and offers a powerful and explainable framework to neuroimaging-based diagnosis in the real world, especially under limited data.

阿尔茨海默病可解释AI少样本学习多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。