用强化学习让大模型自动生成可解释的痴呆症诊断理由。
An Explainable Diagnostic Framework for Neurodegenerative Dementias via Reinforcement-Optimized LLM Reasoning
- 将MRI图像转为报告,再用LLM做分型诊断。
- 不依赖标注推理过程,也能生成结构化诊断理由。
- 适合需要可解释性医疗AI的临床研究者。
神经退行性痴呆的鉴别诊断极具挑战,因症状重叠及影像学模式相似。现有深度学习方法(如卷积神经网络、视觉变换器)虽能自动分类脑部MRI,但决策过程不透明,临床应用受限。本文提出一个可解释诊断框架,整合两个核心组件:首先,构建模块化流程将3D T1加权脑MRI转化为文本放射科报告;其次,利用现代大型语言模型(LLMs)基于生成报告对额颞叶痴呆亚型、阿尔茨海默病与正常老化进行鉴别诊断。为平衡预测精度与可解释性,采用强化学习激励LLM生成诊断推理过程。无需监督推理轨迹或从大模型蒸馏,该方法可自发产生基于神经影像发现的结构化诊断理由。不同于事后解释方法,本框架在推理过程中生成因果关联的解释,指导决策。结果在诊断性能上达到现有深度学习方法水平,同时提供支持结论的可解释理由。
原文摘要 · Abstract (English)
The differential diagnosis of neurodegenerative dementias is a challenging clinical task, mainly because of the overlap in symptom presentation and the similarity of patterns observed in structural neuroimaging. To improve diagnostic efficiency and accuracy, deep learning-based methods such as Convolutional Neural Networks and Vision Transformers have been proposed for the automatic classification of brain MRIs. However, despite their strong predictive performance, these models find limited clinical utility due to their opaque decision making. In this work, we propose a framework that integrates two core components to enhance diagnostic transparency. First, we introduce a modular pipeline for converting 3D T1-weighted brain MRIs into textual radiology reports. Second, we explore the potential of modern Large Language Models (LLMs) to assist clinicians in the differential diagnosis between Frontotemporal dementia subtypes, Alzheimer's disease, and normal aging based on the generated reports. To bridge the gap between predictive accuracy and explainability, we employ reinforcement learning to incentivize diagnostic reasoning in LLMs. Without requiring supervised reasoning traces or distillation from larger models, our approach enables the emergence of structured diagnostic rationales grounded in neuroimaging findings. Unlike post-hoc explainability methods that retrospectively justify model decisions, our framework generates diagnostic rationales as part of the inference process-producing causally grounded explanations that inform and guide the model's decision-making process. In doing so, our framework matches the diagnostic performance of existing deep learning methods while offering rationales that support its diagnostic conclusions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。