arXiv:2601.08440cs.CV2026-01被引 1

让大模型像心脏科医生一样推理,提升超声心动图诊断可解释性。

Incentivizing Cardiologist-Like Reasoning in MLLMs for Interpretable Echocardiographic Diagnosis

  • 设计心脏病诊断模板与强化学习奖励机制,引导模型按临床逻辑推理。
  • 多视图诊断准确率提升48%,对复杂心脏病识别效果显著。
  • 生成的推理过程93.3%符合心脏病专家思维,适合临床辅助场景。

超声心动图诊断对心脏筛查至关重要但难度高。现有超声基础模型难以捕捉量化指标与临床表现间的关联,而医学推理多模态大模型需耗时构建详细推理路径,且难以直接融入超声先验知识。为此,我们提出新方法:心脏推理模板(CRT)与CardiacMind。CRT提供复杂心脏疾病的标准诊断流程,简化推理路径构建;CardiacMind采用三种新奖励机制——流程数量奖励(PQtR)、流程质量奖励(PQlR)和超声语义奖励(ESR),分别促进推理详尽性、跨视图证据整合及视觉内容对齐。实验显示,该方法在15种复杂心脏疾病上多视图诊断准确率提升48%,在CardiacNet-PAH上提升5%。用户研究显示,93.33%的临床医生认可其推理逻辑与心脏科医生一致。代码将开源。

原文摘要 · Abstract (English)

Echocardiographic diagnosis is vital for cardiac screening yet remains challenging. Existing echocardiography foundation models do not effectively capture the relationships between quantitative measurements and clinical manifestations, whereas medical reasoning multimodal large language models (MLLMs) require costly construction of detailed reasoning paths and remain ineffective at directly incorporating such echocardiographic priors into their reasoning. To address these limitations, we propose a novel approach comprising Cardiac Reasoning Template (CRT) and CardiacMind to enhance MLLM's echocardiographic reasoning by introducing cardiologist-like mindset. Specifically, CRT provides stepwise canonical diagnostic procedures for complex cardiac diseases to streamline reasoning path construction without the need for costly case-by-case verification. To incentivize reasoning MLLM under CRT, we develop CardiacMind, a new reinforcement learning scheme with three novel rewards: Procedural Quantity Reward (PQtR), Procedural Quality Reward (PQlR), and Echocardiographic Semantic Reward (ESR). PQtR promotes detailed reasoning; PQlR promotes integration of evidence across views and modalities, while ESR grounds stepwise descriptions in visual content. Our methods show a 48% improvement in multiview echocardiographic diagnosis for 15 complex cardiac diseases and a 5% improvement on CardiacNet-PAH over prior methods. The user study on our method's reasoning outputs shows 93.33% clinician agreement with cardiologist-like reasoning logic. Our code will be available.

医疗AI多模态推理增强超声心动图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。