arXiv:2411.07611cs.CLcs.AI2024-11ACL被引 4

用小模型生成可解释的疾病诊断理由,兼顾准确与可信。

Knowledge-Augmented Multimodal Clinical Rationale Generation for Disease Diagnosis with Small Language Models

  • 用大模型提炼推理能力,注入小模型提升多模态理解
  • 在真实数据集上达到顶尖诊断与解释性能
  • 适合临床部署,兼顾效率与医生可读性

解释能力对疾病诊断至关重要,但现有模型难以平衡预测准确率与人类可理解的推理过程。尽管大语言模型(LLMs)具备强大推理能力,其临床应用受限于高计算成本和有限的多模态推理能力。小语言模型(SLMs)虽高效,却缺乏整合多模态医疗数据的高级推理能力,且普遍缺乏领域知识以支持可信推理。为此,我们提出ClinRaGen,通过从大模型中蒸馏推理能力并注入领域知识,增强小模型的多模态可解释推理能力。核心创新包括:一种顺序推理蒸馏框架,使SLMs获得接近大模型的多模态推理能力;以及一种知识增强注意力机制,将时序与文本数据统一编码至同一表示空间,实现自然可解释的同时融合领域知识。在真实医疗数据集上的实验表明,ClinRaGen在疾病诊断与推理生成任务上均达到当前最优表现,验证了大模型驱动推理与知识增强相结合在提升可解释性方面的有效性。

原文摘要 · Abstract (English)

Interpretation is critical for disease diagnosis, but existing models struggle to balance predictive accuracy with human-understandable rationales. While large language models (LLMs) offer strong reasoning abilities, their clinical use is limited by high computational costs and restricted multimodal reasoning ability. Small language models (SLMs) are efficient but lack advanced reasoning for integrating multimodal medical data. In addition, both LLMs and SLMs lack domain knowledge for trustworthy reasoning. Therefore, we propose ClinRaGen, enhancing SLMs by leveraging LLM-derived reasoning ability via rationale distillation and domain knowledge injection for trustworthy multimodal rationale generation. Key innovations include a sequential rationale distillation framework that equips SLMs with LLM-comparable multimodal reasoning abilities, and a knowledge-augmented attention mechanism that jointly unifies multimodal representation from time series and textual data in the same encoding space, enabling it to be naturally interpreted by SLMs while incorporating domain knowledge for reliable rationale generation. Experiments on real-world medical datasets show that ClinRaGen achieves state-of-the-art performance in disease diagnosis and rationale generation, demonstrating the effectiveness of combining LLM-driven reasoning with knowledge augmentation for improved interpretability.

临床推理小模型多模态可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。