arXiv:2410.14464cs.LG2024-10中稿 · AHLI CHIL 2025被引 7

用少量心电图数据实现精准问诊,让大模型读懂心电图。

Electrocardiogram-Language Model for Few-Shot Question Answering with Meta Learning

  • 通过可训练融合模块连接心电图编码器与冻结大语言模型
  • 5类5样本下准确率最高达84.6%,在少样本场景表现突出
  • 适合临床少样本场景,尤其适用于数据稀缺的心电图诊断

心电图解读需专业知识,常需结合心电图信号与自然语言临床问题。由于标注数据稀缺且临床问题多样,构建鲁棒自适应的心电图诊断系统面临挑战。本文提出一种新型多模态元学习方法,用于少样本心电图问答,利用大语言模型(LLM)的丰富知识,在有限标注数据下实现良好泛化。该方法不依赖特定语言模型,将预训练心电图编码器与冻结的LLM(如LLaMA、Gemma)通过可训练融合模块连接,使语言模型能推理心电图并生成临床有意义的回答。大量实验表明,相比监督基线,本方法在未见过的诊断任务上表现更优,即使使用较少心电图导联也取得良好效果。例如,在5类5样本设置下,采用LLaMA-3.1-8B时,单验证、选择和查询类问题的准确率分别为84.6%、77.3%和69.6%。结果表明,该方法能有效结合信号处理与大语言模型的语义理解能力,提升临床心电图解读性能,尤其适用于数据受限场景。

原文摘要 · Abstract (English)

Electrocardiogram (ECG) interpretation requires specialized expertise, often involving synthesizing insights from ECG signals with complex clinical queries posed in natural language. The scarcity of labeled ECG data coupled with the diverse nature of clinical inquiries presents a significant challenge for developing robust and adaptable ECG diagnostic systems. This work introduces a novel multimodal meta-learning method for few-shot ECG question answering, addressing the challenge of limited labeled data while leveraging the rich knowledge encoded within large language models (LLMs). Our LLM-agnostic approach integrates a pre-trained ECG encoder with a frozen LLM (e.g., LLaMA and Gemma) via a trainable fusion module, enabling the language model to reason about ECG data and generate clinically meaningful answers. Extensive experiments demonstrate superior generalization to unseen diagnostic tasks compared to supervised baselines, achieving notable performance even with limited ECG leads. For instance, in a 5-way 5-shot setting, our method using LLaMA-3.1-8B achieves an accuracy of 84.6%, 77.3%, and 69.6% on single verify, choose and query question types, respectively. These results highlight the potential of our method to enhance clinical ECG interpretation by combining signal processing with the nuanced language understanding capabilities of LLMs, particularly in data-constrained scenarios.

心电图少样本学习大模型多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。