arXiv:2505.18847cs.AIcs.CL2025-05被引 2

对比三种心电图输入方式,发现符号化表示最有效。

Signal, Image, or Symbolic: Exploring the Best Input Representation for Electrocardiogram-Language Models Through a Unified Framework

  • 用符号序列、信号波形和图像三种方式表示心电图
  • 符号化表示在6个数据集上显著优于其他两种方式
  • 适合想构建下一代心电图语言模型的研究者参考

近年来,大型语言模型(LLMs)被用于心电图(ECG)解读,催生了心电图-语言模型(ELMs)。ELM根据心电图和文本查询,自回归生成自由格式的文本回答。与传统分类系统不同,ELMs能模拟心脏电生理专家,进行诊断、波形分析、病因识别和个性化治疗建议。为实现这一潜力,研究者正在构建配对心电图与对话文本的指令微调数据集,并在此基础上训练ELMs。然而,在进一步扩展之前,一个根本性问题尚未解决:哪种心电图输入表示最有效?目前主要有三种候选方案——原始时间序列信号、渲染图像和离散符号序列。本文首次在6个公开数据集和5项评估指标下对这三种模态进行全面基准测试。结果表明,符号化表示在统计显著性上胜过信号和图像输入的数量最多。我们还对LLM主干、心电图时长和令牌预算进行了消融实验,并评估了对信号扰动的鲁棒性。希望本研究为下一代ELMs的输入表示选择提供清晰指导。

原文摘要 · Abstract (English)

Recent advances have increasingly applied large language models (LLMs) to electrocardiogram (ECG) interpretation, giving rise to Electrocardiogram-Language Models (ELMs). Conditioned on an ECG and a textual query, an ELM autoregressively generates a free-form textual response. Unlike traditional classification-based systems, ELMs emulate expert cardiac electrophysiologists by issuing diagnoses, analyzing waveform morphology, identifying contributing factors, and proposing patient-specific action plans. To realize this potential, researchers are curating instruction-tuning datasets that pair ECGs with textual dialogues and are training ELMs on these resources. Yet before scaling ELMs further, there is a fundamental question yet to be explored: What is the most effective ECG input representation? In recent works, three candidate representations have emerged-raw time-series signals, rendered images, and discretized symbolic sequences. We present the first comprehensive benchmark of these modalities across 6 public datasets and 5 evaluation metrics. We find symbolic representations achieve the greatest number of statistically significant wins over both signal and image inputs. We further ablate the LLM backbone, ECG duration, and token budget, and we evaluate robustness to signal perturbations. We hope that our findings offer clear guidance for selecting input representations when developing the next generation of ELMs.

心电图语言模型符号表示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。