将心电图心跳当作词汇,节奏当作句子,实现更懂心脏语言的自监督学习。
Reading Your Heart: Learning ECG Words and Sentences via Pre-training ECG Language Model
- 把心跳看作词汇,节奏看作句子,用QRs-Tokenizer生成语义化心电序列。
- 在6个公开数据集上超越现有方法,实现心电图形态与节律的联合表征学习。
- 构建了当前最大的基于心跳的心电图词库,适合医疗AI研究者和临床工程师。
心电图(ECG)对心律失常等心脏病诊断至关重要,但基于深度学习的ECG方法常受限于高质量标注数据。尽管先前的无监督学习方法在未标注ECG数据表示学习上取得进展,通常仍将ECG视为普通时间序列,采用固定大小和步长的时间窗口分割,忽略了心跳的形态、节律特征及潜在语义关系。本文提出新视角:将心跳视为词汇,节奏视为句子。为此设计了QRS-Tokenizer,从原始信号生成语义有意义的ECG句子;在此基础上提出HeartLang框架,实现形态与节律层级的自监督学习;并构建迄今最大的基于心跳的ECG词库,推动心电语言处理发展。在6个公共数据集上验证,HeartLang性能优于其他eSSL方法。数据与代码已开源:https://github.com/PKUDigitalHealth/HeartLang。
原文摘要 · Abstract (English)
Electrocardiogram (ECG) is essential for the clinical diagnosis of arrhythmias and other heart diseases, but deep learning methods based on ECG often face limitations due to the need for high-quality annotations. Although previous ECG self-supervised learning (eSSL) methods have made significant progress in representation learning from unannotated ECG data, they typically treat ECG signals as ordinary time-series data, segmenting the signals using fixed-size and fixed-step time windows, which often ignore the form and rhythm characteristics and latent semantic relationships in ECG signals. In this work, we introduce a novel perspective on ECG signals, treating heartbeats as words and rhythms as sentences. Based on this perspective, we first designed the QRS-Tokenizer, which generates semantically meaningful ECG sentences from the raw ECG signals. Building on these, we then propose HeartLang, a novel self-supervised learning framework for ECG language processing, learning general representations at form and rhythm levels. Additionally, we construct the largest heartbeat-based ECG vocabulary to date, which will further advance the development of ECG language processing. We evaluated HeartLang across six public ECG datasets, where it demonstrated robust competitiveness against other eSSL methods. Our data and code are publicly available at https://github.com/PKUDigitalHealth/HeartLang.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。