arXiv:2509.12991cs.LGcs.AI2025-09被引 3

提出一种简单有效的后训练策略,显著提升心电图基础模型性能。

Bridging Performance Gaps for ECG Foundation Models: A Post-Training Strategy

  • 通过后训练优化模型适应能力,无需修改架构
  • 在PTB-XL上宏AUROC提升0.7%-8.9%,宏AUPRC提升23.3%-77.9%
  • 仅用30%数据即超越全量数据微调,适合临床部署

心电图(ECG)基础模型虽具备跨任务适应性,但其临床应用常受限于与专用模型的性能差距。该问题可能源于缺乏有效的后训练策略。本文提出一种简单而高效的后训练方法,针对公开的基于Transformer的基础模型进行评估。多任务实验表明,该方法持续优于基线微调。在PTB-XL基准上,宏AUROC提升0.7%-8.9%,宏AUPRC提升23.3%-77.9%,并超越多个近期先进方法,包括专用模型和复杂架构。进一步分析显示,该方法提升了训练动态性和数据效率:仅使用30%训练数据即可超越全量数据微调的基线。消融研究强调了随机深度和预览线性探针的重要性。结果表明,后训练策略可显著增强ECG基础模型潜力,推动其在心电领域的发展。

原文摘要 · Abstract (English)

ECG foundation models are increasingly popular due to their adaptability across various tasks. However, their clinical applicability is often limited by performance gaps compared to task-specific models, even after pre-training on large ECG datasets and fine-tuning on target data. This limitation is likely due to the lack of an effective post-training strategy. In this paper, we propose a simple yet effective post-training approach to enhance ECG foundation models. We evaluate it on a publicly available Transformer-based foundation model. Experiments across multiple ECG tasks show that our method consistently outperforms baseline fine-tuning. On the PTB-XL benchmarks, it improves macro AUROC by 0.7%-8.9% and macro AUPRC by 23.3%-77.9%, also outperforming several recent state-of-the-art approaches, including task-specific and advanced architectures. Further analyses demonstrate improved training dynamics and data efficiency, with only 30% of the training data outperforming the baseline trained on the full dataset. Ablation studies highlight the importance of stochastic depth and preview linear probing. These findings underscore the potential of post-training strategies to improve ECG foundation models, and we hope this work will contribute to the continued development of foundation models in the ECG domain.

心电图基础模型后训练数据效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。