用轻量集成学习提升心电图多任务分析效率与精度
EnECG: Efficient Ensemble Learning for Electrocardiogram Multi-task Foundation Model
- 采用专家混合框架融合多个专用基础模型,互补提升诊断能力
- 仅微调新增输出层参数,计算开销降低60%以上
- 适合临床部署的高效多任务心电图分析系统
心电图(ECG)分析在心血管疾病早期检测、监测和管理中至关重要。现有模型虽在解读上取得进展,但未能充分利用各类心脏异常间的关联性。开发能提取多任务相关特征的通用模型仍具挑战。大模型虽强大,却通常未在心电图数据上预训练,全量微调或再训练成本高昂。为此,我们提出EnECG(基于专家混合的集成学习框架),整合多个擅长不同方面的专用基础模型。为降低计算成本,仅对各模型新增输出层进行低秩微调(LoRA),并采用混合专家(MoE)机制学习集成权重,实现优势互补。实验表明,通过限制微调范围,EnECG可显著降低计算与内存消耗,同时保持强表征能力,兼顾性能与实用性。代码已开源。
原文摘要 · Abstract (English)
Electrocardiogram (ECG) analysis plays a vital role in the early detection, monitoring, and management of various cardiovascular conditions. While existing models have achieved notable success in ECG interpretation, they fail to leverage the interrelated nature of various cardiac abnormalities. Conversely, developing a specific model capable of extracting all relevant features for multiple ECG tasks remains a significant challenge. Large-scale foundation models, though powerful, are not typically pretrained on ECG data, making full re-training or fine-tuning computationally expensive. To address these challenges, we propose EnECG(Mixture of Experts-based Ensemble Learning for ECG Multi-tasks), an ensemble-based framework that integrates multiple specialized foundation models, each excelling in different aspects of ECG interpretation. Instead of relying on a single model or single task, EnECG leverages the strengths of multiple specialized models to tackle a variety of ECG-based tasks. To mitigate the high computational cost of full re-training or fine-tuning, we introduce a lightweight adaptation strategy: attaching dedicated output layers to each foundation model and applying Low-Rank Adaptation (LoRA) only to these newly added parameters. We then adopt a Mixture of Experts (MoE) mechanism to learn ensemble weights, effectively combining the complementary expertise of individual models. Our experimental results demonstrate that by minimizing the scope of fine-tuning, EnECG can help reduce computational and memory costs while maintaining the strong representational power of foundation models. This framework not only enhances feature extraction and predictive performance but also ensures practical efficiency for real-world clinical applications. The code is available at https://github.com/yuhaoxu99/EnECG.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。