轻量级混合模型提升心脏病预测准确率,适合资源有限的医疗环境。
Residual GRU+MHSA: A Lightweight Hybrid Recurrent Attention Model for Cardiovascular Disease Detection
- 结合残差循环与多头自注意力,有效捕捉临床数据序列特征。
- 在心病数据集上达86.1%准确率,优于所有对比模型。
- 模型小巧高效,嵌入表示更清晰区分疾病与健康样本。
心血管疾病仍是全球首要致死原因,亟需可靠高效的预测工具以支持早期干预。传统诊断依赖人工特征与医生经验,机器学习虽提升可重复性,但在噪声大、异构性强的临床数据上泛化能力不足。本文提出残差双向门控循环单元结合多头自注意力(Residual GRU+MHSA)的轻量级深度学习架构,用于处理表格型临床记录。模型融合残差双向GRU进行特征列建模,通道重加权模块及带有可学习分类标记的多头自注意力池化,以捕获全局上下文信息。在UCI心脏病数据集上采用5折分层交叉验证,与逻辑回归、随机森林、支持向量机以及DeepMLP、卷积网络、循环网络、Transformer等现代基线模型对比。所提模型达到0.861的准确率、0.860的宏F1、0.908的ROC-AUC和0.904的PR-AUC,优于所有基线。消融实验证明残差递归、通道门控与注意力池化的独立贡献。t-SNE可视化显示,学习到的嵌入比原始特征更清晰地区分疾病与非疾病类别。结果表明,轻量级混合递归与注意力结构在准确率与效率间取得良好平衡,适用于资源受限的医疗场景部署。
原文摘要 · Abstract (English)
Cardiovascular disease (CVD) remains the leading cause of mortality worldwide, underscoring the need for reliable and efficient predictive tools that support early intervention. Traditional diagnostic approaches rely on handcrafted features and clinician expertise, while machine learning methods improve reproducibility but often struggle to generalize across noisy and heterogeneous clinical data. In this work, we propose Residual GRU with Multi-Head Self-Attention, a compact deep learning architecture designed for tabular clinical records. The model integrates residual bidirectional gated recurrent units for sequential modeling of feature columns, a channel reweighting block, and multi-head self-attention pooling with a learnable classification token to capture global context. We evaluate the model on the UCI Heart Disease dataset using 5-fold stratified cross-validation and compare it against classical methods such as Logistic Regression, Random Forest, and Support Vector Machines, as well as modern deep learning baselines including DeepMLP, convolutional networks, recurrent networks, and Transformers. The proposed model achieves an accuracy of 0.861, macro-F1 of 0.860, ROC-AUC of 0.908, and PR-AUC of 0.904, outperforming all baselines. Ablation studies confirm the individual contributions of residual recurrence, channel gating, and attention pooling. t-SNE visualizations further indicate that the learned embeddings exhibit clearer separation between disease and non-disease classes compared to raw features. These results demonstrate that lightweight hybrid recurrent and attention-based architectures provide a strong balance between accuracy and efficiency for clinical risk prediction, supporting deployment in resource-constrained healthcare settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。