用多模态Transformer提升长期血糖预测准确率
AttenGluco: Multimodal Transformer-Based Blood Glucose Forecasting on AI-READI Dataset
- 通过交叉注意力融合连续血糖与活动数据,处理采样率差异
- 多尺度注意力捕捉长时间依赖,相比LSTM模型RMSE降10%、MAE降15%
- 在健康、糖尿病前期和2型糖尿病人群上均表现稳健
糖尿病是一种慢性代谢疾病,特征为持续高血糖水平,可导致心血管疾病、神经病变和视网膜病变等严重并发症。预测血糖水平有助于患者将血糖维持在安全范围,并使照护者通过生活方式调整采取主动措施。连续血糖监测(CGM)系统提供实时追踪,是监测血糖的重要工具。然而,由于运动、饮食等因素引起的波动,准确预测血糖仍具挑战性。近年来深度学习模型在改善血糖预测方面展现出潜力。但如何从多模态、不规则采样的数据中长期准确预测血糖,仍是研究难题。本文提出AttenGluco,一种基于多模态Transformer的长期血糖预测框架。该模型采用交叉注意力机制有效融合CGM与活动数据,解决不同采样率数据融合问题;同时引入多尺度注意力,捕捉时间序列中的长时依赖关系,提升预测精度。我们在新发布的AI-READI数据集上评估了AttenGluco性能,分析其在健康个体、糖尿病前期及2型糖尿病患者群体中的预测表现,并考察新增人群对模型性能的影响。实验结果表明,AttenGluco在各项指标上均优于多模态LSTM基线模型,其中根均方误差(RMSE)降低约10%,平均绝对误差(MAE)降低约15%。
原文摘要 · Abstract (English)
Diabetes is a chronic metabolic disorder characterized by persistently high blood glucose levels (BGLs), leading to severe complications such as cardiovascular disease, neuropathy, and retinopathy. Predicting BGLs enables patients to maintain glucose levels within a safe range and allows caregivers to take proactive measures through lifestyle modifications. Continuous Glucose Monitoring (CGM) systems provide real-time tracking, offering a valuable tool for monitoring BGLs. However, accurately forecasting BGLs remains challenging due to fluctuations due to physical activity, diet, and other factors. Recent deep learning models show promise in improving BGL prediction. Nonetheless, forecasting BGLs accurately from multimodal, irregularly sampled data over long prediction horizons remains a challenging research problem. In this paper, we propose AttenGluco, a multimodal Transformer-based framework for long-term blood glucose prediction. AttenGluco employs cross-attention to effectively integrate CGM and activity data, addressing challenges in fusing data with different sampling rates. Moreover, it employs multi-scale attention to capture long-term dependencies in temporal data, enhancing forecasting accuracy. To evaluate the performance of AttenGluco, we conduct forecasting experiments on the recently released AIREADI dataset, analyzing its predictive accuracy across different subject cohorts including healthy individuals, people with prediabetes, and those with type 2 diabetes. Furthermore, we investigate its performance improvements and forgetting behavior as new cohorts are introduced. Our evaluations show that AttenGluco improves all error metrics, such as root mean square error (RMSE), mean absolute error (MAE), and correlation, compared to the multimodal LSTM model. AttenGluco outperforms this baseline model by about 10% and 15% in terms of RMSE and MAE, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。