arXiv:2411.10703cs.LGeess.SP2024-11中稿 · version被引 14

用分解与蒸馏技术提升糖尿病血糖预测精度,适配边缘设备实时运行。

Hybrid Attention Model Using Feature Decomposition and Knowledge Distillation for Glucose Forecasting

  • 基于特征分解的Transformer模型,将不规则数据转为连续特征。
  • 在12名1型糖尿病患者数据上,RMSE降低51%,MAE降低57%。
  • 模型参数减少21%,适合部署在低算力边缘设备上。

连续血糖监测仪作为非处方商品的普及,为实时监测血糖水平、预测血糖轨迹并提供自动化干预创造了独特机遇,以预防因血糖控制不佳引发的慢性并发症。然而,血糖变化受饮食、用药、运动、睡眠和压力等多种因素影响,难以从多模态且采样不规则的数据中准确预测长期血糖趋势,且模型需在边缘设备上实时运行。为此,本文提出GlucoNet,一种用于持续监测行为与生理健康并实现稳健血糖预测的AI传感器系统。GlucoNet采用基于特征分解的Transformer模型,整合患者的行为与生理数据,并通过数学模型将稀疏不规则数据(如饮食和用药记录)转换为连续特征,便于与血糖数据融合。针对血糖信号的非线性与非平稳特性,提出分解方法提取高低频分量,提升预测精度。同时引入知识蒸馏降低计算复杂度。实验使用12名1型糖尿病患者数据,模型实现RMSE降低60%,参数量减少21%,在真实场景中显著提升预测性能,验证其在糖尿病预防与管理中的实用性。

原文摘要 · Abstract (English)

The availability of continuous glucose monitors as over-the-counter commodities have created a unique opportunity to monitor a person's blood glucose levels, forecast blood glucose trajectories and provide automated interventions to prevent devastating chronic complications that arise from poor glucose control. However, forecasting blood glucose levels is challenging because blood glucose changes consistently in response to food intake, medication intake, physical activity, sleep, and stress. It is particularly difficult to accurately predict BGL from multimodal and irregularly sampled data and over long prediction horizons. Furthermore, these forecasting models must operate in real-time on edge devices to provide in-the-moment interventions. To address these challenges, we propose GlucoNet, an AI-powered sensor system for continuously monitoring behavioral and physiological health and robust forecasting of blood glucose patterns. GlucoNet devises a feature decomposition-based transformer model that incorporates patients' behavioral and physiological data and transforms sparse and irregular patient data (e.g., diet and medication intake data) into continuous features using a mathematical model, facilitating better integration with the BGL data. Given the non-linear and non-stationary nature of BG signals, we propose a decomposition method to extract both low and high-frequency components from the BGL signals, thus providing accurate forecasting. To reduce the computational complexity, we also propose to employ knowledge distillation to compress the transformer model. GlucoNet achieves a 60% improvement in RMSE and a 21% reduction in the number of parameters, improving RMSE and MAE by 51% and 57%, using data obtained involving 12 participants with T1-Diabetes. These results underscore GlucoNet's potential as a compact and reliable tool for real-world diabetes prevention and management.

血糖预测边缘计算知识蒸馏糖尿病管理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。