arXiv:2503.11695cs.LGcs.AI2025-03被引 1

用多模态专家模型预测危重症患者12小时移动状态,准确率超80%

MELON: Multimodal Mixture-of-Experts with Spectral-Temporal Fusion for Long-Term Mobility Estimation in Critical Care

  • 双分支架构融合频谱图与加速度统计特征,捕捉长期移动模式
  • 在126名患者数据上实现0.82的AUROC,优于传统方法
  • 腕部传感器即可达成高精度,降低患者负担和部署成本

危重症患者移动监测对及时干预和改善临床结局至关重要。尽管基于加速度计的传感器数据广泛用于训练人工智能模型以估计患者移动性,但现有方法面临两大挑战:(1)由于高维度、变异性与噪声,建模长期加速度数据困难;(2)缺乏高效稳健的长期移动评估方法。为此,我们提出MELON,一种新型多模态框架,用于预测危重症环境中12小时的移动状态。MELON采用双分支网络结构,结合频谱图视觉表示与加速度计序列统计特征。通过预训练图像编码器提取丰富频域特征,以及混合专家编码器进行序列建模,有效捕捉全局与细粒度移动模式。我们在佛罗里达大学健康沙恩德医院九个重症监护室招募的126名患者多模态数据集上训练并评估了MELON模型。实验表明,MELON在12小时移动状态估计上优于传统方法,整体受试者工作特征曲线下面积(AUROC)为0.82(95%置信区间0.78–0.86)。值得注意的是,腕部采集的加速度数据相比踝部数据表现出更优的预测性能,表明单一传感器方案可减少患者负担并降低部署成本。

原文摘要 · Abstract (English)

Patient mobility monitoring in intensive care is critical for ensuring timely interventions and improving clinical outcomes. While accelerometry-based sensor data are widely adopted in training artificial intelligence models to estimate patient mobility, existing approaches face two key limitations highlighted in clinical practice: (1) modeling the long-term accelerometer data is challenging due to the high dimensionality, variability, and noise, and (2) the absence of efficient and robust methods for long-term mobility assessment. To overcome these challenges, we introduce MELON, a novel multimodal framework designed to predict 12-hour mobility status in the critical care setting. MELON leverages the power of a dual-branch network architecture, combining the strengths of spectrogram-based visual representations and sequential accelerometer statistical features. MELON effectively captures global and fine-grained mobility patterns by integrating a pre-trained image encoder for rich frequency-domain feature extraction and a Mixture-of-Experts encoder for sequence modeling. We trained and evaluated the MELON model on the multimodal dataset of 126 patients recruited from nine Intensive Care Units at the University of Florida Health Shands Hospital main campus in Gainesville, Florida. Experiments showed that MELON outperforms conventional approaches for 12-hour mobility status estimation with an overall area under the receiver operating characteristic curve (AUROC) of 0.82 (95\%, confidence interval 0.78-0.86). Notably, our experiments also revealed that accelerometer data collected from the wrist provides robust predictive performance compared with data from the ankle, suggesting a single-sensor solution that can reduce patient burden and lower deployment costs...

危重症监测多模态学习移动估计专家模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。