arXiv:2508.09085cs.NIcs.AI2025-08被引 18

动态环境下的健康监测新框架,能自适应处理传感器噪声。

Dynamic Uncertainty-aware Multimodal Fusion for Outdoor Health Monitoring

  • 基于不确定性量化,动态评估多模态数据噪声影响
  • 融合权重随噪声水平自动调整,提升低质量数据利用效率
  • 适合户外实时健康监测场景,尤其对噪声敏感的应用

户外健康监测对早期发现异常健康状态至关重要。传统方法依赖静态多模态深度学习框架,需大量数据从头训练,难以捕捉细微生理变化。多模态大语言模型(MLLMs)虽可用小样本微调预训练模型实现高效监测,但仍面临三大挑战:一、传感器数据受采集噪声及户外环境突变导致的生理信号波动影响,降低训练性能;二、现有基于Transformer的MLLM难以实现鲁棒的多模态融合,缺乏对噪声模态的融合设计;三、不同噪声水平的模态阻碍从波动分布中准确恢复缺失数据。为此,我们提出不确定性感知的多模态融合框架DUAL-Health,用于动态噪声环境下的户外健康监测。首先,通过当前与时间特征精准量化输入噪声与波动噪声引起的模态不确定性;其次,根据校准后的不确定性,为各模态定制融合权重,实现高效融合;第三,通过在共同语义空间对齐模态分布,增强从波动噪声模态中恢复数据的能力。大量实验表明,DUAL-Health在检测准确率与鲁棒性上均优于现有最先进方法。

原文摘要 · Abstract (English)

Outdoor health monitoring is essential to detect early abnormal health status for safeguarding human health and safety. Conventional outdoor monitoring relies on static multimodal deep learning frameworks, which requires extensive data training from scratch and fails to capture subtle health status changes. Multimodal large language models (MLLMs) emerge as a promising alternative, utilizing only small datasets to fine-tune pre-trained information-rich models for enabling powerful health status monitoring. Unfortunately, MLLM-based outdoor health monitoring also faces significant challenges: I) sensor data contains input noise stemming from sensor data acquisition and fluctuation noise caused by sudden changes in physiological signals due to dynamic outdoor environments, thus degrading the training performance; ii) current transformer based MLLMs struggle to achieve robust multimodal fusion, as they lack a design for fusing the noisy modality; iii) modalities with varying noise levels hinder accurate recovery of missing data from fluctuating distributions. To combat these challenges, we propose an uncertainty-aware multimodal fusion framework, named DUAL-Health, for outdoor health monitoring in dynamic and noisy environments. First, to assess the impact of noise, we accurately quantify modality uncertainty caused by input and fluctuation noise with current and temporal features. Second, to empower efficient muitimodal fusion with low-quality modalities,we customize the fusion weight for each modality based on quantified and calibrated uncertainty. Third, to enhance data recovery from fluctuating noisy modalities, we align modality distributions within a common semantic space. Extensive experiments demonstrate that our DUAL-Health outperforms state-of-the-art baselines in detection accuracy and robustness.

健康监测多模态融合不确定性建模动态环境

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。