针对传感器数据不完整问题,提出稳定识别人体动作的新方法。
Leveraging Imperfect Medical Data: A Manifold-Consistent Spatio-Temporal Network for Sensor-based Human Activity Recognition

- 通过双重噪声建模模拟真实传感器缺陷
- 在多种缺失数据下仍保持准确识别性能
- 适合医疗可穿戴设备等实际应用场景
基于传感器的人体活动识别(HAR)在医疗健康监测中日益重要,尤其随着医疗物联网(IoMT)的发展。然而,在真实可穿戴传感场景中,IoMT信号常受数据缺失、传感器故障和环境噪声影响,显著降低传统深度学习模型性能。为此,本文提出一种面向不完美传感条件的流形一致时空网络(MCSTN)。该框架引入双层噪声建模机制,通过物理级噪声和扩散驱动的连续噪声模拟真实传感器缺陷。通过强制多扰动视图间表征一致性,模型学习到稳定且抗干扰的语义表示。此外,设计双流时空结构,显式分离时序动态建模与空间相关性学习:时序流捕捉长期活动模式,空间流建模传感器间关系,实现更有效的时空表征学习。在三个主流基准数据集PAMAP2、Opportunity和WISDM上的大量实验表明,所提MCSTN在不完美传感条件下表现优于现有先进方法,验证了其在真实可穿戴IoMT应用中的有效性与鲁棒性。
原文摘要 · Abstract (English)
Sensor-based Human Activity Recognition (HAR) has attracted increasing attention in medical and healthcare monitoring, particularly with the growth of Internet of Medical Things (IoMT). However, in real-world wearable sensing scenarios, IoMT signals are often corrupted by missing measurements, sensor failures, and environmental noise, which significantly degrade the performance of conventional deep learning models that assume clean and complete inputs. To address this challenge, we propose a Manifold-Consistent Spatio-Temporal Network (MCSTN) for robust HAR under imperfect sensing conditions. The proposed framework introduces a dual-level corruption modeling mechanism that simulates realistic sensor imperfections through both physical-level corruption and diffusion-driven continuous corruption. By enforcing representation consistency across multiple corrupted views, the model learns stable and corruption-invariant semantic representations. Furthermore, we design a dual-stream spatio-temporal architecture that explicitly decouples temporal dynamics modeling and spatial correlation learning. The temporal stream captures long-term activity dynamics, while the spatial stream models inter-sensor relationships, enabling more effective spatio-temporal representation learning. Extensive experiments on three widely used HAR benchmark datasets, PAMAP2, Opportunity, and WISDM, demonstrate that the proposed MCSTN achieves competitive performance compared with existing state-of-the-art methods, particularly under imperfect sensing conditions. These results validate the effectiveness and robustness of the proposed framework for real-world wearable IoMT sensing applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。