用记忆增强的LSTM自编码器实现无监督动作识别,提升实时性与准确率。
Memory-Augmented LSTM Autoencoder for Unsupervised Activity Recognition with IMU Sensor Fusion
- 引入记忆增强自编码器融合多传感器时序数据,捕捉时空特征。
- 在DaLiAc和PAMAP2上分别达96.6%和98.4%准确率,优于有监督基线。
- 适合医疗监控等真实场景,尤其对噪声数据和标签缺失鲁棒。
使用惯性测量单元(IMU)进行人体活动识别(HAR)对健康监测和康复至关重要。尽管深度学习取得进展,仍面临标注数据依赖、多传感器融合复杂及无监督方法难以捕捉时空依赖等问题,尤其在噪声数据、活动重叠和标签缺失的真实场景中更为突出。本文提出一种全无监督的时空特征融合框架,基于记忆增强自编码器,通过短时窗的多传感器IMU数据增强活动表征,支持实时应用。框架首先通过堆叠自编码器提取分层静态特征,并在传感器内与跨传感器间进行融合;随后,序列到序列的LSTM自编码器对特征进行时间精炼,利用历史运动模式而不需标签。我们分析关键超参数以确定在短时窗约束下最大化特征可分性的配置。在DaLiAc和PAMAP2数据集上,采用真实类间窗口分割评估,分别达到96.6%和98.4%的准确率,超越监督与无监督基线。相比长窗口,短窗口下特征可分性提升高达9%。尽管真实类间分割使准确率下降约7%,但该设计旨在更贴近真实活动切换场景,增强实用性。
原文摘要 · Abstract (English)
HAR using Inertial Measurement Unit (IMU) sensors is vital for healthcare monitoring and rehabilitation. Despite deep learning advancements, major challenges remain: reliance on labeled data, multi-sensor fusion complexity, and the limited ability of unsupervised methods to capture spatiotemporal dependencies. These issues are pronounced in real-world scenarios with noisy data, overlapping activities, and missing labels. We propose a fully unsupervised spatiotemporal feature fusion framework using a memory-augmented autoencoder. It enhances activity representations via short temporal windows of multi-sensor IMU data, enabling real-time applications. Our framework extracts hierarchical static features via a Stacked Autoencoder, fusing them within and across sensors. A sequence-to-sequence LSTM Autoencoder then temporally refines these features, incorporating historical motion patterns without labels. We analyze key hyperparameters to identify configurations that maximize feature separability under short-window constraints. Evaluated on DaLiAc and PAMAP2 using realistic inter-class window segmentation, our method achieves 96.6% and 98.4% accuracy, respectively, surpassing supervised baselines and unsupervised approaches. Our method improves feature separability by up to 9% despite shorter temporal windows. While our realistic inter-class segmentation reduces accuracy by ~7%, it was intentionally adopted to better reflect real-world activity transitions and practical relevance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。