arXiv:2509.23077cs.LG2025-09被引 1

解决可穿戴设备持续学习中的遗忘问题,提升多用户行为识别准确率。

CLAD-Net: Continual Activity Recognition in Multi-Sensor Wearable Systems

  • 用自监督变压器+知识蒸馏的CNN架构,实现持续学习
  • 在PAMAP2数据集上达91.36%准确率,遗忘率仅8.78%
  • 对少量标注数据鲁棒,适合真实场景的持续训练

深度学习推动了可穿戴传感器在人体行为监测中的应用,尤其在人体活动识别(HAR)方面。然而,现有模型多假设数据分布稳定,而实际中不同用户的传感器数据差异大,导致分布偏移。在持续学习中,这表现为一系列新任务(对应不同用户),易引发灾难性遗忘。此外,人类研究中标签数据稀缺且不一致。为此,我们提出CLAD-Net(带注意力与蒸馏的持续学习),使可穿戴模型能持续更新而不丢失旧知识。该框架融合自监督变压器(作为长期记忆)与通过知识蒸馏训练的监督卷积神经网络(CNN)。变压器通过跨传感器的交叉注意力捕捉全局活动模式,无须标签即可学习通用表示;而CNN利用知识蒸馏保留旧任务知识。在PAMAP2数据集上,CLAD-Net最终准确率达91.36%,遗忘率仅8.78%,优于基于记忆和正则化的基线方法(如经验回放、弹性权重固化)。在仅10%-20%标注数据的半监督设置下仍表现优异,验证其对标签稀缺的鲁棒性。消融实验进一步证明各模块的有效性。

原文摘要 · Abstract (English)

The rise of deep learning has greatly advanced human behavior monitoring using wearable sensors, particularly human activity recognition (HAR). While deep models have been widely studied, most assume stationary data distributions - an assumption often violated in real-world scenarios. For example, sensor data from one subject may differ significantly from another, leading to distribution shifts. In continual learning, this shift is framed as a sequence of tasks, each corresponding to a new subject. Such settings suffer from catastrophic forgetting, where prior knowledge deteriorates as new tasks are learned. This challenge is compounded by the scarcity and inconsistency of labeled data in human studies. To address these issues, we propose CLAD-Net (Continual Learning with Attention and Distillation), a framework enabling wearable-sensor models to be updated continuously without sacrificing performance on past tasks. CLAD-Net integrates a self-supervised transformer, acting as long-term memory, with a supervised Convolutional Neural Network (CNN) trained via knowledge distillation for activity classification. The transformer captures global activity patterns through cross-attention across body-mounted sensors, learning generalizable representations without labels. Meanwhile, the CNN leverages knowledge distillation to retain prior knowledge during subject-wise fine-tuning. On PAMAP2, CLAD-Net achieves 91.36 percent final accuracy with only 8.78 percent forgetting, surpassing memory-based and regularization-based baselines such as Experience Replay and Elastic Weight Consolidation. In semi-supervised settings with only 10-20 percent labeled data, CLAD-Net still delivers strong performance, demonstrating robustness to label scarcity. Ablation studies further validate each module's contribution.

持续学习行为识别可穿戴设备知识蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。