通过通道门控调制冻结特征,实现可穿戴设备上持续学习的稳定与高效。
Gated Adaptation for Continual Learning in Human Activity Recognition
- 用通道级门控对冻结特征进行选择性调制,避免灾难性遗忘。
- 在PAMAP2数据集上将遗忘率从39.7%降至16.2%,最终准确率达77.7%。
- 仅训练不足2%参数,适合资源受限的边缘设备应用。
物联网中的可穿戴传感器广泛用于远程健康监测、老人照护和智能家居自动化,均依赖于稳健的人体活动识别(HAR)。持续学习系统需平衡学习新任务的灵活性与保留旧知识的稳定性,但人工智能模型常出现灾难性遗忘,即学习新任务会降低对旧任务的性能。这一问题在领域增量式HAR中尤为突出:设备端模型必须适应具有不同运动模式的新用户,同时在不传输敏感数据至云端的前提下保持对先前用户的识别准确率。本文提出一种基于通道级门控调制冻结预训练特征的参数高效持续学习框架。核心思想是:适应应通过特征选择而非生成实现——通过将学习变换限制为对现有特征的对角缩放,保留预训练表示的几何结构,同时实现个体特异性调制。理论分析表明,门控实现有界对角算子,相比无约束线性变换,能有效抑制表示漂移。实验显示,冻结主干网络显著减少遗忘,轻量级门控恢复了被损失的适应能力,实现稳定与灵活的同步。在包含8个连续受试者的PAMAP2数据集上,遗忘率由39.7%降至16.2%,最终准确率从56.7%提升至77.7%,且仅训练少于2%的参数。该方法无需回放缓冲或任务特定正则化,即达到或超过标准持续学习基线,验证了结构化对角算子在分布偏移下的有效性与高效性。
原文摘要 · Abstract (English)
Wearable sensors in Internet of Things (IoT) ecosystems increasingly support applications such as remote health monitoring, elderly care, and smart home automation, all of which rely on robust human activity recognition (HAR). Continual learning systems must balance plasticity (learning new tasks) with stability (retaining prior knowledge), yet AI models often exhibit catastrophic forgetting, where learning new tasks degrades performance on earlier ones. This challenge is especially acute in domain-incremental HAR, where on-device models must adapt to new subjects with distinct movement patterns while maintaining accuracy on prior subjects without transmitting sensitive data to the cloud. We propose a parameter-efficient continual learning framework based on channel-wise gated modulation of frozen pretrained representations. Our key insight is that adaptation should operate through feature selection rather than feature generation: by restricting learned transformations to diagonal scaling of existing features, we preserve the geometry of pretrained representations while enabling subject-specific modulation. We provide a theoretical analysis showing that gating implements a bounded diagonal operator that limits representational drift compared to unconstrained linear transformations. Empirically, freezing the backbone substantially reduces forgetting, and lightweight gates restore lost adaptation capacity, achieving stability and plasticity simultaneously. On PAMAP2 with 8 sequential subjects, our approach reduces forgetting from 39.7% to 16.2% and improves final accuracy from 56.7% to 77.7%, while training less than 2% of parameters. Our method matches or exceeds standard continual learning baselines without replay buffers or task-specific regularization, confirming that structured diagonal operators are effective and efficient under distribution shift.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。