用任务专属生成器在持续学习中高效复现旧数据,提升动作识别稳定性。
TaskVAE: Task-Specific Variational Autoencoders for Exemplar Generation in Continual Learning for Human Activity Recognition
- 为每类任务训练专用VAE,生成逼真旧数据样本用于复习。
- 仅需每任务60个样本内存,却能无限生成新样本,节省存储。
- 适合个性化动作识别场景,尤其数据少时表现更优。
随着基于机器学习的系统日益融入日常生活,其面临动态数据环境的挑战。各类数据漂移——渐进式、突变式或周期性——威胁模型准确性,使持续适应成为必要。持续学习(CL)使模型能在不断变化的数据流中学习,同时最小化对已有知识的遗忘。在各类方法中,基于重放的策略已被证明有效,但其成功依赖于在记忆限制与保留旧类别准确率之间取得平衡。本文提出TaskVAE框架,用于类别增量设置下的重放式持续学习。TaskVAE采用任务特定的变分自编码器(VAE)从过往任务中生成合成样本,并与新任务数据一同训练分类器。相较于传统方法需要预知总类别数或依赖单一VAE处理所有任务,TaskVAE可灵活适应不断增加的任务,无需此类约束。研究聚焦于使用惯性传感器设备进行人体活动识别(HAR),不同于以往将所有用户数据合并的方法,本方法专注于个体用户数据,更贴近真实应用场景,即一个人逐步学习新动作。在5个不同HAR数据集上的大量实验表明,TaskVAE优于经验重放方法,尤其在数据有限时表现突出,且随数据规模增大仍保持稳健性能。此外,TaskVAE内存占用极小,每任务仅相当于60个样本,却可生成无限数量的合成样本。其贡献在于在内存约束、任务特异性生成与长期稳定性之间实现良好平衡,使其成为如HAR等领域的可靠实际解决方案。
原文摘要 · Abstract (English)
As machine learning based systems become more integrated into daily life, they unlock new opportunities but face the challenge of adapting to dynamic data environments. Various forms of data shift-gradual, abrupt, or cyclic-threaten model accuracy, making continual adaptation essential. Continual Learning (CL) enables models to learn from evolving data streams while minimizing forgetting of prior knowledge. Among CL strategies, replay-based methods have proven effective, but their success relies on balancing memory constraints and retaining old class accuracy while learning new classes. This paper presents TaskVAE, a framework for replay-based CL in class-incremental settings. TaskVAE employs task-specific Variational Autoencoders (VAEs) to generate synthetic exemplars from previous tasks, which are then used to train the classifier alongside new task data. In contrast to traditional methods that require prior knowledge of the total class count or rely on a single VAE for all tasks, TaskVAE adapts flexibly to increasing tasks without such constraints. We focus on Human Activity Recognition (HAR) using IMU sensor-equipped devices. Unlike previous HAR studies that combine data across all users, our approach focuses on individual user data, better reflecting real-world scenarios where a person progressively learns new activities. Extensive experiments on 5 different HAR datasets show that TaskVAE outperforms experience replay methods, particularly with limited data, and exhibits robust performance as dataset size increases. Additionally, memory footprint of TaskVAE is minimal, being equivalent to only 60 samples per task, while still being able to generate an unlimited number of synthetic samples. The contributions lie in balancing memory constraints, task-specific generation, and long-term stability, making it a reliable solution for real-world applications in domains like HAR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。