arXiv:2410.15954cs.LGcs.AI2024-10被引 1

提出无需梯度更新的时序持续学习方法,解决遗忘与类内差异问题。

TS-ACL: Closed-Form Solution for Time Series-oriented Continual Learning

  • 用闭式解替代梯度更新,避免知识遗忘
  • 在5个数据集上4个接近联合训练性能
  • 适合隐私敏感、高效实时的时序分类场景

时序分类支撑医疗诊断和多媒体手势交互等关键应用。然而,时序类别增量学习(TSCIL)面临两大挑战:灾难性遗忘和类内差异。灾难性遗忘源于基于梯度的参数更新会抹除历史知识;而时序数据具有个体特异性模式,即类内差异,表现为同一类别中模式的多样性。现有基于实例的方法受限于样本量难以覆盖多样变异,无实例方法则缺乏显式处理类内差异机制。为此,我们提出TS-ACL,采用无梯度闭式解,避免梯度优化固有的遗忘问题,同时学习全局分布以缓解类内差异。该方法兼具隐私保护与高效性。在涵盖多种传感器模态和任务的五个基准数据集上进行的大量实验表明,TS-ACL在四个数据集上性能接近联合训练,优于现有方法,确立了TSCIL的新最佳水平(SOTA)。

原文摘要 · Abstract (English)

Time series classification underpins critical applications such as healthcare diagnostics and gesture-driven interactive systems in multimedia scenarios. However, time series class-incremental learning (TSCIL) faces two major challenges: catastrophic forgetting and intra-class variations. Catastrophic forgetting occurs because gradient-based parameter update strategies inevitably erase past knowledge. And unlike images, time series data exhibits subject-specific patterns, also known as intra-class variations, which refer to differences in patterns observed within the same class. While exemplar-based methods fail to cover diverse variation with limited samples, existing exemplar-free methods lack explicit mechanisms to handle intra-class variations. To address these two challenges, we propose TS-ACL, which leverages a gradient-free closed-form solution to avoid the catastrophic forgetting problem inherent in gradient-based optimization methods while simultaneously learning global distributions to resolve intra-class variations. Additionally, it provides privacy protection and efficiency. Extensive experiments on five benchmark datasets covering various sensor modalities and tasks demonstrate that TS-ACL achieves performance close to joint training on four datasets, outperforming existing methods and establishing a new state-of-the-art (SOTA) for TSCIL.

时序学习持续学习分类隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。