arXiv:2503.01669cs.LGcs.AI2025-03被引 3

提出高效方法缓解时间序列学习中的遗忘问题,适用于车辆状态估计。

An Efficient Continual Learning Framework for Multivariate Time Series Prediction Tasks with Application to Vehicle State Estimation

  • 通过选择历史数据代表子集结合记忆机制,避免模型遗忘旧知识。
  • 在电动别克昂科兹车上测试,持续学习性能优于现有方法。
  • 训练速度快,适合实时车辆系统持续更新场景。

在神经网络用于连续时间序列分析时,模型在学习新数据域时容易发生灾难性遗忘,这一问题在车辆状态估计与控制中尤为突出。现有持续学习方法未能充分解决多变量输出环境下的遗忘问题。本文提出EM-ReSeleCT(高效多变量代表性选择持续学习框架),通过从旧数据中精选代表性子集,结合基于记忆的持续学习技术与改进优化算法,在适应新信息的同时保留已有知识。此外,我们设计了专用于车辆状态估计的自回归序列到序列变换器模型,并提出基于共形预测的不确定性量化框架,评估记忆规模敏感性并验证方法鲁棒性。在电动别克昂科兹车辆上的实验表明,该方法在持续学习新信息的同时有效保留旧知识,性能超越当前最优持续学习方法。且训练时间显著减少,对实际应用具有重要意义。

原文摘要 · Abstract (English)

In continual time series analysis using neural networks, catastrophic forgetting (CF) of previously learned models when training on new data domains has always been a significant challenge. This problem is especially challenging in vehicle estimation and control, where new information is sequentially introduced to the model. Unfortunately, existing work on continual learning has not sufficiently addressed the adverse effects of catastrophic forgetting in time series analysis, particularly in multivariate output environments. In this paper, we present EM-ReSeleCT (Efficient Multivariate Representative Selection for Continual Learning in Time Series Tasks), an enhanced approach designed to handle continual learning in multivariate environments. Our approach strategically selects representative subsets from old and historical data and incorporates memory-based continual learning techniques with an improved optimization algorithm to adapt the pre-trained model on new information while preserving previously acquired information. Additionally, we develop a sequence-to-sequence transformer model (autoregressive model) specifically designed for vehicle state estimation. Moreover, we propose an uncertainty quantification framework using conformal prediction to assess the sensitivity of the memory size and to showcase the robustness of the proposed method. Experimental results from tests on an electric Equinox vehicle highlight the superiority of our method in continually learning new information while retaining prior knowledge, outperforming state-of-the-art continual learning methods. Furthermore, EM-ReSeleCT significantly reduces training time, a critical advantage in continual learning applications.

持续学习时间序列车辆估计变换器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。