提出新方法缓解运动预测中持续学习的稳定与灵活矛盾。
Escaping Stability-Plasticity Dilemma in Online Continual Learning for Motion Forecasting via Synergetic Memory Rehearsal
- 用不等式约束控制记忆损失增量,保持知识稳定性。
- 根据损失梯度相似性选择重放样本,提升新知识学习效率。
- 适合自动驾驶场景下在线持续学习,避免遗忘旧数据。
深度神经网络在运动预测中表现优异,但大多数方法存在灾难性遗忘问题,在适应新数据后会丧失对旧场景的性能。现有持续学习方法虽强化了记忆稳定性(保留已学知识的能力),却常损害学习灵活性(有效获取新信息的能力)。为此,本文提出一种新型持续学习方法——协同记忆重放(Synergetic Memory Rehearsal, SyReM),用于基于DNN的运动预测。SyReM维护一个紧凑的记忆缓冲区以表征已学知识。为保障记忆稳定性,采用不等式约束限制记忆缓冲区上平均损失的增量。同时,设计选择性记忆重放机制,通过在线计算损失梯度余弦相似性,挑选与最近观测数据最相似的记忆样本进行重放,从而增强学习灵活性。由于重放样本来自已学场景,不会破坏记忆稳定性。我们在11个来自INTERACTION数据集的自然驾驶场景下,采用在线持续学习范式(数据以单次流形式到达)验证了该方法。结果表明,相较于非持续学习和主流持续学习基线,SyReM显著缓解了对过往场景的灾难性遗忘,同时提升了对新场景的预测准确率。代码已开源:https://github.com/BIT-Jack/SyReM。
原文摘要 · Abstract (English)
Deep neural networks (DNN) have achieved remarkable success in motion forecasting. However, most DNN-based methods suffer from catastrophic forgetting and fail to maintain their performance in previously learned scenarios after adapting to new data. Recent continual learning (CL) studies aim to mitigate this phenomenon by enhancing memory stability of DNN, i.e., the ability to retain learned knowledge. Yet, excessive emphasis on the memory stability often impairs learning plasticity, i.e., the capacity of DNN to acquire new information effectively. To address such stability-plasticity dilemma, this study proposes a novel CL method, synergetic memory rehearsal (SyReM), for DNN-based motion forecasting. SyReM maintains a compact memory buffer to represent learned knowledge. To ensure memory stability, it employs an inequality constraint that limits increments in the average loss over the memory buffer. Synergistically, a selective memory rehearsal mechanism is designed to enhance learning plasticity by selecting samples from the memory buffer that are most similar to recently observed data. This selection is based on an online-measured cosine similarity of loss gradients, ensuring targeted memory rehearsal. Since replayed samples originate from learned scenarios, this memory rehearsal mechanism avoids compromising memory stability. We validate SyReM under an online CL paradigm where training samples from diverse scenarios arrive as a one-pass stream. Experiments on 11 naturalistic driving datasets from INTERACTION demonstrate that, compared to non-CL and CL baselines, SyReM significantly mitigates catastrophic forgetting in past scenarios while improving forecasting accuracy in new ones. The implementation is publicly available at https://github.com/BIT-Jack/SyReM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。