用恒等性机制让模型在持续学习中既不遗忘旧知识,又提升预测可靠性。
IDER: IDempotent Experience Replay for Reliable Continual Learning
- 通过恒等性设计使模型在重复训练时输出不变,增强稳定性。
- 在多个基准上同时提升准确率、降低遗忘率并改善预测置信度可靠性。
- 兼容主流重放方法,计算开销低,适合部署于关键任务系统。
灾难性遗忘是神经网络在学习新任务时遗忘先前知识的主要挑战。为应对这一问题,已有持续学习(CL)方法被提出并有效缓解遗忘。此外,在关键任务场景中,具备不确定性感知能力的模型可通过校准预测来可靠评估置信度。然而,现有不确定性感知的持续学习方法存在计算开销高、与主流重放方法不兼容的问题。为此,我们提出恒等性经验回放(IDER),基于函数重复应用结果不变的恒等性原理。具体而言,我们首先调整训练损失,使模型在当前数据流上具有恒等性;同时引入恒等性蒸馏损失:将当前模型输出反馈至旧检查点,最小化重构输出与原输出之间的距离。该方法构建了一个简单有效的新型基线,可无缝集成至其他持续学习框架。在多个持续学习基准上的大量实验表明,IDER在保持高准确率的同时显著减少遗忘,并提升预测可靠性。结果表明,恒等性是一种有潜力的原理,可用于构建高效且可信的现实世界持续学习系统。代码已开源:https://github.com/YutingLi0606/Idempotent-Continual-Learning。
原文摘要 · Abstract (English)
Catastrophic forgetting, the tendency of neural networks to forget previously learned knowledge when learning new tasks, has been a major challenge in continual learning (CL). To tackle this challenge, CL methods have been proposed and shown to reduce forgetting. Furthermore, CL models deployed in mission-critical settings can benefit from uncertainty awareness by calibrating their predictions to reliably assess their confidences. However, existing uncertainty-aware continual learning methods suffer from high computational overhead and incompatibility with mainstream replay methods. To address this, we propose idempotent experience replay (IDER), a novel approach based on the idempotent property where repeated function applications yield the same output. Specifically, we first adapt the training loss to make model idempotent on current data streams. In addition, we introduce an idempotence distillation loss. We feed the output of the current model back into the old checkpoint and then minimize the distance between this reprocessed output and the original output of the current model. This yields a simple and effective new baseline for building reliable continual learners, which can be seamlessly integrated with other CL approaches. Extensive experiments on different CL benchmarks demonstrate that IDER consistently improves prediction reliability while simultaneously boosting accuracy and reducing forgetting. Our results suggest the potential of idempotence as a promising principle for deploying efficient and trustworthy continual learning systems in real-world applications.Our code is available at https://github.com/YutingLi0606/Idempotent-Continual-Learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。